You day to day role will include
- Drive business decisions with technical input and lead the team.
- Design, implement, and support an data infrastructure from scratch.
- Manage AWS resources, including EC2, EMR, S3, Glue, Redshift, and MWAA.
- Extract, transform, and load data from various sources using SQL and AWS big data technologies.
- Explore and learn the latest AWS technologies to enhance capabilities and efficiency.
- Collaborate with data scientists and BI engineers to adopt best practices in reporting and analysis.
- Improve ongoing reporting and analysis processes, automating or simplifying self-service support for customers.
- Build data platforms, data pipelines, or data management and governance tools.
BASIC QUALIFICATIONS for Data Engineer
- Bachelor's degree in Computer Science, Engineering, or a related field
- 3-5 years of experience in data engineering
- Strong understanding of AWS technologies, including S3, Redshift, Glue, and EMR
- Experience with data pipeline tools such as Airflow and Spark
- Experience with data modeling and data quality best practices
- Excellent problem-solving and analytical skills
- Strong communication and teamwork skills
- Experience in at least one modern scripting or programming language, such as Python, Java, or Scala
- Strong advanced SQL skills
PREFERRED QUALIFICATIONS
- AWS cloud technologies: Redshift, S3, Glue, EMR, Kinesis, Firehose, Lambda, IAM, Airflow
- Prior experience in Indian Banking segment and/or Fintech is desired.
- Experience with Non-relational databases and data stores
- Building and operating highly available, distributed data processing systems for large datasets
- Professional software engineering and best practices for the full software development life cycle
- Designing, developing, and implementing different types of data warehousing layers
- Leading the design, implementation, and successful delivery of large-scale, critical, or complex data solutions
- Building scalable data infrastructure and understanding distributed systems concepts
- SQL, ETL, and data modelling
- Ensuring the accuracy and availability of data to customers
- Proficient in at least one scripting or programming language for handling large volume data processing
- Strong presentation and communications skills.
- For Managers,
- Customer centricity, obsession for customer
- Ability to manage stakeholders (product owners, business stakeholders, cross function teams) to coach agile ways of working.
- Ability to structure, organize teams, and streamline communication.
- Prior work experience to execute large scale Data Engineering projects