Cloud Data Engineer

Your role:

1. Designs, creates, tests and maintains data pipelines and storage (inbound, inflight, etc); Creates end-to-end vision for how data will flow through an organization
2. Maintains the infrastructure required for extracting, transforming and loading (ETL/ELT) the data from a wide variety of data sources
3. Responsible for database design, data warehousing, setting up a data lake, design and implementation of data protection
4. Address non-functional infrastructure requirements with a strong focus on end-users, high quality (QMS/regulatory standards), performance, safety and security, privacy, scalability, reliability, durability, availability, backups
5. Establish and follow quality measures for data sets Keeps abreast of technical knowledge by studying and implementing state-of-the-art programming techniques and development tools, participating in educational opportunities, participating in communities of practice, reading professional publications and maintaining personal networks

Key Responsibilities:

1. Develop scalable data pipelines using AWS Glue, Lambda and other AWS services
2. Define workflow for data ingestion, cleansing, transformation, and storage using S3, Athena, Glue and other AWS services
3. Ensure data security, compliance, and governance
4. Implement robust monitoring and alerting mechanisms using CloudWatch and custom metrics for pipeline health and data quality
5. Contribute to cloud optimization, cost control, and architectural design reviews.

You're the right fit if:

1. Strong hands-on experience in AWS Data Engineering - S3, Lambda, Athena, S3, API Gateway, CloudFront, ECS and Glue
2. Solid understanding of data modeling, partitioning strategies, and performance tuning in large datasets
3. Familiarity with tools like CloudFormation for infrastructure automation
4. Proficiency in Python and SQL
5. Strong in SQL, Datawarehousing, Data Modelling
6. Awareness of latest datalake architectures (Iceberg, S3 tables, duckdb)
7. Knowledge of serviceability domain use cases such as diagnostics, telemetry, and predictive service operations is a plus
8. Strong communication and stakeholder management skills.

Minimum required Education:

1. Bachelor's / Master's Degree in Computer Science, Software Engineering, Information Technology or equivalent.

Minimum required Experience:

1. Minimum 6-8 years of experience with Bachelor's in areas such as Software Development, Testing and Quality Assurance or equivalent