Roles & Responsibilities:
- Design and develop highly reliable and scalable data pipelines and data platforms with comprehensive test coverage.
- Collaborate with stakeholders to analyse and translate requirements to technical implementation.
- Identify and drive opportunities for continuous improvement within the team and in delivery of products.
- Provide mentoring and technical assistance to other members of the team, including more junior Data Engineers.
- Produce high quality, sustainable solutions to meet business requirements, leveraging approved delivery frameworks and by applying industry best practice.
- Provide technical governance of product delivery to ensure successful delivery and adoption. Deliver data engineering solutions aligned to core concepts of data design, preparation, transformation, and load.
- Build and implement data pipelines in distributed data platforms including warehouses, databases, data lakes and cloud lake houses to enable data predictions and models, and reporting and visualisation analysis via data integration tools and frameworks.
- Contribute to domain planning, providing guidance to ensure that technical deliveries are aligned to engineering direction and strategy.
Essential Skills:
- 7-10 years experience of relevant experience
- Hadoop, Spark, Scala/Python, Hive, SQL, AWS(Cloud), HDFS .
Education Qualifications:
- Bachelor’s degree in engineering in Computer Science/Information Technology