Impact & contribution
- We are looking to hire a Sr. Data Engineer to develop and deliver the vision in Retail Technology. This high availability, modernised platform powers many critical elements of the customer experience for our products.
- Roles & Responsibilities:
- Contribute to the technical design for system enhancements.
- Apply deployment mechanisms for CI/CD pipelines and Release Management on data platforms.
- Provide technical assistance to other members of the team.
- Participate actively in peer reviews.
- Identify and drive opportunities for continuous improvement within the team and in delivery of products.
- Produce high quality, sustainable solutions to meet business requirements, leveraging approved delivery frameworks and by applying industry best practice.
- Collaborate with stakeholders to ensure that solutions are robust, secure and highly available.
- Complete data engineering duties aligned to core concepts of data design, preparation, transformation, and load.
- Build data pipelines in distributed data platforms including warehouses, databases, data lakes and cloud lakehouses to enable data predictions and models, and reporting and visualisation analysis via data integration tools and frameworks
Essential Skills
- 9+ years’ experience in design, architecture or development in Analytics and Data Warehousing.
- Extensive experience with Cloudera Hadoop, Teradata & data warehouses. Proficient across Enterprise Analytics/BI/DW/ETL technologies such as Teradata Control Framework, Apache Spark, Hive.
- Experience in Development projects using Ab Initio, Snowflake, AWS/Cloud Services
- Nice to have Knowledge on Data Analysis; Banking Domain Experience
- Experience in working within a Data Delivery Life Cycle framework & Agile Methodology.
- Extensive experience in large enterprise environments handling large volume of datasets with High SLAs and in creating reusable group data asset.
- Develop highly reliable data pipelines and data platforms with comprehensive test coverage with limited supervision.
Education Qualifications
- Bachelor’s degree/master’s degree in engineering in Computer Science/Information Technology or any similar stream