Job Duties: • Design, implement, and maintain data pipelines and data integration solutions using Azure Synapse
• Develop and optimize data models and data storage solutions on Azure
• Collaborate with data scientists and analysts to implement data processing and data transformation tasks.
• Ensure data quality and integrity through data validation and cleansing methodologies.
• Monitor and troubleshoot data pipelines to identify and resolve performance issues.
• Collaborate with cross-functional teams to understand and prioritize data requirements.
• Stay up-to-date with the latest trends and technologies in data engineering and Azure services.
Minimum Skills Required: • Bachelor’s degree in IT, computer science, computer engineering, or similar
• 8+ years of experience in Data Engineering.
• Microsoft Azure Synapse Analytics experience is essential. (Azure Data Factory, Dedicated SQL Pool, Lake Database, Azure Storage)
• End-to-end Data Warehouse experience: Ingestion, ETL, big data pipelines, data architecture, message queuing, BI/Reporting, and Data Security.
• Advanced SQL/relational database knowledge and query authoring.
• Demonstrated experience in design and delivering data platforms for Business Intelligence and Data Warehouse.
• Strong skills in handling and analysing complex, high volume data with excellent attention in details.
• Knowledge of data modelling and data warehousing concepts, such as DataVault or 3NF.
• Experience with Data Governance (Quality, Lineage, Data dictionary, and Security).
• Proficiency in programming languages such as Python/Scala or equivalent for data engineering tasks.
• Familiar with Agile methodology and Agile working environment.
• Ability to work alone with POs, BAs, Architects.