CA

Data Engineer

Capgemini

6 months ago

5 - 7 years

Hybrid

Kolkata, West Bengal, West Bengal, India

ETL Pipelines

SQL

ETL Processes

Azure Synapse

Azure Data Lake Storage

Azure Data Factory

databricks

PL/SQL

Data Processing

Azure data services

Python

CI/CD pipeline

Job description & requirements

Your role

  1. Develop and maintain data pipelines tailored to Azure environments, ensuring security and compliance with client data standards.
  2. Collaborate with cross-functional teams to gather data requirements, translate them into technical specifications, and develop data models.
  3. Leverage Python libraries for data handling, enhancing processing efficiency and robustness.
  4. Ensure SQL workflows meet client performance standards and handle large data volumes effectively.
  5. Build and maintain reliable ETL pipelines, supporting full and incremental loads and ensuring data integrity and scalability in ETL processes.
  6. Implement CI/CD pipelines for automated deployment and testing of data solutions.
  7. Optimize and tune data workflows and processes to ensure high performance and reliability.
  8. Monitor, troubleshoot, and optimize data processes for performance and reliability.
  9. Document data infrastructure, workflows, and maintain industry knowledge in data engineering and cloud tech.

Your Profile

  1. Bachelor’s degree in computer science, Information Systems, or a related field
  2. 4+ years of data engineering experience with a strong focus on Azure data services for client-centric solutions.
  3. Extensive expertise in Azure Synapse, Data Lake Storage, Data Factory, Databricks, and Blob Storage, ensuring secure, compliant data handling for clients.
  4. Good interpersonal communication skills
  5. Skilled in designing and maintaining scalable data pipelines tailored to client needs in Azure environments.
  6. Proficient in SQL and PL/SQL for complex data processing and client-specific analytics.

Experience :

5 - 7 years

Job Domain/Function :

Data Engineer

Job Type :

Hybrid

Employment Type :

Full Time

Number Of Position(s) :

1

Educational Qualifications :

Bachelor's Degree

Location :

Kolkata, West Bengal, India, Kolkata, West Bengal, India

Create alert for similar jobs

CA

Capgemini

Similar Jobs