ME

Data Engineer I

Merck

9 months ago

7 - 10 years

Work From Office

Bengaluru, Karnataka, Karnataka, India

  • Develop data pipelines by ingesting various data sources – structured and un-structured – into Palantir Foundry
  • Participate in end-to-end project lifecycle, from requirements analysis to go-live and operations of an application
  • Hadoop

    Application Development

    Spark

    Data Structures

    GIT

    ETL

    Programming

    SQL

    Aws

    Analytics

    Data pipelines

    PySpark

    Postgres

    Cloud Platforms

    Job description & requirements

    Roles & Responsibilities: 


    • Develop data pipelines by ingesting various data sources – structured and un-structured – into Palantir Foundry
    • Participate in end-to-end project lifecycle, from requirements analysis to go-live and operations of an application
    • Acts as business analyst for developing requirements for Foundry pipelines
    • Review code developed by other data engineers and check against platform-specific standards, cross-cutting concerns, coding and configuration standards and functional specification of the pipeline
    • Document technical work in a professional and transparent way. Create high quality technical documentation
    • Work out the best possible balance between technical feasibility and business requirements (the latter can be quite strict)
    • Deploy applications on Foundry platform infrastructure with clearly defined checks
    • Implementation of changes and bug fixes via change management framework and according to system engineering practices (additional training will be provided)
    • DevOps project setup following Agile principles (e.g. Scrum)
    • Besides working on projects, act as third level support for critical applications; analyze and resolve complex incidents/problems. Debug problems across a full stack of Foundry and code based on Python with Spark
    • Work closely with business users, data scientists/analysts to design physical data models
    •  

    Education 

    • B.Sc. (or higher) degree in Computer Science, Engineering, Mathematics, or related fields 

     

    Professional Experience  

    • 5+ years of experience in system engineering or software development
    • 3+ years of experience in data and analytics.
    • 0-2 years of experience for intern in data analytis


    Specific information related to the position:

    • Physical presence in primary work location (Bangalore)
    • Flexible to work CEST and US EST time zones (according to team rotation plan)
    • Willingness to travel to Germany, US and potentially other locations (as per project demand)

    Experience :

    7 - 10 years

    Job Domain/Function :

    Data Engineering

    Job Type :

    Work From Office

    Employment Type :

    Full Time

    Number Of Position(s) :

    1

    Educational Qualifications :

    Bachelor's Degree

    Location :

    Bengaluru, Karnataka, India, Bengaluru, Karnataka, India

    Create alert for similar jobs

    Similar Jobs