MA

Lead Data Engineer

Mastercard

10 months ago

5 - 7 years

Work From Office

Pune, Maharashtra, Maharashtra, India

  • Leads initiatives to build and maintain database technologies, environments, and applications.
  • Writes SQL statement procedures to optimize SQL execution and query development.
  • Manages the deployment of data solutions that are optimally standardized and database updates to meet project deliverables.
  • SQL

    Spark

    Data Modeling

    ETL Processes

    DataBricks

    Snowflake

    PYTHON

    Job description & requirements

    Role


    • Leads initiatives to build and maintain database technologies, environments, and applications, seeking opportunities for improvements and efficiencies

    • Architects internal data solutions as part of the full stack to include data modelling, integration with file based as well as event driven upstream systems

    • Writes SQL statement procedures to optimize SQL execution and query development

    • Effectively utilizes various tools such as Spark (Scala, Python), Nifi, Spark streaming, Informatica for data ETL,

    • Manages the deployment of data solutions that are optimally standardized and database updates to meet project deliverables

    • Leads database security posture, which includes proactively identifying security risks and implementing both risk mitigation plans and control functions

    • Oversees the resolution of chronic complex problems to prevent future data performance issues

    • Supports process improvement efforts to identify and test opportunities for automation and/or reduction in time to deployment

    • Responsible for complex design (in conjunction with Data Architects), development, and performance and system testing, and provides functional guidance, advice to experienced engineers

    • Mentors junior staff by providing training to develop technical skills and capabilities across the team


    All about you


    • Experience developing a specialization in a particular functional area (e.g., modeling, data loads, transformations, replication, performance tuning, logical and physical database design, performance and troubleshooting, data replication, backup and recovery, and data security) leveraging Apache Spark, Nifi, Databricks, Snowflake, Informatica, streaming solutions.

    • Experience leading a major work stream or multiple smaller work streams for a large domain initiative, often providing technical guidance and advice to project team members

    • Experience creating deliverables within the global database technology domains and sub-domains, supporting cross-functional leaders in the technical community to derive new solutions

    • Experience supporting automation and/or cloud delivery effort; may perform financial and cost analysis

    • Experience in database architecture or other relevant IT experience

    • Experience in leading business system application and database architecture design, influencing technology direction in range of breadth of IT areas

    Experience :

    5 - 7 years

    Job Domain/Function :

    Data Engineering

    Job Type :

    Work From Office

    Employment Type :

    Full Time

    Number Of Position(s) :

    1

    Educational Qualifications :

    Bachelor's Degree

    Location :

    Pune, Maharashtra, India, Pune, Maharashtra, India

    Create alert for similar jobs

    MA

    Mastercard

    Similar Jobs