We are seeking a highly skilled and experienced Senior Data Engineer (Technical Lead) to lead the design, development, and management of data systems and pipelines that enable data-driven decision-making. In this role, you will oversee a team of data engineers, drive technical architecture decisions, and work closely with data scientists, analysts, and other stakeholders to ensure the smooth integration of data solutions across various platforms. You will be responsible for optimizing data flows, ensuring data quality, and driving innovation in how we store, process, and utilize large datasets.
Required Skills & Qualifications: Experience: 10+ years of hands-on experience in data engineering or a related field, with at least 2+ years in a technical lead or leadership role. Should have extensively worked on migration projects, leading teams and interacting with Architect roles and Client for a minimum of 2 projects
Technical Skills: Strong proficiency in programming languages such as Spark or Python or Java, or Scala. Deep experience with Spark SQL / SQL, data warehousing, ETL frameworks, and cloud-based data platforms (e.g., AWS, GCP, Azure). Big Data Technologies: Experience with bigdata tools such as Cloudera Hive, Apache Spark, Hadoop, Kafka, and other distributed computing technologies. Data Warehousing & Databases: Expertise in relational, MPP and NoSQL databases, data modeling, and data warehousing solutions such as Teradata, Snowflake, Redshift, or BigQuery. Cloud Platforms: Hands-on experience with cloud platforms (AWS, GCP, or Azure) and cloud-based data services. Data Pipeline Development: Proven track record in building, optimizing, and managing data pipelines for large datasets and high-availability systems. Team Leadership: Experience leading a team of data engineers and collaborating with cross-functional teams. Problem Solving: Strong analytical and troubleshooting skills with the ability to resolve complex data issues and improve system performance. Communication Skills: Excellent communication and collaboration skills, with the ability to present technical concepts to non-technical stakeholders and lead team discussions.