What You'll Do
- Build a world-class team. Push your team to hone their craft, communicate expectations clearly, and build high trust through regular feedback.
- Drive world-class results. Prioritize mission-critical work, set aggressive timelines, and ensure the best ideas win by fostering an environment where all ideas are challenged.
- Design and develop robust, scalable, and high-performance data pipelines and ETL processes to extract, transform, and load data from various sources into our data warehouse or data lake.
- Monitor, troubleshoot, and resolve issues related to data quality, data consistency, and data integrity, ensuring the reliability and correctness of our data systems.
- Implement and maintain data governance practices and policies, ensuring compliance with data privacy and security regulations.
- Document data engineering processes, data flows, and system architectures to ensure knowledge sharing and maintain an up-to-date repository of technical documentation.
- Work closely with cross-functional teams, including software engineers and infrastructure teams, to optimize data infrastructure and ensure its seamless integration with other systems.
What You’ll Need
- Bachelor's degree in Computer Science, Engineering, or a related field.
- Proven experience as a Data Engineer or in a similar role, working with large-scale data processing and ETL pipelines.
- Experience managing a team for more than 2+ years.
- Excellent communication and collaboration skills, with the ability to work effectively in a cross-functional team environment
- Strong programming skills in languages such as Python, Java, or Scala, with experience in data manipulation and processing frameworks like Apache Spark.
- Experience with SQL and database technologies (e.g., relational databases, SQL queries, data modeling).
- Familiarity with data integration and workflow management tools such as Apache Airflow
- Knowledge of data warehousing concepts and experience with data warehousing solutions is highly desirable.
- Strong analytical and problem-solving skills, with the ability to analyze complex data-related issues and propose effective solutions.