Senior Data Engineer (Azure Databricks)

RESPONSIBILITIES:

1. Writing and testing code for Data & Analytics applications and building E2E cloud native (Azure) solutions.
2. Engineering applications throughout its entire lifecycle from development, deployment, upgrade, and replacement/termination
3. Ensuring that development and architecture enforce to established standards, including modern software engineering practices (CICD, Agile, DevOps)
4. Collaborate with internal technical specialists and vendors to develop final products to improve overall performance, efficiency and/or to enable adaptation of new business processes.

Job Qualifications

Qualifications

1. Bachelor’s degree in computer science or related technical field.
2. 8+ years of experience working as Software/Data Engineer (with focus on developing in Python, PySpark, Databricks, ADF)
3. Experience leveraging modern software engineering practices (code standards, Gitflow, automated testing, CICD, DevOps)
4. Experience working with Cloud infrastructure (Azure preferred)
5. Strong verbal, written, and interpersonal communication skills.
6. A strong desire to produce high quality software through cross functional collaboration, testing, code reviews, and other best practices.
7. Data Modeling: Knowledge of data modeling techniques and experience with data modeling tools.
8. Database Technologies: Familiarity with relational databases (e.g., SQL Server) for data storage and retrieval.
9. Data Warehousing: Understanding of data warehousing concepts, dimensional modeling, and experience with data warehousing technologies such as Azure Synapse Analytics or Azure SQL Data Warehouse or Azure Databricks DeltaLake
10. Data Governance: Knowledge of data governance principles, data security, privacy regulations (e.g., GDPR, CCPA), and experience implementing data governance practices.
11. Data Visualization: Experience of working with Microsoft Power BI to build semantic data model & BI reports/dashboards.

YOU ALSO SHOULD HAVE:

1. Strong written and verbal English communication skills to influence others
2. Demonstrated use of data and tools
3. Ability to handle multiple priorities
4. Ability to work collaboratively across different functions and geographies