Roles and Responsibilities
- You will engage in a diverse range of impactful customer technical Data platform projects, Including the development.
- Lead strategic initiatives encompassing the end-to-end design, build, and deployment of industry-leading.
- Collaborate with platform engineering teams to effectively implement Data Brick services within our infrastructure.
- Leverage your hands-on experience with Data Bricks Unity Catalog to implement robust data governance and lineage capabilities.
- Advocate for and implement CI/CD practices to streamline the deployment of Data bricks solutions.
- Contribute to developing a data mesh architecture, promoting decentralized data ownership and accessibility across the organization.
- Understand and articulate the analytics capabilities of the Data platform, enabling teams to derive actionable insights from their data.
Skills and Qualifications
Cloud and Architectures:
- Azure Architecture and Platform: Expertise in Azure Data Lake, AI/ML model hosting, Key Vault, Event Hub, Logic Apps, and other Azure cloud services.
- Databricks Development: Strong integration with Azure, workflow orchestration, and governance.
- Data Engineering & Architecture: Hands-on experience with scalable ETL/ELT pipelines, Delta Lake, and enterprise data management.
Coding and Implementation:
- Software Engineering: Modular design, CI/CD, version control, and best coding and design practices.
- Python and PySpark: Experience in building reusable packages and components for both technical and business users, including data validation, lineage modules, and accelerators for data processing.
Process and Compliance:
- Enterprise Process Understanding: Experience with large-scale workflows, structured environments, and compliance frameworks.
- Governance and Security: Knowledge of data lineage, GxP, HIPAA, GDP compliance, and regulatory requirements.
- Pharma, MedTech, Life Sciences (Good to Have): Understanding industry-specific data, regulatory constraints, and security considerations.