Responsibilities
• You will develop and maintain data pipelines, including solutions for data collection, management, transformation, and usage, ensuring accurate data ingestion and readiness for downstream analysis, visualization, and AI model training.
• You will review, design, and implement end-to-end software life cycles, encompassing design, development, CI/CD, service reliability, recoverability, and participation in agile development practices, including on-call rotation.
• You will review and write code to implement performance monitoring protocols across data pipelines, building visualizations and aggregations to monitor pipeline health. You’ll also implement solutions and self-healing processes that minimize points of failure across multiple product features.
• You will anticipate data governance needs, designing data modeling and handling procedures to ensure compliance with all applicable laws and policies.
• You will plan, implement, and enforce security and access control measures to protect sensitive resources and data.
• You will perform database administration tasks, including maintenance, and performance monitoring.
• You will collaborate with Product Managers, Data and Applied Scientists, Software and Quality Engineers, and other stakeholders to understand data requirements and deliver phased solutions that meet test and quality programs data needs, and support AI model training and inference.
• You will become an SME of our teams products and provide inputs for strategic vision.
• You will champion process, engineering, architecture, and product best practices in the team.
- You will work with other team Seniors and Principles to establish best practices in our organization.
Qualifications
Required/Minimum Qualifications
• Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 6+ years' experience in business analytics, data science, software development, data modeling or data engineering work
o OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years' experience in business analytics, data science, software development, or data engineering work
o OR equivalent experience.
• 4+ years of experience in software or data engineering, with proven proficiency in C#, Java, or equivalent.
• 4+ years in one scripting language for data retrieval and manipulation (e.g., SQL or KQL).
• 4+ years of experience with ETL and data cloud computing technologies, including Azure Data Lake, Azure Data Factory, Azure Synapse, Azure Logic Apps, Azure Functions, Azure Data Explorer, and Power BI or equivalent platforms.
Other Requirements
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check:
- This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Preferred/Additional Qualifications
• Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 8+ years' experience in business analytics, data science, software development, data modeling or data engineering work
o OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 6+ years of business analytics, data science, software development, data modeling or data engineering work experience
o OR equivalent experience.
• 3+ years of demonstrated experience implementing data governance practices, including data access, security and privacy controls and monitoring to comply with regulatory standards.
• 3+ years of experience in MLOps, covering the entire machine learning lifecycle: data ingestion, preprocessing, model training, validation, deployment, and monitoring.