As a Data Engineer you will be building and maintaining data systems and construct datasets that are easy to analyze and support Business Intelligence requirements as well as downstream systems.
Responsibilities
- Develops and maintains scalable data pipelines and builds out new integrations using AWS native technologies to support continuing increases in data source, volume, and complexity.
- Collaborates with analytics and business teams to improve data models that feed business intelligence tools and dashboards, increasing data accessibility and fostering data-driven decision making across the organization.
- Implements processes and systems to drive data reconciliation, monitor data quality, ensuring production data is always accurate and available for key stakeholders, downstream systems, and business processes that depend on it.
- Writes unit/integration/performance test scripts, contributes to engineering wiki, and documents work.
- Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
- Works closely with a team of frontend and backend engineers, product managers, and analysts.
- Works closely with enterprise teams including Enterprise Architecture, Security, and Enterprise Data Backbone Engineering to design and develop data integration patterns/solutions along with proper data models supporting different data and analytics use cases.
Skills and Qualifications
- Bachelors’ Degree, from an accredited institution in Engineering, Computer Science, or related field.
- 3+ years of experience in software, data, data warehouse, data lake, and analytics reporting development.
- Solid experience in data/Big Data, data integration, data model, modern database (Graph, SQL, No-SQL, etc.) query languages and AWS cloud technologies
- Experience with building, maintaining and monitoring Data Pipelines.
- Experience with Databricks (PySpark).
- Experience designing, building, maintaining data interactions using SOAP/REST web services/API, as well as schema design and dimensional data modeling.
- Excellent written and verbal communication skills including the ability to interact effectively with multifunctional teams.