Business Technology Solutions Associate - Big Data Engineer

What you’ll do:

1. Work with business stakeholders to understand their business needs.
2. Create data pipelines that extract, transform, and load (ETL) from various sources into a usable format in a Data warehouse.
3. Clean, filter, and validate data to ensure it meets quality and format standards.
4. Develop data model objects (tables, views) to transform the data into unified format for downstream consumption.
5. Expert in monitoring, controlling, configuring, and maintaining processes in cloud data platform.
6. Optimize data pipelines and data storage for performance and efficiency.
7. Participate in code reviews and provide meaningful feedback to other team members.
8. Provide technical support and troubleshoot issue(s).

What you’ll bring:

1. Bachelor’s degree in Computer Science, Information Technology, or a related field, or equivalent work experience.
2. Experience working in the AWS cloud platform.
3. Data engineer with expertise in developing big data and data warehouse platforms.
4. Experience working with structured and semi-structured data.
5. Expertise in developing big data solutions, ETL/ELT pipelines for data ingestion, data transformation, and optimization techniques.
6. Experience working directly with technical and business teams.
7. Able to create technical documentation.
8. Excellent problem-solving and analytical skills.
9. Strong communication and collaboration abilities.
10. AWS (Big Data services) - S3, Glue, Athena, EMR
11. Programming - Python, Spark, SQL, Mulesoft,Talend, Dbt
12. Data warehouse - ETL, Redshift / Snowflake

Additional Skills:

1. Experience in data modeling.
2. Certified in AWS platform for Data Engineer skills.
3. Experience with ITSM processes/tools such as ServiceNow, Jira
4. Understanding of Spark, Hive, Kafka, Kinesis, Spark Streaming, and Airflow