Your work profile
As a Consultant in our Cyber Team you’ll build and nurture positive working relationships with teams and clients with the intention to exceed client expectations:
We are looking for a highly skilled Data Engineer with hands-on experience in AWS Glue and Snowflake to design and build efficient, scalable, and reliable data pipelines and warehouse solutions. This role involves working with large datasets, integrating various sources, and optimizing data processes for analytics and reporting use cases.
AWS Glue:
- Design and develop ETL pipelines using AWS Glue (Spark & Python).
- Configure Glue Crawlers, Data Catalogs, and Workflows for metadata management.
- Tune Glue jobs for performance and cost-efficiency (e.g., job bookmarks, partitioning).
- Integrate AWS Glue with S3, Redshift, RDS, and Athena for data ingestion and querying.
Snowflake:
- Build and manage data warehouses and data marts on Snowflake.
- Develop SQL scripts, stored procedures, and UDFs for data transformation and cleansing.
- Implement Snowflake Streams, Tasks, and Snowpipe for continuous data ingestion.
- Optimize query performance using clustering, partitioning, and warehouse scaling.
- Manage RBAC, data masking, and row-level security for sensitive data.
JIRA:
- Manage and customize JIRA workflows, permissions, and integrations to optimize tracking and team collaboration
Desired qualifications
- Education: Bachelor’s degree in Information Security, Computer Science, or a related field. A Master’s degree in Cybersecurity or Business Management is preferred.
- Experience:
- 2 to 3 years of overall experience
- Data engineering with solid expertise in AWS Glue and Snowflake.
- Strong programming skills in Python and PySpark.
- Proficient in SQL for complex queries and data modeling.
- Deep understanding of data lake and warehouse architecture.
- Experience with cloud-native services (S3, Lambda, IAM, Athena).
- Familiarity with ETL/ELT best practices, performance tuning, and cost optimization.
Location and way of working
- Base location: Bangalore
- Professional is required to work from office
Your role as a Consultant