Roles & responsibilities:
- Lead the design and architecture of scalable, maintainable, and secure full-stack applications.
- Collaborate with product managers, designers, and other stakeholders to translate business requirements into technical solutions.
- Ensure adherence to best practices in software design, including modularity, reusability, and maintainability.
- Utilise AWS services such as S3, Lambda, Glue, Step Functions, and CloudWatch to build and manage data solutions.
- Implement best practices for AWS security, cost management, and performance optimisation.
- Stay updated with the latest AWS offerings and evaluate their potential impact on the data infrastructure.
- Lead the design and implementation of data management solutions, ensuring data integrity, quality, and accessibility.
- Develop and maintain data models, data pipelines, and ETL processes.
- Implement data governance and compliance measures to adhere to regulatory requirements.
Essential skills:
- Minimum 15+Years of experience
- ·Utilize AWS services such as S3, Lambda, Glue, Step Functions, and CloudWatch to build and manage data solutions.
- Implement best practices for AWS security, cost management, and performance optimization.
- Stay updated with the latest AWS offerings and evaluate their potential impact on our data infrastructure.
- Demonstrated expertise in dashboard and backend development, with a strong focus on SQL.
- Proficient in JavaScript, Python, SQL, and DBT.
- Extensive experience in building data lakes and data warehouses.
- Mastery of both SQL and NoSQL databases, data ingestion processes, ETL pipelines, and data integration.
- Architect and implement real-time data streaming solutions using technologies such as Apache Kafka, AWS Kinesis, or similar.
- Ensure high availability, scalability, and low latency of data streaming pipelines.
- Collaborate with data scientists and analysts to enable real-time data analytics and insights.
- Proficient in data profiling techniques and tools.
- Lead the design and implementation of data management solutions, ensuring data integrity, quality, and accessibility.
- Develop and maintain data models, data pipelines, and ETL processes.
- Implement data governance and compliance measures to adhere to regulatory requirements.
Education Qualification: Bachelor’s degree or master’s degree in engineering in Computer Science/Information Technology.