Roles & responsibilities:
· Lead the design and architecture of scalable, maintainable, and secure full-stack applications.
· Collaborate with product managers, designers, and other stakeholders to translate business requirements into technical solutions.
· Ensure adherence to best practices in software design, including modularity, reusability, and maintainability.
· Utilise AWS services such as S3, Lambda, Glue, Step Functions, and CloudWatch to build and manage data solutions.
· Implement best practices for AWS security, cost management, and performance optimisation.
· Stay updated with the latest AWS offerings and evaluate their potential impact on the data infrastructure.
· Lead the design and implementation of data management solutions, ensuring data integrity, quality, and accessibility.
· Develop and maintain data models, data pipelines, and ETL processes.
· Implement data governance and compliance measures to adhere to regulatory requirements.
Essential skills:
. Minimum 15+Years of experience
· Utilize AWS services such as S3, Lambda, Glue, Step Functions, and CloudWatch to build and manage data solutions.
· Implement best practices for AWS security, cost management, and performance optimization.
· Stay updated with the latest AWS offerings and evaluate their potential impact on our data infrastructure.
· Demonstrated expertise in dashboard and backend development, with a strong focus on SQL.
· Proficient in JavaScript, Python, SQL, and DBT.
· Extensive experience in building data lakes and data warehouses.
· Mastery of both SQL and NoSQL databases, data ingestion processes, ETL pipelines, and data integration.
· Architect and implement real-time data streaming solutions using technologies such as Apache Kafka, AWS Kinesis, or similar.
· Ensure high availability, scalability, and low latency of data streaming pipelines.
· Collaborate with data scientists and analysts to enable real-time data analytics and insights.
· Proficient in data profiling techniques and tools.
· Lead the design and implementation of data management solutions, ensuring data integrity, quality, and accessibility.
· Develop and maintain data models, data pipelines, and ETL processes.
· Implement data governance and compliance measures to adhere to regulatory requirements.
Education Qualification: Bachelor’s degree or master’s degree in engineering in Computer Science/Information Technology.