Qualifications & Requirements:
· Bachelors / 4 year university degree
· Experience – Between 7-10 Years of Experience with below mentioned Skills
Must Have Skills
- Good understanding of Spark Architecture
- Good understanding of Data Architecture and solutions in Azure
- Good Skills in Azure Data Processing skills like Azure data Factory and Azure data Bricks
- Good experience in building data pipelines using ADF
- Strong proficiency in SQL and complex queries
- Good experience with programming languages such as Python, PySpark.
- Ability to learn and adapt to new data technologies
- Knowledge & experience with Containerization – Docker, Kubernetes
- Knowledge/Experience with Bigdata & Hadoop ecosystem – Spark, Hive, HBase, Sqoop etc.
- Build / Deployment Automation – Jenkins.
- Good problem-solving skills
- Good communication skills
- Act in a strategic capacity as a senior technical expert for all current Azure Cloud based solutions while keeping abreast of industry Cloud solutions
- Lead project independently & with minimal guidance, including high level client communication and project planning.
Good to Have
- Technical lead for Data Engineering – Data pipelines, Data modelling and Data warehouse.
- Experience of developing cloud-based API gateways
- Experience & exposure to API integration frameworks
- Certified in Azure Data Engineering (AZ-205)
- Excellent time management, communication, decision making, and presentation skills
Position Responsibilities:
· Work under supervision of Data Architects to gather requirements to create Datamodel for Data Science & Business Intelligence projects
· Work closely with Data Architects to create project plans & list down exhaustive list of activities to be carried out to implement solution
· Engage in client communications for all important functions including data understanding/exploration, strategizing solutions etc.
· Document the Metadata information about the data sources used in the project & present that information to team members during team meetings
· Design & Develop Data Marts, De-normalized views & Data Models for projects
· Design & Develop Data Quality control processes around the data sets used for analysis
· Mentoring & Grooming Junior Engineers
· Lead and Drive Knowledge sharing session within the team
· Own the technical deliveries of the team
· Work with Senior team members to develop new capabilities for the team
· Being Accountable
· Possess Achievable Drive
· Passionate about software development
· Looks forward to build and apply technical and functional skills
· Focuses on understanding Goals, Priorities and Plans
· Possess problem solving approach