As a Data Engineer in the IT team, you will work on various big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical tasks to help business to get most value out of their data.
The impact you will have:
- You will work on a variety of impactful Big Data projects which may include building reference architectures, how-to's and production grade MVPs
- Work on implementing transformational big data projects, 3rd party migrations, including end-to-end design, build and deployment of industry-leading big data and AI applications
- Work on architecture and design; bootstrap or implement strategic projects.
What we look for:
- 7+ years experience with Big Data Technologies such as Apache Spark™, Kafka, Cloud Native and Data Lakes
- 4+ years of experience working on Big Data Architectures independently
- Preferred experience working in the Databricks ecosystem
- Comfortable writing code in either Python or Scala.
- Experience working across Cloud Platforms (GCP / AWS / Azure)
- Documentation and white-boarding skills.
- Build skills in technical areas which support the deployment and integration of Databricks-based solutions to complete customer projects.