Overview
Hands-on Data Engineer role building the data foundations for analytics and AI, bridging raw data and production-ready AI solutions within the Databricks ecosystem.
What you'll do
- Architect, build and maintain scalable data pipelines to support AI/ML workflows, including feature engineering and model training datasets.
- Design and implement robust data pipelines, data lakes and data warehousing solutions.
- Partner with data scientists and analysts to deploy machine learning models and analytics solutions on Databricks.
- Enhance Databricks cluster performance, ensuring cost-effectiveness and efficient resource utilization.
- Implement Databricks security features, enforce data governance and maintain compliance with industry standards.
- Collaborate with data scientists to deploy and operationalize machine learning models into production environments securely.
- Contribute to the technical direction and best practices of data engineering initiatives.
- Stay current with Databricks innovations, best practices and industry trends, and share knowledge across the team.
What you'll need
- 1-4 years of total experience in data engineering or related fields.
- Solid experience with Databricks, focusing on platform engineering, data engineering and analytics.
- Proficiency in Python, Scala or Java.
- Strong experience with Databricks APIs, Apache Spark and Delta Lake.
- Solid experience in data warehousing, ETL processes and data governance frameworks.
- Practical experience supporting AI/ML lifecycles, including familiarity with ML frameworks (e.g., TensorFlow, PyTorch) or MLOps practices.
- Proven ability to work independently, take ownership of projects and collaborate effectively with a team.
- Excellent interpersonal and communication skills for effective collaboration with stakeholders.
Nice to have
- Hands-on experience with AWS, Azure or GCP.
- Databricks Certified Professional or equivalent certification.
- Familiarity with ML concepts and popular libraries (e.g., TensorFlow, PyTorch, Scikit-learn).
Details
- Flexible schedule and remote working benefits.
Read the full description and apply on the company’s own careers page.