Senior Data Engineer – Databricks | AI & Cloud Engineering

apartmentNetwork Contracting placeJohannesburg business_centerR 70,000/month calendar_month 
data platforms come together to drive impactful business solutions. We are seeking a highly skilled Senior Data Engineer to design, build, and optimise scalable cloud-native data platforms supporting analytics, AI, and enterprise reporting solutions.

This opportunity offers exposure to modern lakehouse environments, enterprise-scale data engineering, and AI-enabled platforms within a collaborative Agile team.

The successful candidate will work closely with engineering, analytics, and product teams to deliver high-quality data solutions across cloud platforms and enterprise environments.

Key Responsibilities:
  • Design, build, and maintain scalable ETL/data pipelines
  • Develop enterprise data solutions using Databricks and Apache Spark
  • Support analytics, AI, and reporting workloads
  • Ensure data quality, governance, and operational stability
  • Collaborate with cross-functional Agile teams
  • Implement CI/CD and engineering best practices

Job Experience & Skills Required / Ideal Candidate Profile: Education

  • Bachelors Degree in Computer Science, Information Technology, Engineering, Data Science, or related field
  • Databricks Certified Data Engineer (Advantageous)
  • Microsoft Azure Data Engineer Associate
  • AWS Certified Data Engineer / AWS Certified Solutions Architect
  • Azure AI Engineer Associate (Advantageous)
  • Databricks Lakehouse Fundamentals
  • Apache Spark Certifications (Advantageous)
Experience
  • Experience working with AI/GenAI data platforms and modern lakehouse environments
  • 5+ years experience as a Senior / Lead Data Engineer
  • Hands-on experience with Databricks and cloud-native data platforms
  • Experience building production-grade ETL/data pipelines
  • Experience working within enterprise or regulated environments
  • Exposure to AI, ML, or Generative AI environments advantageous
  • Experience working within Agile delivery teams
Skills
  • Databricks
  • Python
  • SQL
  • Apache Spark / PySpark
  • AWS or Azure
  • ETL / ELT pipelines
  • Data Lake / Lakehouse architectures
  • CI/CD practices
  • Data governance and data quality management

Apply now!

thumb_up_altRecommended

Senior Data Engineer

apartmentChosen Online Pty LtdplaceJohannesburg
Are you a passionate Senior Data Engineer who loves building robust, scalable data solutions that power analytics, machine learning, and business transformation? We are looking for a talented and experienced Senior Data Engineer to join a dynamic...
business_centerHigh salary

Data Engineer

apartmentIOCOplaceJohannesburg
We are seeking a skilled Data Engineer to support the design, development, and maintenance of scalable data solutions within a banking environment. The role will focus on building reliable data pipelines, integrating data from multiple sources...
local_fire_departmentUrgent

Senior Data Engineer

apartmentPsybergate (Pty) LTDplaceJohannesburg
Implement automated testing and CI/CD practices for data engineering workloads  •  Ensure data solutions are observable, resilient, performant, and cost-efficient  •  Support operational stability, incident resolution, and root cause analysis  •  Collaborate...