Data Engineer (Databricks, AWS, Python) – JHB – up to R450k per annum

Join a global financial services organisation whose core purpose is to seek out and invest in exceptional individuals who understand and support their core purpose, and whose values align and pride themselves with attracting intellectual leaders who are the best in their respective field you will be accountable for assisting in designing, building, and maintaining scalable data pipelines using Python, AWS services and Databricks.

Responsibilities:

• Data Pipeline Development: Design, Build, And Maintain Scalable Data Pipelines Using Python, AWS Services (E.G., S3, Glue, Lambda), and Databricks to Support Data Ingestion, Transformation, And Storage.
• Data Integration: Integrate Structured and Unstructured Data from Various Sources, Including Policy Administration Systems, Claims Databases, And Customer Relationship Management (CRM) Platforms.
• Collaboration: Work Closely with Data Scientists, Analysts, And Business Stakeholders to Understand Data Requirements and Deliver Solutions That Support Analytics and Reporting Needs.
• Data Quality Assurance: Implement Data Validation and Cleansing Processes to Ensure the Accuracy and Reliability of Data Used for Decision-Making.
• Documentation: Maintain Comprehensive Documentation of Data Workflows, Schemas, And Processes to Facilitate Knowledge Sharing and Compliance.
• Continuous Learning: Stay Updated with Emerging Technologies and Best Practices in Data Engineering to Contribute to The Team''s Growth and Innovation

Qualifications & Experience:

• Bachelors degree in Computer Science, Information Systems, Engineering, or a related field.
• Proficiency in Python for data manipulation and scripting.
• Experience with AWS services such as S3, Glue, Lambda, and Redshift.
• Familiarity with Databricks and Spark for big data processing.
• Strong SQL skills for querying and managing relational databases.
• Industry Experience: Prior experience in the insurance sector, with an understanding of insurance data structures and regulatory requirements.

The Reference Number for this position is NG60471 which is a Permanent, Hybrid role in Johannesburg offering a salary of R350k to R450k per annum CTC negotiable based on experience. E-mail Nokuthula