Data Engineer (Junior) - Discovery Connect

About (MDS Hub)

The information assets that we are building is not only limited to report delivery but also integrated information assets to support the data scientists, analytics and actuarial teams within the Greater Marketing space.

Key Purpose

Together these teams will enable data driven actionable insights and solutions.

• Work within a highly specialized and growing team to enable delivery of data and advanced analytics system capability.
• Develop and implement a reusable architecture of data pipelines to make data available for various purposes including Machine Learning (ML), Analytics and Reporting
• Work collaboratively as part of team engaging with system architects, data scientists and business in a healthcare context
• Define hardware, tools, and software to enable the reusable framework for data sharing and ML model productionization
• Work comfortably with structured and unstructured data in a variety of different programming languages such as SQL, R, python, Java etc
• Understanding of distributing programming and advising data scientists on how to optimally structure program code for maximum efficiency
• Build data solutions that leverage controls to ensure privacy, security, compliance, and data quality
• Understand meta-data management systems and orchestration architecture in the designing of ML/AI pipelines
• Deep understanding of cutting-edge cloud technology and frameworks to enable Data Science
• System integration skills between Business Intelligence and source transactional
• Improving overall production landscape as required
• Define strategies with Data Scientists to monitor model’s postproduction
• Write unit tests and participate in code reviews

• Exceptional analytical, conceptual thinking and problem solving skills
• Excellent oral and written communication skills.
• Ability to understand entity-relationship diagrams, normalized and de-normalized structures
• Excellent planning, organizational, and time management skills
• Scope and size BI initiatives.
• Work breakdown management
• Coach and co-ordinate team members
• Data manipulation, storytelling, and visualization

• Degree in BSc Computer Science or Engineering or Software Engineering with solid experience in data mining and machine learning (Honours or Masters preferrable)
• 1- 2 years of work experience
• Expert in programming languages such as R, Python, Scala, and Java
• Expert database knowledge in SQL and experience with Cloud-based tools such as Data Factory, Synapse Analytics, Data Lake, Databricks, Azure stream analytics, PBI, GCP suite.
• Modern Azure data warehouse skills (advantageous)
• Google Cloud Platform skills (advantageous)
• Expert Unix/Linux admin experience including shell script development
• Exposure to AI or model development
• Experience working on large and complex datasets
• Understanding and application of Big Data and distributed computing principles (Hadoop and MapReduce)
• ML model optimization skills in a production environment
• Production environment machine learning and AI
• DevOps/DataOps and CI/CD experience

AWS experience (advantageous)

EMPLOYMENT EQUITY

The Company’s approved Employment Equity Plan and Targets will be considered as part of the recruitment process. As an Equal Opportunities employer, we actively encourage and welcome people with various disabilities to apply.