Data Engineer

• Assist the data warehouse development team to define low-level development tasks and estimated completion timelines
• Develop data models according to assigned low-level development tasks
• Develop unit tests according to assigned low-level development tasks
• Participate in testing and validation of data models throughout development stages
• Maintain documentation for technical aspects of data models and changes for the data warehouse team and stakeholders
• Provide production support to solve immediate problems
• Optimise, support, and maintain data warehouse environments

Junior Data Warehouse Developer

• Lead the technical design, development and iterative improvement of the online data platform and visualisation tools
• Translate user needs into a prioritised product roadmap, prototypes, specifications and tested releases
• Work with Ember to adapt or integrate relevant platform components while building independent ACF-AEF capability
• Design for accessibility, low-bandwidth use, maintainability, multilingual expansion and responsible open access
• Implement analytics, usage monitoring and user-feedback processes
• Design scalable data ingestion, transformation, storage, metadata, versioning and publishing pipelines
• Integrate structured and unstructured data from public, partner and internal sources using APIs, automated workflows and documented manual processes
• Collaborate with the Junior Data Scientist on validation, provenance, reproducibility, access control and release standards
• Maintain technical documentation, source-code repositories, testing processes, backups and business-continuity arrangements
• Identify, prototype and deploy AI applications for data discovery, extraction, classification, cleaning, summarisation, visualisation, research and internal knowledge management
• Develop retrieval, search and assisted-analysis tools connecting users to trusted ACF-AEF data and evidence
• Evaluate build-versus-buy choices and select appropriate open-source or commercial tools
• Create human-in-the-loop evaluation processes addressing hallucination, bias, confidentiality, intellectual-property and security risks
• Monitor AI developments and provide briefings, demonstrations and guidance to ACF and AEF teams
• Work with analysts, programme teams, communications colleagues and external users to understand workflows and adoption barriers
• Provide training, templates and technical support for safe and effective use of AI and data tools
• Manage technical vendors and contributors and conduct code and security reviews where necessary
• Report to the Project Director

Data Engineer jobs in South Africa

Junior Data Warehouse Developer

AI and Data Platforms Lead – 1 year contract