Data Engineer

• Build and maintain batch and streaming data pipelines using Python, SQL, Kafka, and Spark
• Develop and operate Airflow workflows, including scheduling, dependency management, retries, and recovery
• Design and maintain data models and warehouse datasets for analytics and reporting
• Improve data quality and freshness through validation, monitoring, and investigation of upstream and downstream issues
• Optimise pipeline and query performance, and manage processing and storage costs
• Work with data users to define datasets and metrics, and document data flows, transformations, and dependencies
• Maintain and develop WOO X’s data platform
• Work with engineering and business colleagues to understand how data is produced and used, address quality issues, and improve platform maintainability

Explore Senior Data Engineer at WOO Network. Review requirements and application details.