LigaData

Data Engineer

• Develop and maintain ETL/ELT data pipelines
• Write and optimize SQL queries for data processing, validation, and analysis
• Support data workflows using Apache Airflow
• Work with Big Data technologies such as Hadoop, HDFS, Hive, Spark, Presto/Trino, Kafka, and HBase
• Perform data validation, reconciliation, and data-quality checks
• Develop scripts and automation using Shell/Bash and Python
• Monitor data pipelines and assist in troubleshooting job failures and production issues
• Work with structured and semi-structured data formats such as Parquet, JSON, CSV, and Avro
• Support applications and data workloads running on Kubernetes (K8s)
• Analyze data to identify inconsistencies, anomalies, and operational issues
• Participate in code reviews, documentation, and continuous improvement activities
• Collaborate with senior engineers, DevOps, QA, database, and analytics teams
• Use AI-assisted engineering tools to support development, troubleshooting, documentation, and data analysis while validating generated results before use

Junior Data Engineer