Senior Data Engineer

IDT BY INDET GROUP

. Design, develop, and maintain scalable data pipelines supporting ingestion, transformation, and delivery into centralized feature stores, model-training workflows, and real-time inference services .

Posted 9/22/2026full-timeRemote • ColombiaSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Expertise in designing and maintaining scalable data pipelines, with proficiency in Python, SQL, and advanced data manipulation techniques. Strong experience in utilizing Apache Spark, Hadoop, and Kafka for real-time data processing and a solid understanding of Business Intelligence methodologies.

Highest-signal resume keywords

Data Pipeline DesignPython ProgrammingApache SparkSQL ProgrammingBusiness Intelligence

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Data EngineeringData TransformationLarge-Scale Data ProcessingAdvanced Data ManipulationComplex Data Pipeline DesignRelational Database SystemsCloud-Based Database ServicesVersion Control SystemsPrompt EngineeringModel Fine-Tuning

Soft Skills

Effective CommunicationCollaboration

Tools & Technologies

Apache SparkHadoopKafkaSnowflakeRedshiftUnixLinuxWindows

Industry Keywords

MLOpsLLM OperationsAgile MethodologiesData Warehouse MethodologiesBusiness Operations

Tech Stack

Tools & technologies

Amazon RedshiftApacheCloudHadoopKafkaLinuxPythonRDBMSSparkSQLUnix

About the role

Key responsibilities & impact

Design, develop, and maintain scalable data pipelines supporting ingestion, transformation, and delivery into centralized feature stores, model-training workflows, and real-time inference services
Build and optimize workflows for extracting, storing, and retrieving semantic representations of unstructured data
Architect and implement lightweight analytics and dashboarding solutions delivering natural language query experiences and AI-backed insights
Define and execute prompt engineering, orchestration, and model fine-tuning processes for conversational interfaces
Oversee vector data stores and develop efficient indexing methodologies for retrieval-augmented generation (RAG) workflows
Partner with data stakeholders to gather requirements for language-model initiatives and translate them into scalable solutions
Create and maintain documentation for data processes, workflows, and model deployment routines
Stay informed about and learn emerging methodologies in data engineering, MLOps, and LLM operations

Requirements

What you’ll need

8+ years of experience as a Data Engineer
Demonstrated experience utilizing Python for data engineering tasks, including transformation, advanced data manipulation, and large-scale data processing
Hands-on experience with Apache Spark, Hadoop, and Kafka for distributed processing and real-time data ingestion
Experience designing complex data pipelines extracting data from RDBMS, JSON, API, and flat file sources
Demonstrated skills in SQL and PL/SQL programming
Advanced mastery in Business Intelligence and data warehouse methodologies
Hands-on experience with relational database systems and cloud-based database services such as Snowflake/Redshift
Understanding of software engineering principles
Skills working on Unix/Linux/Windows operating systems
Experience with Agile methodologies
Proficiency in version control systems, including managing code repositories, branching, merging, and collaborating within a distributed development environment
Interest in business operations and understanding of how robust BI systems drive corporate profitability
Effective oral and written English communication skills
Please attach CV in English
The interview process will be conducted in English
Applicants must be from LATAM
In-person verification will be conducted

Benefits

Comp & perks

Remote work opportunity
B2B Employment ($, gross)
Stable job with long-term growth perspective with talented people around
Really good hardware
Great learning and growth opportunities
Compensation for professional training, seminars, and conferences
Referral program – get rewarded for helping us grow the team with talented people
Company-supported English classes to enhance your professional growth