FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Tech Stack
Tools & technologiesAWSAzureCloudETLMongoDBNoSQLPostgres
About the role
Key responsibilities & impact- Design and scale Retrieval-Augmented Generation (RAG) pipelines
- Transform unstructured IT logs and documentation into optimized Vector Embeddings
- Maintain the health and performance of vector databases such as Pinecone, Milvus, or Weaviate
- Build knowledge graphs and semantic layers
- Create automated data guardrails to detect noise, bias, or PII before data reaches the model
- Identify and resolve data quality issues at the source
- Build, deploy, and maintain CI/CD pipelines for data infrastructure
- Ensure data and context windows remain fresh and reliable
Requirements
What you’ll need- Expertise in data mining, data storage and Extract-Transform-Load (ETL) processes
- Experience in data pipelines development and tooling, e.g., Glue, Databricks, Synapse, or Dataproc
- Experience with both relational and NoSQL databases, PostgreSQL, DB2, MongoDB
- Excellent problem-solving, analytical, and critical thinking skills
- Ability to manage multiple projects simultaneously while maintaining attention to detail
- Ability to communicate with technical and non-technical colleagues and translate technical requirements from business needs
- Preferred: Experience working as a Data Engineer and/or in cloud modernization
- Preferred: Experience in Data Modelling
- Preferred: Professional certification, e.g. Open Certified Technical Specialist with Data Engineering Specialization
- Preferred: Cloud platform certification, e.g. AWS Certified Data Analytics – Specialty, Elastic Certified Engineer, Google Cloud Professional Data Engineer, or Microsoft Certified: Azure Data Engineer Associate
- Preferred: Understanding of social coding and Integrated Development Environments, e.g. GitHub and Visual Studio
- Preferred: Degree in a scientific discipline such as Computer Science, Software Engineering, or Information Technology
Benefits
Comp & perks- Flexible, supportive environment
- Hybrid-friendly culture
- Be Well programs supporting financial, mental, physical, and social health
- Personalized development goals and continuous feedback
- Access to cutting-edge learning opportunities
- Certifications with Microsoft, Google, and Amazon
- Coaching and hands-on experiences
- Career path tools and in-demand skills development
- Employee referral opportunity