FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Tech Stack
Tools & technologiesAWSCloudEC2PostgresPythonSQLTypeScript
About the role
Key responsibilities & impact- Migrate the current n8n/spreadsheets workflow into a scalable AWS production service
- Establish separate development and production environments
- Build direct integrations with Salesforce Service Cloud, Amazon Connect, chat, and other customer-interaction sources
- Ensure proper data retention
- Design and operate Claude-based AI quality-evaluation pipelines
- Manage versioned prompts and quality rubrics
- Track cost and model version for each evaluation
- Build automated evaluations to measure AI consistency against human reviewers
- Iterate on prompts and rubrics using performance data
- Collaborate daily with the CX team and BPOs
- Generate actionable feedback for each agent
- Explain AI grading limitations
- Translate user needs into technical improvements
Requirements
What you’ll need- Technical mastery of Claude and advanced Prompt Engineering, specifically in text extraction, classification, and grading flows
- Experience writing LLM evaluations
- 3+ years of backend development experience in production environments using Python or TypeScript
- Strong SQL skills
- Basic data modeling
- Experience integrating with external APIs and data sources
- Experience with Git, code reviews, and CI/CD
- AWS developer-level experience with EC2, S3, and Secrets Manager
- Desirable: Experience with Salesforce Service Cloud, Amazon Connect, n8n, and Postgres
- Desirable: Background in Contact Center or QA operations
Benefits
Comp & perks- Impact at Scale: Build solutions that solve real financial challenges for Mexican businesses
- Cutting-Edge Innovation: Lead the integration of Generative AI in high-impact regulated products
- Culture of Excellence: Join a team focused on critical thinking, agile execution, and a strong sense of ownership
- Operational Flexibility: A results-oriented work model designed to maximize your productivity and professional development
- Hybrid work model