FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
LLM Platform Engineer
AllSpice. Partner with engineers and product managers to discover workflow bottlenecks, prioritize high-impact problems, and own solutions from requirements and architecture through rollout and iteration .
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in building and maintaining data pipelines, tooling, and integrations for AI products, with a strong focus on data quality, observability, and customer outcomes. Proficient in translating technical findings for diverse audiences and leading collaborative efforts across teams.
Highest-signal resume keywords
Software Engineering ExperienceStrong SQL SkillsPython Scripting and AutomationData Pipeline Design and Storage SchemaExperience with BI Tools
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Software EngineeringSQLPythonData Pipeline DesignData Quality ManagementWeb Application DevelopmentLLM-Enabled SystemsAutomationSchema EvolutionEvaluation Pipelines
Soft Skills
Excellent Communication SkillsCustomer-First MindsetProject Management SkillsProblem Identification and Solution ProposalCollaboration with Stakeholders
Tools & Technologies
JupyterMetabaseLookerGitHub ActionsVueReactTypeScriptMCP ToolsInternal ApplicationsSelf-Service Tools
Certifications & Qualifications
Bachelor's Degree in Technology-Related Field
Industry Keywords
AI ProductsData PlatformsObservabilityCustomer OutcomesAutomated WorkflowsFeedback MechanismsIntegrationEvaluation WorkflowsTelemetryNon-Determinism
Tech Stack
Tools & technologiesPythonReactSQLTypeScriptVue.js
About the role
Key responsibilities & impact- Partner with engineers and product managers to discover workflow bottlenecks, prioritize high-impact problems, and own solutions from requirements and architecture through rollout and iteration
- Own the evaluation and observability layer for AI products, including automated and human review workflows, regression detection, and comparisons across models, prompts, and pipelines
- Make quality, cost, latency, usage, and customer outcomes visible and actionable
- Build internal applications and self-service tools for inspecting AI results, investigating failures, and providing feedback
- Extend tooling into customer-facing experiences where useful
- Build and maintain scripts, data pipelines, and integrations connecting internal systems, third-party services, LLMs, and MCP tools
- Ensure data quality, schema evolution, and customer data privacy
- Write documentation and communicate findings to technical and non-technical audiences, including leadership and customers
- Champion code quality, testing, and reliability through reviews, mentorship, and thoughtful design
- Build evaluation workspaces and review workflows for AI design review products
- Aggregate evaluation results, customer feedback, and telemetry into unified analytics layers
- Create scripting tools and automations for Gen AI development and testing workflows
- Design and implement RAG-based information repositories and domain-knowledge tooling
- Integrate with GitHub Actions to surface AI insights in engineering workflows
- Partner with infrastructure to measure cache effectiveness, usage, and cost
- Potentially contribute to core AllSpice product features alongside product engineering
Requirements
What you’ll need- 4+ years of software engineering experience focused on tooling, data platforms, or full-stack web development
- Demonstrated senior-level ownership of systems or products that other people depend on
- Strong SQL skills
- Experience designing data pipelines and storage schemas
- Experience handling data quality and schema evolution
- Experience using data/analytics tools such as Jupyter, Metabase, Looker, or similar BI platforms
- Proficiency in Python scripting and automation for data pipelines, integrations, and internal tools
- Experience building web applications or customer-facing tools using modern frameworks such as Vue, React, or TypeScript
- Practical experience shipping or maintaining LLM-enabled systems and infrastructure such as evaluation pipelines, observability, or integrations
- Understanding of non-determinism, quality and reliability challenges, and cost, latency, and model-performance tradeoffs
- Excellent communication skills for translating technical findings to engineers, product managers, and customers
- Customer-first mindset and proactive feedback-seeking
- Bachelor's degree or higher in a technology-related field, or equivalent practical experience
- Project management skills
- Ability to lead and collaborate with varied stakeholders
- Comfort with ambiguity and autonomy
- Ability to identify problems, propose solutions, make build-vs.-buy and architectural decisions, and bring stakeholders along
- Preferred availability to work from flex offices in San Francisco or Boston on a hybrid basis 2–3 times per week
Benefits
Comp & perks- Competitive salary and equity
- Health insurance
- Dental insurance
- Vision insurance
- Generous PTO
- Home office stipend
- Flexible work
- Opportunity to make a big impact
- Supportive and smart colleagues