FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
AI Operations Analyst
Johnson & Johnson. Manage day-to-day operational analysis and monitoring for AI applications and AI agents .
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in operational analysis and monitoring for AI applications, with a strong focus on incident investigation, service reporting, and automation of operational tasks. Proficient in managing operational readiness, compliance, and governance activities while ensuring effective communication and coordination across teams.
Highest-signal resume keywords
Operational AnalysisIncident InvestigationAI Application SupportScripting Language ProficiencyCloud Services Familiarity
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Operational AnalyticsService ReportingAI ApplicationsData AnalysisAutomationMonitoringIncident ManagementCost AnalysisDeployment-Readiness ChecksVersion Control
Soft Skills
Technical CommunicationCross-Team CoordinationDocumentation SkillsProblem-SolvingFollow-Through
Tools & Technologies
DashboardsLogsMetricsAPIsCloud ServicesCI/CDInfrastructure-as-CodeOperational DashboardsKnowledge ArticlesRunbooks
Industry Keywords
AI ApplicationsOperational ComplianceSecurity RequirementsPrivacy-Aware LoggingService-Level ObjectivesRegulated EnvironmentsIncident ManagementChange ManagementOperational Audit EvidenceGenerative AI Patterns
Tech Stack
Tools & technologiesCloud
About the role
Key responsibilities & impact- Manage day-to-day operational analysis and monitoring for AI applications and AI agents
- Analyse logs, traces, model and tool calls, retrieval steps, latency, failures, and token consumption
- Validate telemetry completeness and coordinate corrective actions with engineers and platform owners
- Build and maintain operational dashboards and reports covering availability, latency, errors, quality signals, policy alerts, consumption, and service health
- Analyse service-level indicators and objectives, tune approved alert thresholds, and recommend monitoring improvements
- Investigate incidents, agent loops, retrieval issues, degraded tool performance, and unexpected runtime behaviour
- Own incident analysis and follow-up, contribute to root-cause reviews, and implement agreed preventive actions
- Maintain configuration, prompt, model, and agent-component version records
- Execute deployment-readiness checks and coordinate resolution of failed integration, regression, security, or observability checks
- Coordinate monitoring during rollouts and validate fallback and rollback readiness
- Maintain runbooks, checklists, knowledge articles, and reusable operational examples
- Produce recurring consumption and cost reports and investigate usage anomalies and budget alerts
- Analyse token consumption, model usage, retrieval overhead, infrastructure usage, and cost-per-transaction metrics
- Recommend optimisation opportunities in model selection, context size, caching, retries, and tool usage
- Apply approved security, privacy, Responsible AI, and compliance requirements to operational activities
- Coordinate access reviews, investigate security alerts, validate logging and retention practices, and maintain operational evidence
- Manage assigned monitoring, support, incident, problem, and change activities
- Coordinate operational-readiness assessments, service acceptance evidence, handoffs, and escalation documentation
- Develop scripts or workflow improvements to automate repetitive reporting, validation, and support tasks
- Act as operational point of contact for assigned services and coordinate updates and investigations across partner teams
- Coordinate governance and compliance activities, maintain control traceability, and track remediation
- Own KPI reporting, analyse operational trends, maintain an inventory of production AI services, and identify coverage gaps
Requirements
What you’ll need- Bachelor's degree in Computer Science, Engineering, Data Analytics, Artificial Intelligence, or a related discipline, or equivalent relevant experience
- 3–5 years of relevant experience in IT operations, application support, operational analytics, DevOps, or a related technical area
- Hands-on responsibility for monitoring, incident investigation, or service reporting
- Practical understanding of AI or machine learning applications, with experience supporting AI-enabled services or analysing operational data
- Working proficiency with a scripting language, APIs, and structured data analysis
- Experience automating routine operational tasks
- Hands-on familiarity with cloud services, version control, and software delivery processes
- Ability to work within established testing and change-management practices
- Experience using dashboards, logs, metrics, and traces to investigate incidents, explain service trends, and improve operational reporting
- Working understanding of generative AI application patterns, including prompts, model responses, RAG, and tool calling
- Working knowledge of secure data handling, access controls, privacy-aware logging, and operational audit evidence
- Ability to independently manage assigned operational activities, investigate ambiguous issues, recommend improvements, and recognise when specialist escalation is required
- Clear technical communication, effective cross-team coordination, and strong documentation and follow-through skills
- Preferred: experience in regulated environments with security, privacy, quality, risk, or audit requirements
- Preferred: experience supporting an AI application, RAG workflow, chatbot, or agent framework in a live service environment
- Preferred: experience with consumption reporting, cloud cost analysis, dashboards, and optimisation tracking
- Preferred: experience with incident and problem management, service-level objectives, deployment-readiness checks, CI/CD, or infrastructure-as-code workflows
Benefits
Comp & perks- Annual bonus with set target (% of pay) depending on pay grade / location, based on employee and company performance
- Sales commissions
- Vacation days
- Parental leave for a minimum of 12 weeks
- Bereavement leave
- Caregiver leave
- Volunteer leave
- Well-being reimbursement
- Programs for financial, physical and mental health
- Service anniversary and recognition awards
- Insurance plans for employees and, in some locations, eligible dependents