AI Product Operations Specialist

Magic, Inc

. Operate, stress-test, and quality-check AI tools and LLM-based systems .

Posted 10/2/2026full-timeRemote • United StatesMid-LevelSenior💰 $7 per hourWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates strong AI tool proficiency and systems thinking, with a focus on test design, execution, and quality assurance methodologies. Capable of providing structured feedback and collaborating effectively with engineering teams to enhance product workflows and user experience.

Highest-signal resume keywords

AI Tool ProficiencyQA MethodologiesTest Design And ExecutionTechnical Support ExperienceExceptional Written Communication

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

AI Tool FluencyLLM WorkflowsDebuggingSmoke TestingRegression TestingEdge Case ReproductionWorkflow DiagnosisData-Backed Workflow EnhancementsTicket TrackingTest Plan Design

Soft Skills

Proactive OwnershipAttention To DetailResilienceCuriosityAbility To Work Independently

Tools & Technologies

Shortcut (Clubhouse)GSuiteSlackMessengerAI Productivity Tools

Industry Keywords

Product OperationsQuality AssuranceTechnical SupportUser Feedback SynthesisFast-Paced Environments

About the role

Key responsibilities & impact

Operate, stress-test, and quality-check AI tools and LLM-based systems
Reproduce edge cases, capture logs/screens, document reproduction steps, and track tickets in Shortcut (Clubhouse)
Validate fixes and run smoke/regression tests before and after deployments
Provide structured feedback to the Head of Engineering and product/engineering teams
Collect and synthesize user feedback into prioritized improvements
Critique internal software and propose data-backed workflow and UX enhancements
Triage broken workflows, diagnose likely failure points, and collaborate with engineers on root causes
Consolidate deployment updates and confirm production changes behave as expected
Design lightweight test plans and track outcomes through resolution
Manage and organize the Head of Engineering’s to-do list and drive follow-through across a 30+ person team
Maintain work queues and surface priorities
Handle calendar management via AI tools and coordinate with stakeholders
Build scalable processes, streamline task flows and handoffs, and reduce repeated failure modes
Leverage AI productivity tools to automate routine steps and increase throughput

Requirements

What you’ll need

Demonstrated technical mindset with strong AI tool fluency (e.g., ChatGPT, LLM workflows) or a programming background
Proven experience in product operations, QA/Testing, technical support, or similar role working closely with engineers
Exceptional written communication for clear, structured bug reports and product feedback
Comfortable operating independently in ambiguous, fast-paced environments with minimal SOPs
Availability to work 40 hours/week, Monday–Friday, 9:00 am–5:00 pm Eastern Time (may shift slightly earlier after 3–4 weeks)
Computer with at least 8GB RAM and an Intel i5 or AMD Ryzen 5 processor or higher
Internet speed of at least 40MBPS
Headset with an extended noise-cancelling mic and webcam
Back-up computer and internet connection
Quiet, dedicated workspace at home
AI tool proficiency, systems thinking, test design and execution, QA methodologies, debugging, and clear documentation
Comfort with Shortcut (Clubhouse), GSuite, Slack, experimental internal tools, and messaging tools such as Messenger
Proactive ownership, attention to detail, resilience, curiosity, and ability to work independently and collaboratively

Benefits

Comp & perks

No benefits package included