Terac

Product Manager

• Walk through the end-to-end process for running customer research
• Discuss currently used software tools and selection rationale
• Explain budget allocation and purchasing triggers for new research platforms
• React to potential product messaging and go-to-market concepts
• Participate in a remote video interview with occasional screen sharing

UX and Product Leaders – Customer Research Workflows

Artificial Intelligence

• Complete a short series of simple tasks and questions
• Engage in a casual, guided chat with an AI moderator
• Share thoughts and experiences openly during the conversation
• Provide honest feedback on the quality and feel of the AI interaction

Consumer Feedback Specialist – AI-Moderated Conversations

Full-stack Engineer

• Review realistic programming tasks for accuracy and difficulty
• Verify the logic and test cases within provided evaluation harnesses
• Assess whether coding environments effectively measure software engineering skills
• Walk through the thought process while analyzing complex code structures
• Provide technical feedback through a guided conversation and screen-sharing exercises

Software Engineer – Paid Code Review, AI Agent Evaluation

• Review transcripts of short AI conversations focused on mental health topics
• Evaluate the safety, tone, and clinical appropriateness of generated responses
• Write high-quality, clinically sound example responses for various scenarios
• Develop structured grading rubrics to assess future conversational models
• Work remotely over an 8-10 hour period between Friday and Sunday
• Read each transcript and evaluate system performance based on clinical standards

Licensed Mental Health Clinician – AI Conversation Review

• Review realistic programming tasks designed for AI evaluation
• Assess the accuracy and structure of various evaluation harnesses
• Walk through thought processes while checking code validity
• Provide actionable feedback on improving task complexity and realism
• Share screen to walk through environments and identify potential flaws or improvements
• Participate in code review, technical discussion, and direct feedback on task structures

Software Engineer, LATAM

AI Engineer

• Review proposed coding tasks and programming environments for realism
• Provide technical feedback on the structure and difficulty of evaluation harnesses
• Walk through the approach to verifying complex code challenges
• Suggest improvements to make test suites more robust
• Participate in an AI-moderated session focused on coding evaluation harnesses

Software Engineer, AI Evaluation

Accounting Manager

• Participate in a paid study on the daily workflows of accounting professionals
• Join a remote video call to discuss current accounting processes
• Walk through a typical accounting or tax preparation workflow
• Describe navigation of primary accounting software tools
• React to proposed concepts for new financial integrations
• Discuss pain points in day-to-day accounting processes
• Provide feedback on potential improvements to existing software interfaces

Accounting Professional – Workflow Evaluation Study

Marketing

• Participate in a remote video interview about cross-channel media planning
• Walk through typical media planning processes
• Describe how advertising budgets are allocated and adjusted for client campaigns
• Explain criteria used to evaluate different advertising channels
• Discuss tools used for media buying and tracking
• Potentially screen-share software or dashboards used to track media buys

Agency Marketing Professional – Cross-Channel Media Planning

• Walk participants through their typical software development workflow
• Describe how AI coding assistants are used to write or debug code
• Compare different AI models or coding tools used recently
• Discuss challenges and limitations encountered when relying on generated code
• Participate in a remote video call about programming environments, practical use cases, debugging habits, and prompt strategies

Software Engineer – Feedback on AI Coding Tools

Data Entry

• Review text or media samples based on provided project guidelines
• Apply accurate labels and categorizations to diverse data sets
• Evaluate AI-generated responses for clarity, safety, and factual accuracy
• Manage your own time to complete assignments at your preferred pace
• Log into the remote platform to access a queue of annotation assignments
• Adapt to new labeling guidelines as project parameters evolve

Data Annotator – AI Model Training

Physician

• Review de-identified patient charts and medical records
• Generate an independent clinical diagnosis for each assigned case
• Evaluate AI-proposed diagnoses for accuracy and clinical relevance
• State whether you agree or disagree with AI model conclusions
• Complete assigned case reviews through the remote platform
• Contribute medical expertise to research improving AI diagnostic algorithms

Hospitalist, Family Medicine – AI Diagnosis Review

Operations

• Complete a 30-minute asynchronous AI-moderated interview
• Detail current approaches to insurance strategy and operational management
• Explain specific organizational bottlenecks or operational challenges
• Provide thoughtful responses to AI-generated follow-up questions
• Record responses via voice or text

Insurance Leader – Strategy and Operations

Insurance

• Participate in a 30-minute remote video or voice interview
• Discuss approach to organizational strategy and corporate planning
• Evaluate current industry trends and their impact on the business model
• Explain how operational risks and opportunities are prioritized
• Discuss current organizational priorities, recent industry trends, and evaluation of new market risks
• No preparation of materials or sharing of sensitive company data required

Insurance Executive – Organizational Strategy

User Researcher

• Share your screen during a remote video call
• Walk through the typical process for setting up a new research project
• Complete guided tasks using a prototype of the study creation interface
• Provide candid feedback on the usability and efficiency of the workflow
• Discuss overall impressions and feature requests

UX Researcher, Study Creation Workflow

• Review and assess the quality of realistic programming tasks
• Evaluate coding environments and technical harnesses for AI testing
• Walk through potential flaws in provided code structures
• Provide feedback on the difficulty and realism of coding challenges
• Assess the technical accuracy, complexity, and realism of coding challenges
• Explain the logic of evaluation environments
• Compare evaluation environments with standard industry practices