AI Developer

Cobalt Benefits Group, LLC (DBA: Blue Benefit Administrators, CBA Blue & EBPA)

. Design, prototype, build, test, and deploy AI applications and agents through production .

Posted 11/3/2026full-timeRemote • Massachusetts • United StatesMid-LevelSenior💰 $120,000 - $155,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in AI application development, including generative AI and retrieval-augmented generation solutions, while ensuring compliance with HIPAA and other regulatory frameworks. Proficient in integrating systems through APIs and managing data pipelines, with a strong focus on security and operational monitoring.

Highest-signal resume keywords

Generative AI DevelopmentPython DevelopmentREST API IntegrationHIPAA ComplianceData Pipeline Management

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Generative AIRAGPythonC#/.NETSQLAI Regression TestingModel Version ManagementData ModelingTool/Function CallingEvaluation Harnesses

Soft Skills

Collaborative CommunicationAnalytical Problem SolvingDetail-OrientedSound JudgmentAdaptability

Tools & Technologies

Microsoft Copilot StudioPower AutomatePower PlatformAzure OpenAIAzure AI Search

Industry Keywords

HIPAAPHI MaskingData ProtectionAI EthicsE-Verify

Tech Stack

Tools & technologies

AzureGraphQLPythonSQL.NET

About the role

Key responsibilities & impact

Design, prototype, build, test, and deploy AI applications and agents through production
Select appropriate Copilot Studio, workflow, agent, custom-service, vendor, or non-AI approaches under Build-vs-Buy guidance
Develop retrieval-augmented generation solutions, including document ingestion, chunking, indexing, metadata, retrieval tuning, and grounded responses with source citations
Integrate with internal and third-party systems through authenticated REST and GraphQL APIs
Collaborate on data pipelines for documents and structured data
Apply least-privilege permissions, single sign-on, secrets management, PHI/PII protections, output validation, and appropriate logging and retention controls with IT Security
Create evaluation harnesses with golden test sets, subject-matter expert rubrics, and production sampling
Monitor accuracy, citation support and completeness, latency, and transaction cost, including results by plan type
Implement telemetry for prompts, retrieval, tool calls, and outputs
Maintain runbooks, hand-off documentation, cost controls, and operational monitoring
Advance solutions through CBG AI Solution Delivery Playbook decision gates and required artifacts
Partner with the AI Risk Manager, Compliance, Data Protection Officer, Security, and AI Ethics Committee
Share reusable components, templates, and approved prompt patterns
Complete AI governance onboarding, ship enhancements through Production Readiness Review, and establish golden-test-set evaluation harnesses
Release approved AI solutions, publish reusable components, and enable monitoring dashboards
Meet approved business KPIs and maintain inventory, risk classification, evaluation, and monitoring records
Ensure solutions meet HIPAA, HITRUST CSF, NIST AI Risk Management Framework, and applicable OWASP guidance

Requirements

What you’ll need

Bachelor's degree in Computer Science, Information Systems, related field, or equivalent practical experience
3+ years of professional software development experience
Hands-on generative AI development and evaluation experience, including RAG, context engineering, tool/function calling, and at least one production or production-pilot solution
Strong Python and/or C#/.NET development skills
Experience with production APIs, REST integration, OAuth or similar authorization, and secure secrets/configuration management
Ability to review, test, debug, and maintain AI-generated code
Working knowledge of SQL, data modeling, and data pipelines
Experience handling HIPAA-regulated information, PHI masking, and access controls
Experience with AI regression testing, monitoring, model version management, release controls, cost optimization, and guarded multi-step agents
Ability to document technical decisions, follow governance and change control, conduct business requirements sessions, and recommend delaying or stopping solutions that fail evaluation thresholds
Preferred: Microsoft Copilot Studio, Power Automate, Power Platform, Azure OpenAI, and Azure AI Search experience
Preferred: Demonstrated improvement of retrieval or extraction systems using before-and-after evaluation results
Preferred: Experience with AI coding agents and Model Context Protocol (MCP)
Preferred: Familiarity with healthcare, third-party administration, employee benefits, claims, eligibility, plan documents, or EDI
Collaborative communicator able to translate business processes into technical requirements and partner across business, engineering, security, and compliance teams
Analytical, detail-oriented problem solver who values measurable quality, documentation, and continuous improvement
Sound judgment and accountability in privacy, fairness, human oversight, and responsible AI delivery
Adaptable, hands-on builder comfortable selecting between low-code and custom engineering approaches
Cobalt Benefits Group participates in E-Verify to confirm the employment eligibility of all new hires

Benefits

Comp & perks

Website LinkedIn All Job Openings 51 - 200 employees 💼 Consulting ⚖️ Legal 🛡️ Insurance Consulting
Legal
Insurance Cobalt Benefits Group, LLC (DBA: Blue Benefit Administrators, CBA Blue & EBPA) is a full service Third Party Administrator (TPA) that specializes in the customization, marketing, and operation of self-funded employee benefit plans. With over 30 years of experience and a team of over 195 employees, CBG provides a wide array of products and services including self-funded medical and dental plans, Flexible Spending Accounts, Health Reimbursement Arrangements, and COBRA management. CBG aims to assist employers in building custom benefit plans while managing costs and ensuring compliance with regulations.