AI Software Engineer

Hallmark - Healthcare Workforce Technology

. Understand business problems and translate them into scalable AI/ML and Generative AI solutions .

Posted 9/22/2026full-timePrinceton • New Jersey • United StatesMid-LevelSenior💰 $115,000 - $137,500 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and deploying scalable AI/ML solutions, with a strong focus on reliability, observability, and measurable outcomes. Proficient in collaborating with cross-functional teams and mentoring junior engineers while implementing MLOps practices and AI governance.

Highest-signal resume keywords

AI/ML Solution DevelopmentPython ProgrammingMLOps PracticesAgentic AI ArchitecturesHealthcare AI Use Cases

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

AI Systems DesignMachine Learning ModelsDeep Learning ModelsPrompt EngineeringRAG SystemsEvaluation FrameworksData EngineeringPredictive AnalyticsComputer VisionNatural Language Processing

Soft Skills

Analytical ThinkingProblem-SolvingExcellent Communication

Tools & Technologies

LangChainLangGraphLlamaIndexCrewAIAzureAWSGCPDockerKubernetesTerraform

Industry Keywords

HealthcareWorkforce ManagementStaffingComplianceEnterprise SaaSAI GovernanceHIPAA Compliance

Tech Stack

Tools & technologies

AirflowAWSAzureDistributed SystemsDockerGoogle Cloud PlatformKubernetesPythonTerraform

About the role

Key responsibilities & impact

Understand business problems and translate them into scalable AI/ML and Generative AI solutions
Design, develop, and deploy enterprise-grade AI systems focused on reliability, scalability, monitoring, and measurable outcomes
Lead or contribute to multiple AI initiatives while coordinating with engineering leads, product managers, architects, and offshore teams
Independently drive proof-of-concepts, pilots, and production implementations
Design and implement Agentic AI workflows for multi-step reasoning, orchestration, task automation, and intelligent decision support
Build AI agents using LangChain, LangGraph, LlamaIndex, CrewAI, MCP, or equivalent orchestration platforms
Implement memory management, evaluation pipelines, guardrails, failure recovery, and observability
Develop prompt engineering strategies and optimize LLM interactions
Build scalable RAG systems with document ingestion, chunking, embeddings, vector databases, hybrid retrieval, re-ranking, and citation traceability
Work with vector stores such as FAISS, Pinecone, Weaviate, or similar technologies
Implement evaluation frameworks for retrieval quality and response accuracy
Develop and optimize ML and deep learning models for predictive analytics, classification, forecasting, NLP, computer vision, and recommendation systems
Participate in model fine-tuning, instruction tuning, RLHF, LoRA, and PEFT initiatives
Build scalable AI infrastructure on Azure, AWS, or GCP
Implement MLOps practices including CI/CD, model monitoring, experiment tracking, infrastructure automation, and deployment orchestration
Work with Docker, Kubernetes, Terraform, MLflow, Airflow, and GitHub Actions
Optimize infrastructure usage, performance, and operational cost
Collaborate with onsite and offshore engineering teams, technical leads, architects, QA, DevOps, and product stakeholders
Mentor junior engineers and contribute to AI capability building

Requirements

What you’ll need

Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Data Science, Machine Learning, or related field
6+ years of software engineering experience with at least 3+ years focused on AI/ML and Generative AI initiatives
Hands-on experience building and deploying production AI systems
Experience delivering AI initiatives independently in enterprise environments
Understanding of LLMs, Agentic AI architectures, and RAG systems
Python programming skills and experience with APIs, distributed systems, and data engineering concepts
Experience working in onsite/offshore collaboration models
Excellent communication, analytical thinking, and problem-solving skills
Experience in Healthcare, Workforce Management, Staffing, Compliance, or Enterprise SaaS domains preferred
Exposure to AI governance, compliance, security, and responsible AI practices preferred
Experience with Computer Vision, NLP, forecasting, or healthcare AI use cases preferred
Knowledge of HIPAA-compliant AI solution development is a plus
Exposure to AI evaluation frameworks such as LangSmith, RAGAS, or equivalent preferred
Experience integrating AI solutions with enterprise platforms and third-party systems preferred
Candidates must be authorized to work in the United States on a permanent basis
Unable to provide sponsorship or consider candidates requiring future sponsorship, including those on OPT
Applicants must be in the Princeton, NJ area, able to interview in person, and occasionally work in the NJ office

Benefits

Comp & perks

Medical, Dental, and Vision Insurance with Employee Premiums Covered by HHCS at 100% and Company Cost Share for any Dependents Enrolled
$3000 Annual Company Contributions to HSAs for all Employees Enrolled in the HSA Eligible Health Plan
Unlimited Paid Time Off
Pre-Tax and Roth 401(K) Retirement Options
On-Site Gym
Free Parking
Provided Lunches 3 Times per Week in the Dallas Office