Software Engineer, AI/ML Focus

Hallmark - Healthcare Workforce Technology

. Understand business problems and translate them into scalable AI/ML and Generative AI solutions .

Posted 9/22/2026full-timeUnited StatesMid-LevelSenior💰 $115,000 - $137,500 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and deploying scalable AI/ML solutions, with a strong focus on reliability, monitoring, and measurable outcomes. Proficient in building AI systems using advanced frameworks and tools while ensuring compliance with industry standards.

Highest-signal resume keywords

AI/ML Solution DevelopmentGenerative AI ImplementationPython ProgrammingMLOps PracticesAI Governance and Compliance

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

AI System DesignMachine LearningDeep LearningPrompt EngineeringData EngineeringComputer VisionNatural Language ProcessingModel Fine-TuningEvaluation FrameworksScalable RAG Systems

Soft Skills

Analytical ThinkingProblem-SolvingExcellent Communication

Tools & Technologies

LangChainLangGraphLlamaIndexCrewAIAzureAWSGCPDockerKubernetesTerraform

Industry Keywords

Healthcare AIWorkforce ManagementStaffingComplianceEnterprise SaaSHIPAA ComplianceAI Evaluation Frameworks

Tech Stack

Tools & technologies

AirflowAWSAzureDistributed SystemsDockerGoogle Cloud PlatformKubernetesPythonTerraform

About the role

Key responsibilities & impact

Understand business problems and translate them into scalable AI/ML and Generative AI solutions
Design, develop, and deploy enterprise-grade AI systems focused on reliability, scalability, monitoring, and measurable outcomes
Lead or contribute to multiple AI initiatives while coordinating with engineering leads, product managers, architects, and offshore teams
Independently drive proof-of-concepts, pilots, and production implementations
Design and implement Agentic AI workflows for multi-step reasoning, orchestration, task automation, and intelligent decision support
Build AI agents using LangChain, LangGraph, LlamaIndex, CrewAI, MCP, or equivalent platforms
Implement memory management, evaluation pipelines, guardrails, failure recovery, and observability
Develop prompt engineering strategies and optimize LLM interactions
Build scalable RAG systems, including document ingestion, chunking, embeddings, vector databases, hybrid retrieval, re-ranking, and citation traceability
Work with vector stores such as FAISS, Pinecone, and Weaviate
Implement evaluation frameworks for retrieval quality and response accuracy
Develop and optimize ML and deep learning models for predictive analytics, classification, forecasting, NLP, computer vision, and recommendation systems
Participate in model fine-tuning, instruction tuning, RLHF, LoRA, and PEFT initiatives
Build AI infrastructure on Azure, AWS, or GCP
Implement MLOps practices including CI/CD, model monitoring, experiment tracking, infrastructure automation, and deployment orchestration
Work with Docker, Kubernetes, Terraform, MLflow, Airflow, and GitHub Actions
Optimize infrastructure usage, performance, and operational cost
Collaborate with onsite and offshore engineering teams, technical leads, architects, QA, DevOps, and product stakeholders
Mentor junior engineers and contribute to AI capability building

Requirements

What you’ll need

Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Data Science, Machine Learning, or related field
6+ years of software engineering experience with at least 3+ years focused on AI/ML and Generative AI initiatives
Hands-on experience building and deploying production AI systems
Experience delivering AI initiatives independently in enterprise environments
Understanding of LLMs, Agentic AI architectures, and RAG systems
Python programming skills and experience with APIs, distributed systems, and data engineering concepts
Experience working in onsite/offshore collaboration models
Excellent communication, analytical thinking, and problem-solving skills
Experience in Healthcare, Workforce Management, Staffing, Compliance, or Enterprise SaaS domains preferred
Exposure to AI governance, compliance, security, and responsible AI practices preferred
Experience with Computer Vision, NLP, forecasting, or healthcare AI use cases preferred
Knowledge of HIPAA-compliant AI solution development is a plus
Exposure to AI evaluation frameworks such as LangSmith, RAGAS, or equivalent preferred
Experience integrating AI solutions with enterprise platforms and third-party systems preferred
Applicants must be located in the Princeton, NJ area or Dallas, TX area
Must not require future sponsorship, including OPT/CPT

Benefits

Comp & perks

Medical, Dental, and Vision Insurance with Employee Premiums Covered by HHCS at 100% and Company Cost Share for any Dependents Enrolled
$3000 Annual Company Contributions to HSAs for all Employees Enrolled in the HSA Eligible Health Plan
Unlimited Paid Time Off
Pre-Tax and Roth 401(K) Retirement Options
On-Site Gym
Free Parking
Provided Lunches 3 Times per Week in the Dallas Office