Kong AI Gateway Engineer

Allstate

. Serve as a technical lead focused on Kong AI Gateway .

Posted 10/28/2026full-timeRemote • Illinois • United StatesSeniorLead💰 $100,000 - $170,500 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and implementing AI Gateway solutions using Kong AI Gateway, with a strong focus on API management, security, and compliance. Proven ability to architect scalable and reliable AI platforms while integrating multiple LLM providers and ensuring operational excellence.

Highest-signal resume keywords

Kong AI Gateway AdministrationAPI Management & API Lifecycle ManagementCloud Platforms: Azure, AWS, or GCPKubernetes, Docker, HelmAI Security, Responsible AI and Model Governance

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

API ManagementAI Gateway DevelopmentREST APIsGraphQLOAuth2JWTCI/CDMonitoring: Prometheus, GrafanaToken Usage MonitoringMulti-LLM Integration

Tools & Technologies

Kong GatewayKong KonnectAzure OpenAIOpenAIDevOps Tools

Industry Keywords

MiddlewarePlatform EngineeringCloud-native ArchitecturesMicroservices ArchitecturesGenAI Adoption

Tech Stack

Tools & technologies

AWSAzureCloudDockerGoogle Cloud PlatformGrafanaGraphQLJenkinsKubernetesMicroservicesPrometheusSplunk

About the role

Key responsibilities & impact

Serve as a technical lead focused on Kong AI Gateway
Architect, design, build, test, and support modern digital products
Own applications through production and drive overall success against key performance goals
Design and implement enterprise-grade AI Gateway solutions using Kong AI Gateway
Configure AI-specific policies including prompt logging, content filtering, token controls, and guardrails
Enable secure access to multiple LLM providers through a unified gateway architecture
Implement AI observability, token analytics, usage tracking, and cost governance
Develop routing strategies across multiple AI models based on latency, cost, and availability
Integrate RAG-based AI services through secure API management frameworks
Ensure compliance with enterprise AI governance, security, and regulatory requirements
Establish AI platform standards, reusable AI APIs, and best practices for GenAI adoption
Support AI agent and MCP-based integrations within enterprise ecosystems
Drive AI platform reliability, scalability, and operational excellence
Configure, administer, and support Kong Gateway environments
Develop and manage AI Gateway proxies for GenAI/LLM services
Implement API security, authentication, throttling, and governance policies
Integrate AI platforms such as Azure OpenAI and OpenAI through secure API gateways
Deploy and manage Kong in Kubernetes-based environments
Monitor, troubleshoot, and optimize gateway performance and availability
Automate deployments and operational processes using DevOps tools

Requirements

What you’ll need

Candidates must be able to work Central Time or Eastern Time hours
8 Plus years of experience in API Management, Middleware, or Platform Engineering
Minimum 3 to 5 years of hands-on experience with Kong Gateway Administration
Experience with cloud-native and microservices architectures preferred
Kong Gateway (OSS/Enterprise), Kong Konnect
API Management & API Lifecycle Management
AI Gateway / LLM Proxy Development
OpenAI / Azure OpenAI Integration
REST APIs, GraphQL
OAuth2, JWT, OIDC, API Security
Kubernetes, Docker, Helm
CI/CD (Jenkins, GitHub Actions, Azure DevOps)
Monitoring: Prometheus, Grafana, ELK/Splunk
Cloud Platforms: Azure, AWS, or GCP
Kong AI Gateway Configuration & Administration
LLM Traffic Routing, Load Balancing and Failover Management
Prompt Management, Prompt Security and Guardrails
AI Security, Responsible AI and Model Governance
Token Usage Monitoring, Rate Limiting and Cost Optimization
Multi-LLM Integration (OpenAI, Azure OpenAI, Anthropic Claude, Google Gemini, Mistral, Llama)
Retrieval-Augmented Generation (RAG) Architecture Concepts
Vector Databases
LLMOps, AI Observability and Model Performance Monitoring
AI API Governance, Compliance and Data Protection
Prompt Caching, Semantic Caching and Response Optimization
Model Gateway Policy Development and AI Consumption Controls
MCP (Model Context Protocol) and AI Agent Integration Concepts
GenAI Platform Engineering and Enterprise AI Enablement
The candidate(s) offered this position will be required to submit to a background investigation
Allstate generally does not sponsor individuals for employment-based visas for this position

Benefits

Comp & perks

Comprehensive technology setup, including a laptop, monitors, headset, keyboard, and mouse
Monthly connectivity reimbursement for employees eligible to work from home