Senior Software Engineer, Cloud Infrastructure

Beacon Venture Capital

. Design, provision, and maintain AWS infrastructure using IaC tools such as AWS CDK or Terraform .

Posted 10/3/2026full-timeSan Carlos • California • United StatesSenior💰 $173,000 - $225,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and maintaining AWS infrastructure using Infrastructure as Code tools, building robust CI/CD pipelines, and managing data ingestion and processing workflows. Proficient in implementing security measures and compliance practices while optimizing machine learning applications and services.

Highest-signal resume keywords

AWS Infrastructure DesignCI/CD Pipeline DevelopmentData Pipeline ManagementMachine Learning Application DeploymentInfrastructure as Code (IaC)

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

AWS CDKTerraformPythonLangChainOpenSearchSageMakerCloudWatchGlueAthenaVPC

Tools & Technologies

GitHub ActionsCodeBuildCodePipelineStep FunctionsAirflowRedisKMSSecrets ManagerS3DynamoDB

Industry Keywords

Data PipelinesMachine LearningServerless ArchitectureCompliance PracticesSafety-Critical Domains

Tech Stack

Tools & technologies

AirflowAWSCloudDynamoDBPostgresPythonRedisTerraform

About the role

Key responsibilities & impact

Design, provision, and maintain AWS infrastructure using IaC tools such as AWS CDK or Terraform
Build CI/CD and testing for applications, infrastructure, and ML pipelines using GitHub Actions, CodeBuild, and CodePipeline
Operate secure networking with VPCs, PrivateLink, and VPC endpoints
Manage IAM, KMS, Secrets Manager, and audit logging
Stand up and operate model endpoints using AWS Bedrock and/or SageMaker
Evaluate ECS/EKS, Lambda, or Batch for inference jobs
Build and maintain application services that call LLMs through clean APIs with streaming, batching, and backoff strategies
Implement prompt and tool execution flows with LangChain or similar, including agent tools and function calling
Design chunking and embedding pipelines and orchestrate them with Step Functions or Airflow
Operate vector search using OpenSearch Serverless, Aurora PostgreSQL with pgvector, or Pinecone
Build and maintain knowledge bases and data synchronization from S3, Aurora, DynamoDB, and external sources
Create evaluation harnesses for prompts, retrievers, and chains
Instrument model and application telemetry with CloudWatch and OpenTelemetry
Build token usage and cost dashboards with budgets and alerts
Add guardrails, rate limits, fallbacks, and provider routing
Implement PII detection and redaction, access controls, content filters, and human-in-the-loop review
Maintain audit trails for regulated environments
Build ingestion and processing pipelines for structured, unstructured, and multimedia data
Ensure data integrity, lineage, and cataloging with Glue and Lake Formation
Optimize bulk data movement and storage in S3, Glacier, and tiered storage
Use Athena for ad-hoc analysis
Manage infrastructure deploying to and communicating with edge devices
Support secure messaging, identity, and over-the-air updates
Partner with product and application teams to integrate retrieval services, embeddings, and LLM chains into user-facing features
Provide expert troubleshooting for cloud and ML services
Tune retrieval quality, context window use, and caching with Redis or Bedrock Knowledge Bases
Optimize inference through model selection, quantization, GPU/CPU instance choices, and autoscaling

Requirements

What you’ll need

At least 3 years of professional work experience, or a master's related to the role
Experience building and managing data pipelines
Experience designing, setting up, and maintaining cloud infrastructure using Infrastructure as Code tools such as AWS CDK
Experience building robust CI/CD and testing components
Experience shipping or operating LLM-powered applications in production
Familiarity with RAG design, prompt versioning, and chain orchestration using LangChain or similar
Strong knowledge of AWS services including VPC, IAM, KMS, CloudWatch, S3, ECS/EKS, Lambda, Step Functions, Bedrock, and SageMaker
Experience building ingestion and transformation pipelines in Python
Familiarity with Glue, Athena, EventBridge, and SQS
Knowledge of least privilege, secrets management, network isolation, and compliance practices
Experience using quantitative evaluations, A/B testing, and live metrics
4+ years working with serverless or container platforms on AWS (bonus)
Experience with vector databases, OpenSearch, or pgvector at scale (bonus)
Familiarity with Bedrock Guardrails, Knowledge Bases, or custom policy engines (bonus)
Familiarity with GPU workloads, Triton Inference Server, or TensorRT-LLM (bonus)
Experience with big data tools for large-scale processing and search (bonus)
Background in aviation data or other safety-critical domains (bonus)
DevOps or DevSecOps experience automating CI/CD for ML and application services (bonus)
Must be a U.S. Person
Must be authorized to work lawfully in the United States
No visa sponsorship or visa transfers available
Must work in the United States
Must be based in or willing to relocate to the San Francisco Bay Area
Must be able to work onsite in San Carlos, CA at least 3 days per week

Benefits

Comp & perks

Offers equity
100% of employee medical premiums covered
25% of dependent medical premiums covered
3 weeks PTO
13+ paid company holidays
401(k) offered
Hybrid work arrangement with remote work on remaining days