FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Senior Data Engineer – AWS, Databricks
LouisianaNOW.Jobs. Develop and implement scalable, secure, cloud-based data platforms, including data lakes, lakehouses, or data warehouses .
Posted 11/3/2026full-timeRemote • Louisiana • United StatesSenior💰 $111,155 - $150,385 per yearWebsite
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in developing and implementing scalable cloud-based data platforms, ensuring alignment with federal security requirements and data governance policies. Proficient in building enterprise-scale data pipelines and optimizing performance while maintaining high standards of code quality and security.
Highest-signal resume keywords
AWS Cloud ExpertiseDatabricks DevelopmentPython ProgrammingETL/ELT FrameworksData Governance Familiarity
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
Data Lake DevelopmentData Warehouse ImplementationDimensional Data ModelingData Pipeline EngineeringData Presentation SolutionsData Quality ChecksRoot Cause AnalysisOperational Database ManagementData Transformation TechniquesStreaming Data Ingestion
Soft Skills
Analytical Problem-SolvingEffective CommunicationTeam CollaborationMentoring Junior EngineersConsultant Mindset
Tools & Technologies
DatabricksApache SparkDelta LakeGitCI/CD ToolsAgile/Scrum MethodologiesUnity CatalogCloud Services IntegrationInfrastructure as CodeMetadata Management
Certifications & Qualifications
Databricks Certified Data ProfessionalAWS Certified Data Analytics - SpecialtyAWS Certified Solutions Architect - ProfessionalAWS Certified Data Engineer
Industry Keywords
Federal Security RequirementsData Governance PoliciesCMM Data Classification StandardsRegulated EnvironmentsCompliance-Driven Environments
Tech Stack
Tools & technologiesApacheAWSCloudETLPySparkPythonSparkSQLUnity
About the role
Key responsibilities & impact- Develop and implement scalable, secure, cloud-based data platforms, including data lakes, lakehouses, or data warehouses
- Align platforms with federal security requirements, judiciary architecture standards, data governance policies, and modernization initiatives
- Engineer multi-tenant cloud environments supporting hybrid/on-premises systems and multiple database models
- Produce and maintain dimensional data models for data marts and data products
- Develop and maintain downstream data marts, consumable data, ETL/ELT processes, reports, and dashboards
- Create and maintain technical, data model, testing, and design documentation
- Develop, deploy, and maintain data presentation and reporting solutions
- Support data and technology roadmaps for data engineering, analytics, reporting, and AI/ML
- Design and develop ingestion and ETL/ELT pipelines for enterprise data sources
- Implement reusable data services for analytics, reporting, data marts, and gold layers
- Implement logical and physical data models in cloud platforms such as Databricks
- Develop secure, testable, high-quality code
- Support CMM Data Classification Standards, including workshops, security controls, metadata, and training
- Configure metadata structures, workflows, automation, and security settings
- Create training, job aids, and communications for user adoption
- Integrate pipelines with cloud services, messaging, and storage components
- Implement data quality checks, validations, and error handling
- Optimize pipeline performance, scalability, and cost efficiency
- Support CI/CD deployments, automated testing, and environment promotion
- Participate in code reviews, design reviews, and sprint ceremonies
- Resolve incidents and perform root cause analysis for pipeline failures
- Maintain runbooks, workflows, technical documentation, and audit-ready artifacts
- Partner with architecture, governance, and migration teams on migration, archiving, and disaster recovery
- Deliver migration documentation for scripts, transformations, and validation results
- Support failover testing and disaster recovery drills
- Implement operational databases, document storage, indexing services, schemas, and secure data APIs using infrastructure as code
- Operate across multiple Agile scrum teams and collaborate with architects, DBAs, business analysts, and QA personnel
- Ensure code quality, performance, security, governance, audit compliance, and delivery timelines
Requirements
What you’ll need- Bachelor’s degree in Data Science or closely related discipline
- 5+ years of specialized experience with AWS Cloud and Databricks
- Deep hands-on experience with core AWS data storage, compute, and serverless tools
- Deep hands-on experience with Databricks, Apache Spark, and Delta Lake
- Advanced proficiency in Python, PySpark, SQL, and data transformation techniques
- Proficiency with ETL/ELT frameworks
- Familiarity with Git, containerization, CI/CD, and data governance frameworks such as Unity Catalog
- Hands-on experience building enterprise-scale data pipelines
- Experience with streaming or near-real-time data ingestion
- Familiarity with data governance, metadata, and classification standards
- Experience with system security best practices
- Experience building and migrating software and IT services
- Experience researching advanced technologies to support business needs
- Experience identifying and applying industry tools, solutions, methods, best practices, and emerging technologies
- Familiarity with Agile/Scrum delivery environments
- Experience in regulated or compliance-driven environments
- Excellent presentation and communication skills
- Consultant mindset and ability to work with high-level customer stakeholders
- Strong analytical and problem-solving skills
- Ability to work effectively independently and as part of a team
- Experience mentoring junior data engineers
- Must be a US Person: Green Card Holder, US Permanent Resident Alien, Refugee, Asylee, or US Citizen
- Must pass a background check to obtain Public Trust
- Must provide onsite fingerprinting at a designated facility
- Preferred but not required: Databricks Certified Data Professional, AWS Certified Data Analytics - Specialty, AWS Certified Solutions Architect - Professional, or AWS Certified Data Engineer
Benefits
Comp & perks- AI-powered career tool identifying career steps and learning opportunities
- Internal mobility team supporting career goals
- Comprehensive benefits and wellness packages
- 401(k) with company match
- Competitive pay
- Paid time off
- Medical plan options, some with Health Savings Accounts
- Dental plan options
- Vision plan options
- Full flex work weeks where possible
- Vacation, sick, personal, holiday, paid parental, military, bereavement, and jury duty leave
- Typically 15 days of paid leave per calendar year
- 10 paid holidays per year
- Up to 160 hours of paid family leave in a rolling 12-month period for eligible employees
- Short- and long-term disability benefits
- Life insurance
- Accidental death and dismemberment insurance
- Personal accident insurance
- Critical illness insurance
- Business travel and accident insurance
- Award-winning culture of innovation
- Military-friendly workplace