FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in designing and developing scalable ETL/data-processing pipelines using Python, PySpark, and SQL, while ensuring data quality and performance optimization across large datasets. Proficient in implementing data warehousing principles and utilizing modern development practices including CI/CD and container technologies.
Highest-signal resume keywords
Python ProgrammingSQL/T-SQL ProficiencyETL Development with Microsoft BI/SSISData Warehousing and Dimensional ModelingPerformance Tuning and Query Optimization
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
PythonPySparkSQLT-SQLETL DevelopmentData WarehousingPerformance TuningData Quality ChecksComplex SQL QueriesDatabase Development
Soft Skills
Analytical SkillsTroubleshootingCommunicationProblem-SolvingCollaboration
Tools & Technologies
Microsoft SQL ServerMicrosoft BISSISHadoopHDFSHiveAutoSysGitCI/CDDocker
Industry Keywords
Data EngineeringData ProcessingRelational DatabaseDimensional ModelingData QualityProduction MonitoringScheduling/OrchestrationNoSQLContainer TechnologiesSecure Data Development
Tech Stack
Tools & technologiesDockerETLHadoopHDFSKubernetesMongoDBMS SQL ServerNoSQLPySparkPythonSQLSSIS
About the role
Key responsibilities & impact- Design, develop, test, and support scalable ETL/data-processing pipelines using Python/PySpark, Microsoft BI/SSIS, SQL, and related technologies
- Develop and optimize complex SQL queries, stored procedures, functions, data transformations, and database objects for high-volume applications
- Identify and resolve query and database performance issues through execution-plan analysis, indexing, query optimization, statistics, and appropriate database design techniques
- Develop and support solutions processing large data volumes across SQL Server and distributed data platforms
- Apply relational, dimensional, and data-warehouse modeling principles to build scalable and maintainable data solutions
- Analyze failed jobs, data-quality issues, performance problems, and production incidents; perform root-cause analysis and implement sustainable resolutions
- Develop and support enterprise batch-processing workflows using scheduling/orchestration platforms such as AutoSys
- Work with Hadoop ecosystem technologies including HDFS, Hive, and related distributed-processing technologies
- Implement validation, reconciliation, exception handling, logging, monitoring, and data-quality controls within data pipelines
- Participate in code reviews and enforce development standards for SQL, Python/PySpark, ETL, and data-processing components
- Use Git-based source control and participate in CI/CD processes; work with container technologies such as Docker/Kubernetes where applicable
- Follow secure data-development practices, access-control requirements, encryption standards, and organizational security policies
- Collaborate with application developers, infrastructure teams, business teams, and other technology groups to design and deliver solutions
- Evaluate new technologies and leverage approved AI-assisted development tools to improve code quality, troubleshooting, refactoring, and developer productivity
- Assess risk in business decisions while safeguarding the firm, its clients, and assets and complying with applicable laws, rules, regulations, and policies
Requirements
What you’ll need- 4+ years of relevant experience in data engineering, application development, database development, or related technology roles
- Strong hands-on experience with Python and PySpark for large-scale data processing and ETL development
- Strong proficiency in SQL/T-SQL and relational database technologies, preferably Microsoft SQL Server
- Experience developing and supporting complex SQL queries, stored procedures, database objects, and high-volume data-processing solutions
- Strong understanding of SQL Server performance tuning, including query execution plans, indexing, statistics, joins, locking/blocking, and query optimization
- Experience with Microsoft BI/SSIS or comparable enterprise ETL technologies
- Experience working with large datasets and distributed data platforms such as Hadoop/HDFS/Hive
- Strong understanding of ETL architecture, data warehousing, dimensional modeling, and relational/3NF modeling
- Experience implementing data-quality checks, reconciliation, audit controls, exception handling, and production monitoring
- Experience with enterprise scheduling/orchestration tools such as AutoSys
- Experience with Git, CI/CD, and modern development practices
- Familiarity with Docker/Kubernetes is preferred
- Familiarity with NoSQL technologies such as MongoDB is beneficial
- Strong analytical, troubleshooting, communication, and problem-solving skills
- Ability to work independently on complex technical assignments while collaborating effectively across teams
- Experience mentoring or providing technical guidance to other developers
- Bachelor’s degree/University degree or equivalent experience
Benefits
Comp & perks- Discretionary and formulaic incentive and retention awards
- Medical, dental & vision coverage
- 401(k)
- Life, accident, and disability insurance
- Wellness programs
- Paid time off packages, including planned time off (vacation), unplanned time off (sick leave), and paid holidays
