Data Engineer

HarperCollins Publishers

. Design, develop, and maintain data pipelines using Microsoft Fabric, Azure Data Factory, and related Azure technologies .

Posted 10/23/2026full-timeRemote • United StatesMid-LevelSenior💰 $120,000 - $130,000 per yearWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and maintaining data pipelines using Azure technologies, including Azure Data Factory and Microsoft Fabric, while ensuring data quality and operational reliability. Proficient in SQL Server, Python, and data transformation processes to support enterprise data integration and governance.

Highest-signal resume keywords

Data Pipeline DevelopmentSQL Server ProficiencyAzure Data Factory ExperiencePython ProgrammingData Governance Implementation

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

SQL ServerT-SQLETL DevelopmentData TransformationData ValidationBatch ProcessingData WarehousingRelational Data ModelingAzure Data Lake StoragePySpark

Soft Skills

Strong CommunicationCollaboration SkillsAnalytical AbilitiesProblem-Solving SkillsAttention to Detail

Tools & Technologies

Microsoft FabricAzure Data FactorySSISNotebooksData Pipelines

Certifications & Qualifications

Relevant Microsoft Certifications

Industry Keywords

Data EngineeringEnterprise Data IntegrationMedallion ArchitectureLegacy Data PlatformsProduction Support

Tech Stack

Tools & technologies

AzureETLPySparkPythonSQLSSIS

About the role

Key responsibilities & impact

Design, develop, and maintain data pipelines using Microsoft Fabric, Azure Data Factory, and related Azure technologies
Develop Python, PySpark, and SQL notebooks for data ingestion, transformation, and processing across Bronze, Silver, and Gold layers
Integrate data from files, databases, APIs, and enterprise applications
Implement data transformations, enrichment, aggregations, and business rules
Optimize pipelines and SQL queries for performance, reliability, and scalability
Develop and maintain enterprise Data Products with Data Governance
Maintain on-premises SQL Server databases, stored procedures, and ETL processes while supporting migration to Azure and Microsoft Fabric
Develop and maintain automated, rule-based processing workflows, including queue-driven processing and batch orchestration
Manage file-based ingestion, feed tracking, processing status, and downstream data distribution
Implement data validation, reconciliation, logging, monitoring, and exception handling
Monitor production pipelines, troubleshoot failures and data discrepancies, and implement corrective actions
Ensure continuity, reliability, and timely delivery of business-critical data processes
Collaborate with business stakeholders, Data Governance, application teams, and engineering resources
Translate business requirements into technical designs and identify source data gaps, dependencies, and process improvements
Maintain technical documentation, including data flows, source-to-target mappings, transformation logic, and operational procedures
Perform unit and integration testing, support QA and business sign-off, and follow development, deployment, and Data Governance standards

Requirements

What you’ll need

Bachelor's degree in Computer Science, Software Engineering, Information Technology, or a related technical discipline
3–5+ years of hands-on experience in data engineering, database development, or enterprise data integration, including building pipelines, migrating data, and modernizing environments
Strong proficiency in SQL Server, T-SQL, stored procedures, query optimization, and ETL/ELT development
Hands-on experience with Azure Data Factory, Azure Data Lake Storage, and Microsoft Fabric, including Data Pipelines, Lakehouse, and Notebooks
Proficiency in Python and/or PySpark
Understanding of data warehousing, relational data modeling, and Medallion Architecture
Experience with file-based integrations, batch processing, queue-driven workflows, data validation, monitoring, troubleshooting, and production support
Familiarity with SSIS or legacy ETL tools is an asset
Experience modernizing legacy data platforms is an asset
Relevant Microsoft certifications are an asset
Strong communication and collaboration skills
Strong analytical and problem-solving abilities, with attention to data accuracy, quality, and operational reliability
Cover letters are strongly preferred

Benefits

Comp & perks

Comprehensive and highly competitive benefits package
Physical health benefits
Retirement and savings benefits
Caregiving benefits
Emotional wellbeing benefits
Transportation benefits
Elective benefits selectable to fit employees’ needs and personal situations
Reasonable accommodation for qualified individuals with disabilities during the application or interview process