Senior Data Engineer – AI, LLM Solutions

AIM Qualifications and Assessment Group

. Design and develop enterprise-scale data solutions using Microsoft Fabric, Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage, and Azure Databricks .

Posted 9/18/2026full-timeRemote • Pakistan, Mexico, India, MoroccoSeniorWebsite

Core Competencies

Role fit

Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in designing and developing enterprise-scale data solutions using Microsoft Fabric and Azure technologies, with a strong focus on data modernization, AI integration, and scalable ETL/ELT pipeline optimization. Proficient in implementing data governance, quality processes, and supporting analytics frameworks for business intelligence.

Highest-signal resume keywords

Microsoft FabricAzure Data FactoryETL/ELT Pipeline OptimizationData GovernanceAI Integration

ATS Keywords

Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills

Data Solutions DesignData Warehouse DevelopmentLakehouse ArchitectureBatch and Real-Time ProcessingPySparkSpark SQLData Quality ImplementationData LineageData CatalogingAPI Integration

Soft Skills

CollaborationTechnical GuidanceMentorshipProblem-SolvingCommunication

Tools & Technologies

Azure Synapse AnalyticsAzure Data Lake StorageAzure DatabricksMicrosoft PurviewPower BI

Industry Keywords

Data ModernizationMachine LearningGenerative AIComplianceSOC 2NISTCMMC

Tech Stack

Tools & technologies

AzureCloudETLMySQLNoSQLPostgresPySparkPythonSparkSQLTableau

About the role

Key responsibilities & impact

Design and develop enterprise-scale data solutions using Microsoft Fabric, Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage, and Azure Databricks
Build and optimize scalable ETL/ELT pipelines for structured, semi-structured, and unstructured data
Develop Lakehouse, Data Warehouse, and Medallion Architecture solutions
Design and implement batch and real-time data processing frameworks
Lead data modernization, migration, and integration initiatives from legacy platforms
Develop data foundations for AI, Machine Learning, and Generative AI solutions
Prepare, transform, and optimize datasets for AI applications, model training, and fine-tuning
Design and implement RAG architectures and vector search solutions
Support Azure OpenAI, Microsoft Copilot, and enterprise LLM implementations
Collaborate with Data Scientists and AI Engineers to operationalize AI and machine learning solutions
Build distributed data processing solutions using PySpark and Spark SQL
Develop automated integrations connecting APIs, SaaS applications, databases, and cloud services
Design reusable data engineering frameworks, components, and standards
Optimize workloads for performance, scalability, reliability, and cost efficiency
Implement data quality, validation, monitoring, and error-handling processes
Implement data governance and cataloging using Microsoft Purview
Establish data lineage, classification, cataloging, and access controls
Ensure alignment with security, privacy, compliance, SOC 2, NIST, and CMMC requirements
Design and support semantic data models for Power BI and enterprise analytics
Enable self-service analytics and support KPI frameworks, executive dashboards, reporting, and predictive analytics
Provide technical guidance and mentorship to junior and mid-level data engineers
Participate in solution architecture, technical design reviews, implementation planning, and presales activities
Work with clients and stakeholders to translate business needs into scalable technical solutions
Develop technical documentation, engineering standards, and reusable implementation patterns
Troubleshoot data pipeline, platform, and integration issues
Monitor and optimize data workloads and cloud resources
Support enhancements, upgrades, and ongoing maintenance of data platforms
Identify improvements in data quality, automation, performance, and operational efficiency
Stay current with Microsoft Fabric, Azure, AI, Generative AI, and data engineering technologies

Requirements

What you’ll need

Website LinkedIn All Job Openings 51 - 200 employees Founded 2011 📚 Education 🤝 Non-profit 👥 HR Tech Education
Non-profit
HR Tech AIM Qualifications and Assessment Group is a not-for-profit awarding organisation and Access Validating Agency with over 40 years of experience in creating and awarding qualifications, including Access to HE Diplomas. The organisation is dedicated to promoting inclusion, integrity, respect, and empowerment through flexible, professional, and technical qualifications ranging from Entry Level to Level 6. AIM also specializes in end-point assessments for apprenticeships in the creative, cultural, digital technologies, and professional services sectors, supporting various organisations in delivering quality training and assessments.

Benefits

Comp & perks

Remote-first work environment
Opportunity to work on enterprise-scale Microsoft Fabric and Azure data platforms
Exposure to AI, Generative AI, Azure OpenAI, and LLM initiatives
Opportunity to work with modern cloud and data technologies
Collaborative, innovation-driven culture
Exposure to diverse enterprise and consulting projects