Apply

Ready to go for it?

AI Apply speeds things up—apply directly if you prefer.

FREE ACCESS
5,000–10,000 jobs/day
Scoutfield Logo

See all jobs on Scoutfield

Search thousands of fresh jobs every day.

Discover
  • Fresh listings
  • Fast filters
  • No subscription required
Create a free account and start exploring right away.
SOFTETA

Senior Data Engineer

SOFTETA

. Propose and lead architecture for user-data workflows across Airflow, Spark, dbt, and BigQuery, including encryption points, derived tables, backfills, and partitions .

Posted 10/31/2026full-timeVilnius • LithuaniaSenior💰 €5,000 - €7,000 per monthWebsite

Core Competencies

Role fit
Core Competencies

Use this summary to align your resume positioning with the role.

Demonstrates expertise in leading architecture for user-data workflows using Airflow, Spark, dbt, and BigQuery, with a strong focus on establishing engineering standards and best practices. Proven ability to manage pipeline migrations and ensure compliance with data lifecycle rules and security protocols.

Highest-signal resume keywords
AirflowSparkDbtBigQueryPython

ATS Keywords

Tailor your resume
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills
Pipeline MigrationData Lifecycle VerificationCode ReviewsTesting ProtocolsIncident Resolution
Soft Skills
MentoringTechnical Leadership
Tools & Technologies
GCP KMSBigQuery AEAD FunctionsTinkApache Kafka
Industry Keywords
Encryption At RestData Retention PoliciesRegulatory ComplianceGDPRArchitecture Decision Records

Tech Stack

Tools & technologies
AirflowApacheBigQueryCloudGoogle Cloud PlatformKafkaPythonSpark

About the role

Key responsibilities & impact
  • Propose and lead architecture for user-data workflows across Airflow, Spark, dbt, and BigQuery, including encryption points, derived tables, backfills, and partitions
  • Sequentially migrate existing pipelines behind a custom regression harness to guarantee identical output
  • Establish engineering standards after migration, including code reviews, testing protocols, incident post-mortems, and release checklists
  • Implement verification jobs to validate end-to-end data lifecycle rules
  • Participate in pipeline maintenance, incident response, and root-cause resolution
  • Document design choices using Architecture Decision Records (ADRs)

Requirements

What you’ll need
  • Deep hands-on experience with Airflow, Spark, dbt, BigQuery, and Python
  • Proven track record leading a live pipeline migration technically from conception to completion
  • Hands-on experience refactoring production pipelines while verifying identical output
  • Demonstrated success establishing engineering best practices, including testing, code reviews, and incident resolution, within a team
  • Concrete mentoring or technical leadership experience
  • Previous experience with encryption at rest, data retention policies, or regulatory compliance such as GDPR (nice to have)
  • Envelope encryption using GCP KMS, BigQuery AEAD functions, or Tink (nice to have)
  • BigQuery column-level security, policy tags, and Google Cloud Data Catalog (nice to have)
  • Event-driven architectures using Apache Kafka (nice to have)

Benefits

Comp & perks
  • Diverse and technically challenging projects
  • Training budget for professional and personal growth
  • Flexible working hours
  • Hybrid workplace model
  • Flexible schedule
  • Agile/SCRUM environment
  • Technical equipment that you can choose
  • Contractor compensation: 40 EUR to 45 EUR per hour (plus VAT)