Data Engineer

• Design, develop, test, deploy, and monitor data pipelines in Databricks on AWS from a wide variety of data sources
• Design, develop, test, deploy, and monitor scalable code with PySpark and SQL in Databricks
• Identify opportunities to improve internal processes through code optimization and automation
• Build data quality dashboards, lineage flows, and monitoring tools
• Provide active monitoring and actionable insight into overall data quality and data governance
• Assist in migrating data from legacy systems to newly developed solutions
• Follow and lead best practices for data security, retention, and privacy policies
• Provide clean, protected, quality, and auditable data from various sources into fit-for-purpose data products

Data Engineer – Personal Loans

• Build and operate batch and streaming pipelines bringing data from databases, event streams, and SaaS tools into BigQuery
• Model the data warehouse so business concepts are defined once and reused
• Keep pipelines and queries fast, reliable, and cost-efficient
• Set up data contracts, automated testing, and freshness monitoring
• Establish data ownership, documentation, and access control for sensitive customer data
• Improve data and annotation quality with the ML team to raise model performance
• Work with product managers and analysts to create self-service datasets from business questions
• Own core metric definitions and event taxonomy
• Shorten the time from hypothesis formulation to data validation
• Support modeling, ML serving, and operational workflows
• Help expand the Analysis Platform team into data engineering, including reliable pipelines, governed warehousing, annotation efficiency, and faster value validation
• Collaborate with ML engineers, platform engineers, and product teams
• Participate in product development for CADDi DRAWER, CADDi’s cloud-based manufacturing drawing digital-transformation system

Data Engineer jobs in Vietnam

Data Engineer – Personal Loans

Data Engineer – Analysis Platform