FREE ACCESS
5,000–10,000 jobs/day
See all jobs on Scoutfield
Search thousands of fresh jobs every day.
Discover
- Fresh listings
- Fast filters
- No subscription required
Create a free account and start exploring right away.
Core Competencies
Role fitCore Competencies
Use this summary to align your resume positioning with the role.
Demonstrates expertise in developing and optimizing large-scale Identity Resolution and Entity Resolution systems, utilizing Java, Python, Scala, and Apache Spark. Proficient in cloud-native application development on AWS and implementing high-performance APIs and data-processing workflows.
Highest-signal resume keywords
Java Application DevelopmentPython Data ProcessingApache Spark WorkloadsAWS Cloud ServicesSQL Query Optimization
ATS Keywords
Tailor your resumeApplicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills
JavaPythonScalaApache SparkSQLDatabricksREST APIsMicroservicesAutomated TestingCI/CD
Soft Skills
Analytical SkillsTroubleshootingProblem-SolvingCommunicationCollaboration
Tools & Technologies
AWSDatabricksGitDistributed SystemsMonitoring Tools
Industry Keywords
Identity ResolutionEntity ResolutionData MatchingMaster Data ManagementCustomer 360
Tech Stack
Tools & technologiesApacheAWSCloudDistributed SystemsJavaMicroservicesPythonScalaSparkSQL
About the role
Key responsibilities & impact- Design, develop, test, and maintain software supporting large-scale Identity Resolution and Entity Resolution platforms
- Develop systems that match, link, consolidate, and resolve identities across multiple datasets and data sources
- Implement real-time and batch identity-resolution workflows
- Develop high-performance backend services and APIs using Java, Python, and Scala
- Build and optimize low-latency APIs supporting real-time identity lookup and resolution
- Develop large-scale distributed data-processing applications using Apache Spark
- Build and maintain Spark workloads using Scala and Python
- Develop complex SQL queries and data-processing logic for identity matching, analysis, and data transformation
- Develop, optimize, and operate large-scale data-processing workloads with Databricks
- Develop cloud-native applications and data-processing solutions using AWS
- Translate solution designs and technical requirements into production-quality software with architects
- Contribute to technical design discussions and recommend implementation approaches
- Implement deterministic and probabilistic matching logic, fuzzy matching, data normalization, identity linking, and related capabilities
- Optimize application code, Spark workloads, SQL queries, and data pipelines
- Troubleshoot application, distributed-processing, data-quality, and production performance issues
- Develop automated tests and validation processes for identity-matching accuracy and reliability
- Build monitoring, logging, metrics, and observability into production applications and data-processing workloads
- Participate in code reviews and establish software engineering practices
- Mentor junior and mid-level engineers and provide technical guidance
- Collaborate with architects, engineering, data, product, security, and other stakeholders
- Stay current with technologies and practices related to Identity Resolution, distributed systems, cloud computing, and large-scale data processing
Requirements
What you’ll need- 5+ years of professional software development experience, including experience developing and supporting production software systems
- Strong proficiency in Java and enterprise application development
- Strong proficiency in Python for application development, data processing, automation, or distributed workloads
- Strong proficiency in Scala, particularly for large-scale data-processing applications
- Strong hands-on experience with Apache Spark and distributed data processing
- Advanced proficiency in SQL, including complex queries, data transformations, and query optimization
- Experience developing production workloads using Databricks
- Experience developing cloud-based applications and services using AWS
- Experience with Identity Resolution, Entity Resolution, record linkage, data matching, or similar large-scale data-processing systems
- Experience developing REST APIs, backend services, microservices, or distributed applications
- Experience building and optimizing high-throughput, low-latency services and APIs
- Strong understanding of distributed systems concepts, including concurrency, partitioning, caching, resiliency, scalability, and fault tolerance
- Experience optimizing Spark workloads, including partitioning, joins, caching, memory utilization, and execution performance
- Strong understanding of software engineering principles, object-oriented design, data structures, algorithms, and design patterns
- Experience with automated testing, CI/CD, source control, and modern software delivery practices
- Experience with Git and collaborative software development workflows
- Strong analytical, troubleshooting, and problem-solving skills
- Excellent written and verbal communication skills
- Ability to independently own complex development tasks while collaborating effectively with architects and other engineering team members
- Bachelor’s degree in Computer Science, Software Engineering, Computer Engineering, or a related technical field, or equivalent professional experience
- Experience with or strong familiarity with Identity Resolution, Entity Resolution, Customer 360, Master Data Management, identity graph, record linkage, or similar matching systems
Benefits
Comp & perks- Equal opportunity employment, including disability and protected veteran status
- Applications for remote work may be considered for applicants in Colorado, California, Connecticut, Massachusetts, Maryland, Nevada, New Jersey, New York City, Ohio, Rhode Island, Virginia, and Washington
