Senior Software Engineer – Identity Resolution

Remote/Homebased

Full time

JR014681

We are seeking an experienced Senior Software Engineer to join our Identity Resolution engineering team.

This role will focus on designing, developing, testing, and supporting high-scale Identity Resolution and Entity Resolution systems that match, link, and resolve identities across large and diverse datasets. The engineer will work on both large-scale distributed data-processing workloads and high-performance application services, including low-latency APIs used for real-time identity resolution.

The ideal candidate will have strong software engineering experience across Java, Python, Scala, Apache Spark, and SQL, along with hands-on experience with AWS and Databricks.

This position will work closely with architects, engineers, data teams, and product stakeholders to implement scalable, reliable, secure, and high-performance solutions.

Key Responsibilities

• Design, develop, test, and maintain software supporting large-scale Identity Resolution and Entity Resolution platforms.

• Develop systems that match, link, consolidate, and resolve identities across multiple datasets and data sources.

• Implement both real-time and batch identity-resolution workflows.

• Develop high-performance backend services and APIs using Java, Python, and Scala.

• Build and optimize low-latency APIs supporting real-time identity lookup and resolution.

• Develop large-scale distributed data-processing applications using Apache Spark.

• Build and maintain Spark workloads using Scala and Python.

• Develop complex SQL queries and data-processing logic to support identity matching, analysis, and data transformation.

• Work with Databricks to develop, optimize, and operate large-scale data-processing workloads.

• Develop cloud-native applications and data-processing solutions using AWS.

• Work closely with architects to translate solution designs and technical requirements into production-quality software.

• Contribute to technical design discussions and recommend implementation approaches based on performance, scalability, reliability, and maintainability.

• Implement deterministic and probabilistic matching logic, fuzzy matching, data normalization, identity linking, and related Identity Resolution capabilities.

• Optimize application code, Spark workloads, SQL queries, and data pipelines for performance and scalability.

• Troubleshoot complex application, distributed-processing, data-quality, and production performance issues.

• Develop automated tests and validation processes to ensure the accuracy and reliability of identity-matching logic.

• Build monitoring, logging, metrics, and observability into production applications and data-processing workloads.

• Participate in code reviews and help establish strong software engineering practices across the team.

• Mentor junior and mid-level engineers and provide technical guidance on complex development tasks.

• Collaborate with architects, engineering teams, data engineers, product teams, security teams, and other stakeholders.

• Stay current with evolving technologies and engineering practices related to Identity Resolution, distributed systems, cloud computing, and large-scale data processing.

Identity Resolution Experience

The Senior Software Engineer should have experience with, or strong familiarity with, Identity Resolution, Entity Resolution, Customer 360, Master Data Management, identity graph, record linkage, or similar matching systems.

Relevant concepts include:

• Deterministic matching

• Probabilistic matching

• Exact and fuzzy matching

• Entity and record linkage

• Identity stitching and consolidation

• Match confidence and scoring

• Attribute normalization and standardization

• Duplicate detection and resolution

• Source prioritization

• Identity graphs

• Real-time identity lookup

• Batch identity processing

• Incremen…