Senior Software Engineer – Identity Resolution

Location: Remote/Homebased

We are seeking an experienced Senior Software Engineer to join our Identity Resolution engineering team.

This role will focus on designing, developing, testing, and supporting high-scale Identity Resolution and Entity Resolution systems that match, link, and resolve identities across large and diverse datasets. The engineer will work on both large-scale distributed data-processing workloads and high-performance application services, including low-latency APIs used for real-time identity resolution.

The ideal candidate will have strong software engineering experience across Java, Python, Scala, Apache Spark, and SQL, along with hands-on experience with AWS and Databricks.

This position will work closely with architects, engineers, data teams, and product stakeholders to implement scalable, reliable, secure, and high-performance solutions.

Key Responsibilities

• Design, develop, test, and maintain software supporting large-scale Identity Resolution and Entity Resolution platforms.
• Develop systems that match, link, consolidate, and resolve identities across multiple datasets and data sources.
• Implement both real-time and batch identity-resolution workflows.
• Develop high-performance backend services and APIs using Java, Python, and Scala.
• Build and optimize low-latency APIs supporting real-time identity lookup and resolution.
• Develop large-scale distributed data-processing applications using Apache Spark.
• Build and maintain Spark workloads using Scala and Python.
• Develop complex SQL queries and data-processing logic to support identity matching, analysis, and data transformation.
• Work with Databricks to develop, optimize, and operate large-scale data-processing workloads.
• Develop cloud-native applications and data-processing solutions using AWS.
• Work closely with architects to translate solution designs and technical requirements into production-quality software.
• Contribute to technical design discussions and recommend implementation approaches based on performance, scalability, reliability, and maintainability.
• Implement deterministic and probabilistic matching logic, fuzzy matching, data normalization, identity linking, and related Identity Resolution capabilities.
• Optimize application code, Spark workloads, SQL queries, and data pipelines for performance and scalability.
• Troubleshoot complex application, distributed-processing, data-quality, and production performance issues.
• Develop automated tests and validation processes to ensure the accuracy and reliability of identity-matching logic.
• Build monitoring, logging, metrics, and observability into production applications and data-processing workloads.
• Participate in code reviews and help establish strong software engineering practices across the team.
• Mentor junior and mid-level engineers and provide technical guidance on complex development tasks.
• Collaborate with architects, engineering teams, data engineers, product teams, security teams, and other stakeholders.
• Stay current with evolving technologies and engineering practices related to Identity Resolution, distributed systems, cloud computing, and large-scale data processing.