Software Engineer, Data Engineering

Staff Software Engineer, Public Records and Derived Authorities

Are you ready to shape the future of AI‑driven content technology while leading cutting‑edge innovation in a mission‑critical role? Do you thrive in environments where your technical expertise can directly impact how the world's leading professionals access and utilize information? We are seeking a talented, self‑driven and highly motivated Staff Data Engineer with experience working with and developing large data solutions to join our Public Records Publishing and Derived Authorities team.

• Design and lead large‑scale, cloud‑native data pipelines and publishing systems—processing billions of records using Snowflake, Python, and AWS services.
• Architect scalable data processing strategies, including stored procedures, transformation logic, orchestration, and enterprise data platform standards.
• Drive technical innovation, evaluating emerging data engineering techniques, leading proofs of concept, and shaping long‑term data platform roadmaps.
• Provide senior technical leadership, making architectural decisions, translating business needs into scalable solutions, and mentoring engineers at all levels.
• Ensure data quality, observability, and operational excellence through testing frameworks, performance optimization, monitoring, and governance for security/compliance.
• Lead cross‑functional collaboration with Product, Engineering, and Labs teams to translate data capabilities into application features and market‑ready content workflows.
• Oversee optimization of large‑scale data processing across latency, cost, and resource efficiency, driving continuous improvements to data infrastructure.
• Serve as a thought leader representing best practices in data engineering, influencing strategy, feature development, and organizational standards.

We’re seeking an experienced engineer with strong hands‑on development skills who has worked extensively with large datasets and modern data platforms. You should be equally comfortable writing Python code, developing stored procedures, optimizing data pipelines, and designing scalable data architectures. Strong software engineering fundamentals, data modeling expertise, and production data platform experience are essential.

• Bachelor’s degree in Computer Science/Engineering (Master’s preferred) with 8+ years in software and data engineering, including 4+ years in senior or lead roles.
• Proven hands‑on engineering background with expertise in Python, data pipelines, and production‑grade ETL/ELT systems.
• Demonstrated experience delivering production‑grade software through the full Software Development Lifecycle (SDLC).
• Deep experience with Snowflake (Python stored procedures, performance tuning, data modeling) and AWS data engineering services (S3, Lambda, Glue, Step Functions).
• Proficiency with AI‑assisted development tools, including Cursor and/or Claude, is required.
• Strong capabilities in SQL, data modeling, distributed data processing, data quality frameworks, and cloud cost/performance optimization.
• Solid software engineering fundamentals including API development, testing, design patterns, Git workflows; bonus for Docker/Kubernetes/Terraform.
• Strong understanding of data governance, security, compliance, and managing large‑scale datasets, migrations, and orchestration workflows.
• Demonstrated technical leadership, excellent communication, ability to translate business requirements, and experience working in Agile/Scrum environments.

• Experience with other modern data platforms or cloud data warehouses (Databricks, Big Query, Redshift).
• Experience with data publishing workflows and content delivery systems.
• Domain expertise in legal, tax, accounting, or other regulated industries, particularly with investigative platforms or systems that search and analyze large‑scale public and proprietary records.
• Track record of successful data platform launches and scaling data systems to enterprise customers.
• Knowledge of data mesh or modern data architecture patterns.
• Experience with infrastructure as code (Terraform, Cloud Formation).
• Portfolio demonstrating…