×
Register Here to Apply for Jobs or Post Jobs. X

Lead Data Engineer

Job in Los Angeles, Los Angeles County, California, 90079, USA
Listing for: WorkHQ
Full Time position
Listed on 2026-01-01
Job specializations:
  • IT/Tech
    Data Engineer, Big Data
Job Description & How to Apply Below

Company Context

Series A, well-funded US startup in HRTech developing an AI Recruiter product. This is a US-only, Remote role (Mainland).

Role Overview

Lead data infrastructure architect managing billions of data points across 250M+ professional profiles. Hire data engineers to aid you in that journey.

Core Responsibilities
  • Design scalable data pipelines processing massive record volumes
  • Architect ETL processes using PySpark on Amazon EMR (Open to shifting to other solutions like Data Bricks / Snowflake)
  • Distribute enriched data through medallion architecture across Postgres, Athena, Open Search
  • Integrate new data sources into the main pipeline
  • Implement advanced data matching using Splink
Technical Requirements

5-8 years professional data engineering experience. Good proficiency in:

  • PySpark and distributed computing
  • AWS data services (EMR, Glue, Athena)
  • Docker
  • Pandas and Data Frame manipulation
  • Complex data format handling (JSONL, Parquet)

Strong background in:

  • Big data processing architectures
  • Data warehouse design
  • Performance optimization
  • Advanced Python, SQL skills
Nice to Have
  • Probabilistic record linking expertise
  • Open Search/elasticsearch technologies
  • Machine learning data pipeline design
  • Recruitment tech ecosystem knowledge
Technical Stack
  • Big Data:
    PySpark, EMR
  • Databases:
    Postgres, Open Search
  • Cloud: AWS
  • Containerization:
    Docker
  • Data Formats: JSONL, Parquet
  • Analytics:
    Metabase, Athena, Glue
  • Data Processing:
    Pandas, Splink
Other Considerations

While this role has specific requirements – if you lack a few technical skills, but motivated to learn and lead the platform, please apply for consideration. If you are coming from Director/Head of/VP levels that is relevant to this job, you can apply as well. You will need to apply directly on our platform.

Thank you for your time.

WorkHQ

#J-18808-Ljbffr
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
 
 
 
Search for further Jobs Here:
(Try combinations for better Results! Or enter less keywords for broader Results)
Location
Increase/decrease your Search Radius (miles)

Job Posting Language
Employment Category
Education (minimum level)
Filters
Education Level
Experience Level (years)
Posted in last:
Salary