Sr. Data Engineer - US; Remote

About the Role

As a Sr. Data Engineer, you’ll be a technical leader at the center of this transformation. You’ll shape platform architecture, drive AI‑powered product delivery, and raise the bar for what a small, AI‑augmented engineering team can accomplish.

• Build and scale high‑throughput streaming pipelines ingesting 400M+ monthly MLS updates across 350+ integrations using Airflow, Spark Streaming, Kafka, and Iceberg – ensuring reliability, performance, and data correctness.
• Model and deliver high‑quality, production‑grade real estate datasets that power core product experiences, focusing on data modeling, transformation logic, and balancing freshness, accuracy, and cost.
• Strengthen data quality and observability by implementing/improving data quality checks, monitoring, and alerting to detect issues early and reduce downstream impact.
• Leverage AI to improve data operations, contributing to AI‑driven tooling that helps triage, debug, and resolve data quality issues, increasing team efficiency and reducing manual intervention.

• You already build with AI daily. You use Claude Code as a core part of your workflow, not as a novelty.
• You have strong opinions, loosely held, about how AI changes software architecture, team structure, and engineering culture.
• You think in systems and connect technical decisions to customer outcomes and long‑term business value.
• You communicate clearly and directly, explaining complex tradeoffs to product, design, and executive stakeholders.
• You thrive in ambiguity and speed, working for a fast‑growing company where the roadmap evolves and ownership is real.
• You enjoy fun at work, celebrating wins and maintaining a healthy team culture.

• 6+ years of professional data engineering or software engineering experience.
• Strong experience with distributed data processing and streaming systems (Spark / PySpark, Kafka).
• Proficiency in Python (Pydantic preferred) and familiarity with Node/Type Script is a plus.
• Experience building and maintaining data pipelines on AWS using Airflow, Spark Streaming, and Iceberg.
• Solid understanding of data modeling and working with large‑scale datasets.
• Familiarity with event‑driven systems and ingestion patterns (Kafka, SQS).
• Experience implementing data quality checks, monitoring, and debugging data issues.
• Interest in applying AI/ML or automation to improve data workflows is a plus.
• Proven track record leading high‑impact initiatives from concept through production in a SaaS environment.
• Expert‑level grasp of software design principles and experience with multi‑tenant platform architectures.

• Backend:
  Python, PySpark, Pydantic, Node/Type Script
• Data:
  Iceberg, Postgres
• Infrastructure: AWS, Kubernetes, Airflow, Spark Streaming
• Messaging:
  Kafka, SQS

$150,000 - $190,000 a year

Luxury Presence is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, or national origin.