Backend Engineer — Data Processing
Listed on 2026-10-16
-
Software Development
Backend Developer, Python
Location: Dumbo, Brooklyn, NY
Work Arrangement: Onsite, 5 days per week (required)
Employment Type: Full-time
Base Salary: $220,000–$300,000
Equity: Competitive equity package
Visa: Open to OPT and H-1B transfers; additional sponsorship may be considered
Relocation: Up to $10,000 in relocation assistance
A rapidly growing AI and data company is building the data infrastructure that powers next-generation AI models. The company works with proprietary enterprise data, transforming information generated through real-world business operations into de-identified datasets for leading AI research organizations.
Having grown from $0 to a multi-eight-figure annualized runrate within months, the business is scaling rapidly with a lean engineering team of approximately five people.
This is an opportunity to join at an early stage, take meaningful ownership of mission-critical systems, and directly influence the architecture and reliability of a high-impact data-processing platform.
The team is seeking a Backend Engineer to build andevolve the systems that transform sensitive enterprise information intohigh-quality, AI-training-ready datasets.
The core focus is on the processing logic applied to thedata itself
, rather than traditional data engineering, ETL, or infrastructure work centered primarily on moving data between systems.
- Design,build, and scale multi-stage, high-volume data-processing pipelines thatde-identify sensitive enterprise data from collaboration tools, email,cloud storage, code repositories, and project-management systems.
- Ownbackend systems end-to-end, from architecture and implementation through debugging, correctness validation, production monitoring, and recovery.
- Develop safeguards to detect silent failures, duplicate outputs, stale data, andother data-quality issues before customer delivery.
- Build reliable mechanisms for retries, checkpoints, partial failures, replay,backfills, and rollbacks across asynchronous workflows, batch workers,queues, and object storage.
- Develop internal tools and dashboards to monitor pipeline performance, investigate data quality, and inform release decisions.
- Partner with ML, full-stack, platform, and security engineers to support new data modalities and expand processing capabilities.
- Improve the reliability, observability, and scalability of systems handling complex and sensitive datasets.
Required Qualifications
- 3–10years of software engineering experience
, with direct ownership of production backend systems. - Demonstrated experience shipping and operating production software, ideally involving multi-stage, high-volume data-processing pipelines.
- Relevant undergraduate STEM degree from a top-30 U.S. institution.
- Strong understanding of distributed and asynchronous backend systems, including:
- Queues,workers, and concurrency
- Idempotency and retry strategies
- Partial failures and fault tolerance
- Recovery,replay, and data consistency
- Meaningful full-time experience at an early-stage or high-growth startup, with demonstrated ownership, adaptability, and comfort operating in ambiguous environments.
- Strong proficiency in a general-purpose backend programming language.
- Ability and willingness to work onsite five days per week in Dumbo, Brooklyn, NY.
Important: The undergraduate education requirement and five-day onsite requirement are firm. Candidates who do not meet both criteria will not be considered.
Technical EnvironmentThe current technology stack includes:
Python, AWS, Airflow, AWS Batch, SQS, S3, DynamoDB, and PostgreSQLPython experience is not mandatory. Strong backend engineers with experience in Go, Rust, Java, or other general-purpose languages
are encouraged to apply.
- AWSand cloud-based backend systems
- Batch processing and workflow orchestration
- Nat…
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).