More jobs:
Job Description & How to Apply Below
We are looking for a Senior Full-Stack Engineer to own and evolve our enterprise data governance and cataloging platform. This is a high-impact role where you will work across the full stack: a FastAPI/Python backend, Celery async workers, and a constellation of internal microservices. You will be responsible for building features, debugging production issues end-to-end, and ensuring platform reliability.
Key Responsibilities- Design, develop, and maintain backend APIs using FastAPI, SQL Alchemy, and Pydantic
- Build and enhance frontend features in React and Type Script (Redux, React Flow for lineage visualization)
- Develop and maintain Celery async tasks (Elasticsearch sync, query execution, lineage creation, metastore updates)
- Integrate with external services:
Trino (SQL engine), Elasticsearch (search), Hive Metastore (metadata), Vault (secrets), Keycloak/OAuth2 (auth), and internal microservices - Debug complex cross-layer issues spanning API routes, ORM relationships, SQL parsing, frontend state management, and Docker containers
- Write and maintain database migrations using Alembic
- Manage Docker-based local development and contribute to CI/CD pipeline improvements
- Ensure code quality through linting, testing, and code review
- 5+ years with Python (3.10+), strong grasp of async patterns, ORM pitfalls, and debugging
- Hands-on experience with FastAPI (route design, middleware, dependency injection, Pydantic models)
- Deep experience with SQL Alchemy ORM
- Working knowledge of Celery (task design, debouncing, beat scheduling, worker debugging)
- Familiarity with Trino/Presto SQL dialect Data & Infrastructure
- Experience with PostgreSQL (queries, indexing, migrations)
- Working knowledge of Elasticsearch (index management, document sync, search queries)
- Experience with Docker and Docker Compose for local development and debugging (container logs, exec, restart workflows)
- Familiarity with Redis as a message broker and cache
- Exposure to Hive Metastore or similar catalog systems is a plus
- Experience with data governance or data catalog platforms (Apache Atlas, Data Hub, Amundsen, Collibra, or similar)
- Knowledge of Apache Iceberg table format and its catalog integration
- Experience with Spark job submission via Kubernetes
- Familiarity with Apache Arrow / Flight for high-performance data transfer
- Experience with DBT and artifact management
- Understanding of data classification and access policy frameworks
- Experience with LDAP / Active Directory integration
- Familiarity with Nginx reverse proxy configuration
Position Requirements
10+ Years
work experience
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×