Full-Stack Engineer | Web Crawling; m/f/d
80331, München, Bayern, Deutschland
Verfasst am 2026-10-16
-
Software Entwicklung
DevOps Ingenieur, Cloud-Ingenieur - Software, Backend Entwicklung, Python
About the Job
We build and operate l
arge-scale web crawling and extraction systems that turn unstructured, dynamic websites into clean, structured, and correct data. You'll own crawlers
end-to-end: discovery, resilient fetching against real anti-bot defenses, and turningHTML/PDF into trustworthy structured output.
- Build and scale
crawlers that handle dynamic, large-scale sites - and keep them runningas those sites change and fight back. - Stay ahead of
anti-bot measures: TLS/browser fingerprinting, proxies, session andrate-limit strategy, change detection. - Turn raw HTML and PDF into clean,
correct structured data - including LLMassistedextraction - where silently-wrong output is worse than a crash. - Design and operate pipelines for ingestion, deduplication, versioning, and enrichment.
- Ship and run containerized apps in the cloud, with CI/CD.
- Shape our technical architecture and engineering culture.
Python, Docker, GCP (Cloud Run jobs) and Azure Blob, MongoDB. Go services and a React frontend on the periphery. You don't need all of it on day one, but you do need to
ramp up fast
- 3+ years of professional software development (5+ for the senior track).
- Strong Python - real production code, async.
- Hands-on web scraping at scale, including firsthand experience with anti-botdefenses and the failure modes of large-scale collection.
- A data-correctness mindset - you care that extracted data is right, not just that the jobfinished.
- Docker + at least one major cloud (GCP, Azure, or AWS), Git, comfortable on theCLI.
- Clear communicator who works well in a small, fast-moving team.
- LLM-assisted extraction / working with LLMs, ML pipelines, or datalabeling workflows.
- Go or Java/Spring Boot.
- Frontend (React) — or eagerness to pick it up.
- Terraform, Kubernetes, modern Dev Ops tooling.
- A vibrant in-office culturein Munich with the option for up to 60 % work from home.
- Flexible working hours.
- 30 vacation days per year (including 4 “company rest days” over christmas).
- 30 daysof "workation" per year, within the EU and selected countries.
- Highautonomyand flat hierarchies.
- EGYM Wellpassfor unlimited access to fitness courses and gyms.
- Udemy access for educational videos.
Certivity is an equal opportunities employer. We are committed to equal employment opportunities regardless of race, religion, sexual orientation, age, marital status, disability, or gender identity. Please do not submit personal data revealing racial or ethnic origin, political opinions, religious or philosophical beliefs, trade union membership, data concerning your health, or data concerning your sexual orientation.
(Wenn dieser Job tatsächlich in Ihrem Zuständigkeitsbereich liegt, verwenden Sie möglicherweise einen Proxy oder VPN, um auf diese Seite zuzugreifen. Um weiterzukommen, sollten Sie Ihre Verbindung zu einem anderen Mobilgerät oder PC wechseln).