Senior Web Scraping Engineer Python

Senior Web Scraping Engineer Python

Location:

Poland

Job type:
Remote

We’re a team of 500+ professionals who develop cutting‑edge proxy and web data scraping solutions for thousands of the world’s best known businesses, including Fortune 500 companies. You’ll solve complex challenges and maintain our own infrastructure handling 60PB+ monthly data traffic.

• 60PB+ monthly data traffic through our systems
• 6PB+ Ceph storage
• 300k+ service requests/sec processed
• 500k+ Kafka messages/sec streamed

We run one of the most advanced and largest scraping and parsing products in the world. Our scrapers and parsers are used by leading e‑commerce, market‑intelligence, and AI industry players. The team is a blend of different personalities from diverse backgrounds. We support you in learning how to build your own scrapers and share all tips, tricks, and hacks so you’re onboard quickly.

• Develop scalable scrapers.
• Define resilient scraping strategies and unblock websites.
• Improve system observability.
• Develop back‑end solutions for scraping & parsing problems of various magnitudes.
• Maintain the current system and develop new features related to scraping & parsing.

• Experience working with Python.
• Understanding of computer science fundamentals (data structures, algorithms, computability, and complexity).
• Version control skills using Git.
• Knowledge of how to unblock websites for scraping.
• Ability to use different scraping techniques & open‑source tools to build scrapers.
• Comfortable with Dev Tools.
• Network (TLS/SSL) knowledge.
• Worked with browser automations.
• Knowledge of asynchronous programming.

• Web development knowledge.
• Knowledge of CSS selectors/XPaths for parsing.
• Experience with Go & C++.
• Worked on browser source code.
• Knowledge of any front‑end framework.
• Experience with Pydantic, FastAPI, SQL Alchemy.
• Experience with Redis, MySQL, Docker, Kubernetes, Elasticsearch, Kibana, and monitoring tools like Grafana, Prometheus.
• Experience with machine learning in domain‑specific scraping.
• Experience building scalable systems.
• Desired salary:
  Gross 5600 EUR/month, negotiable based on skills.

• Gross salary from 5600 EUR/month, open to negotiation.

Up for the challenge? Let’s talk!

Please mention the word PROUD and tag RMz Qu Mz Qu Mj Mz Lj Q0  when applying to show you read the job post completely (#RMz Qu Mz Qu Mj Mz Lj Q0 ).