More jobs:
Python Web Scraping Engineer – Advanced Automation
Remote / Online - Candidates ideally in
560001, Vasanthanagar, Karnataka, India
Listed on 2026-08-30
560001, Vasanthanagar, Karnataka, India
Listing for:
AIMLEAP
Full Time, Remote/Work from Home
position Listed on 2026-08-30
Job specializations:
-
IT/Tech
Data Engineering
Job Description & How to Apply Below
Location: Vasanthanagar
Python Web Scraping Engineer – Advanced Automation (WFH)
Experience:
2–5 Years
Location:
Remote (Work from Home)
Mode of Engagement: Full-time
No of Positions: 8
Educational
Qualification:
Bachelor's degree in computer science, IT, or related field
Industry: IT / Software Services / Data & AI
Notice Period: Immediate Joiners Preferred
What We Are Looking For
Strong hands-on experience handling dynamic, JavaScript-heavy websites using Selenium, Playwright, or Puppeteer.
Expertise in managing cookies, sessions, and local storage to maintain state and bypass authentication/anti-bot systems.
Ability to solve CAPTCHAs programmatically using third-party or AI-based solutions.
Proven experience in proxy rotation, IP management, and fingerprinting techniques to avoid detection and rate limits.
Capability to design scalable data pipeline architectures to automate extraction, validation, transformation, and storage.
Hands-on experience in web scraping using tools like Python (Beautiful Soup, Scrapy, Selenium) for extracting, cleaning, and structuring data from dynamic web sources.
Responsibilities
Develop and maintain high-scale automated scraping workflows for dynamic and protected websites.
Implement browser automation solutions using Selenium, Playwright, Puppeteer, or similar frameworks for complex user flows and asynchronous rendering.
Integrate CAPTCHA-solving services , proxy rotation systems, and advanced anti-detection mechanisms.
Build robust ETL-style data pipelines ensuring data quality, monitoring, retries, and error handling.
Collaborate with AI, data engineering, and product teams to deliver reliable scraping datasets.
Qualifications
2–5 years of experience in web scraping and automation using Python or JavaScript .
Strong experience in Selenium, Playwright, Puppeteer , and browser automation.
Proficiency in Python (Requests, Beautiful Soup, Scrapy, Async frameworks) or JavaScript/Node.js for automation workflows.
Hands-on experience with proxy networks, fingerprinting, session handling , and anti-bot strategies.
Understanding of SQL/No
SQL databases for structured data storage.
Experience working with AWS/GCP/Azure is a plus.
Strong debugging, analytical, and problem-solving skills.
Note that applications are not being accepted from your jurisdiction for this job currently via this jobsite. Candidate preferences are the decision of the Employer or Recruiting Agent, and are controlled by them alone.
To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search:
To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search:
Search for further Jobs Here:
×