×
Register Here to Apply for Jobs or Post Jobs. X

Automation Engineer - Worlwide Remote

Remote / Online - Candidates ideally in
San Francisco, San Francisco County, California, 94199, USA
Listing for: Invisible Technologies
Remote/Work from Home position
Listed on 2026-06-30
Job specializations:
  • Software Development
    Python, Backend Developer
Salary/Wage Range or Industry Benchmark: 80000 - 120000 USD Yearly USD 80000.00 120000.00 YEAR
Job Description & How to Apply Below

Job Description

  • Create crawlers for each source URL using Python modules (Scrapy, Selenium, Requests, Beautiful Soup, Splash).
  • Develop and maintain Scrapy pipelines and middle wares to manage crawler output.
  • Build crawlers for all types of websites, overcoming technical roadblocks.
  • Manage crawlers to handle IP bans, geolocation bans, CAPTCHAs, and bot‑blocking services.
  • Write SQL queries for database operations using Python modules such as SQL Alchemy.
  • Deploy the Python scripts and crawlers to Linux‑based AWS servers.
Skills Must Haves
  • Strong hands‑on experience in Python programming.
  • Good experience with scraping libraries such as Requests, Beautiful Soup, Selenium and Scrapy.
  • Proven 3+ years working with web development frameworks such as Flask, Django, FastAPI, Tornado, and pandas, and building APIs and services using REST.
  • Experience with any RDBMS and strong SQL knowledge.
  • Clear understanding of object‑oriented concepts.
  • Proficient understanding of code versioning tools like Git.
Nice to Have
  • Familiarity with UI frameworks such as Angular or ReactJS.
  • Strong unit‑testing and debugging skills.
  • Knowledge of data engineering platforms such as Airflow.
  • Experience with Docker.
  • Knowledge of Agile and Scrum practices; experience with Jira and Confluence is a plus.
  • Experience with ETL and Celery.
  • Excellent interpersonal skills and ability to work with a diverse team.
Qualifications
  • Python
  • Web Scraping using Requests, Beautiful Soup, Selenium, and Scrapy
  • Frameworks such as Flask, Django, FastAPI, Tornado, pandas
  • Building APIs and services using REST
#J-18808-Ljbffr
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
 
 
 
Search for further Jobs Here:
(Try combinations for better Results! Or enter less keywords for broader Results)
Location
Increase/decrease your Search Radius (miles)
0
200
Filters
Education Level
Experience Level (years)
Posted in last:
Salary