Senior Web Scraping Engineer

Join a team reshaping how companies manage shipping spend.

Founded in 2005, Lojistic is a shipping spend management platform helping businesses reduce costs through analytics, automation, and intelligence. We work with SMB and enterprise companies across industries—including brands like Chipotle, Miller Coors, Christian Louboutin, Electrolux, Royal Caribbean, and Toshiba—to help them uncover inefficiencies and make smarter, data-driven decisions.

As a Senior Web Scraping Engineer at Lojistic, you’ll own the backbone of everything we do: a large-scale web data acquisition pipeline processing tens of millions of scrapes each month. You’ll be responsible for keeping the system reliable in production by maintaining uptime, reducing failures, and continuously improving resilience.

If you thrive in engineering work that rewards depth over breadth and long-term resilience over flashy launches, keep reading.

• Owning the end-to-end reliability of Lojistic’s web scraping infrastructure – tens of millions of pages scraped monthly across a diverse set of tools and services.
• Monitoring scraping and API success rates and system health, identifying issues early, and jumping on problems before they cascade.
• Responding to scraping and API failures and outages with urgency – diagnosing root causes, deploying fixes, and communicating status to the team.
• Proactively improving the data retrieval platform: building better alerting, adding redundancies, increasing resilience, and reducing manual intervention over time.
• Evaluating and experimenting with new scraping technologies, libraries, and approaches (even across different languages) to stay ahead of an ever-changing web landscape.
• Working with authenticated sessions and login-protected data sources, handling the unique challenges that come with retrieving data behind authentication walls.
• Collaborating with our senior team on major architectural decisions while having the autonomy to move fast on day-to-day improvements.
• Building and maintaining dashboards and tooling that give the team clear visibility into the health and performance of our data collection systems.

• Experience building and maintaining monitoring, alerting, and observability systems for production infrastructure.
• Comfort working across multiple languages and tools – our core codebase is primarily written in Ruby, but we don’t require Ruby experience. You should be the kind of developer who can pick up a new language and be productive quickly.
• Strong debugging and diagnostic skills – you can trace a failure across multiple systems and identify the root cause without hand-holding.
• Self-directed and comfortable with ownership. You won’t always have a manager assigning you daily tasks. You’ll have a mission, and you’ll work with the team to figure out the best way to accomplish it.
• Excellent communication skills – you can explain what broke, why it broke, and what you’re doing about it in a way that a non-engineer can understand.