Senior Software Engineer; Big Data

Bitsight is a cyber risk management leader transforming how companies manage exposure, performance, and risk for themselves and their third parties. Companies rely on Bitsight to prioritize their cybersecurity investments, build greater trust within their ecosystem, and reduce their chances of financial loss.
Built on over a decade of technological innovation, its integrated solutions deliver value across enterprise security performance, digital supply chains, cyber insurance, and data analysis.

• We invented the cyber ratings industry in 2011
• Over 3000 customers trust Bitsight
• Over 750 teammates are dispersed throughout Boston, Raleigh, New York, Lisbon, Singapore, and remote

Bitsight is looking for an experienced Big Data Engineer to join our engineering team. We pride ourselves in building exceptional career opportunities and offering outstanding benefits to our team. We have the enthusiasm of a start-up but the structure and solidity of a mature industry leader.

Bitsight’s mission is to make the online world a safer place by helping governments, companies and NGOs understand and mitigate their cybersecurity risks. Ours is an internet-scale challenge - we track every IP address, every piece of malware, and a good portion of the world’s internet traffic.

Bitsight’s data pipeline is the core of our Security Ratings product. We ingest security-related intelligence data from many sources, feed terabytes of data into a proprietary rating algorithm, and deliver ratings for over 1,000,000 organizations on a daily basis. Built on the highly scalable AWS ecosystem, our pipeline code base meets the highest standards of reliability and scalability to deliver consistent, actionable, intuitive, and responsive ratings to the customer.

We are looking for developers with a passion for building software to collect, aggregate, and analyze data at scale using continuous, incremental development methodologies. Working with a close-knit team across multiple locations, you will help us architect and evolve the pipeline to support even larger volumes via cloud data warehouses. You will bring actionable security insights to the customer through integrating new data sources, surfacing new features from existing data, and refining the rating algorithm.

Collaborating with data science and research teams, you will build trust with Bitsight customers in the quality and integrity of our data.

Apart from domain skills, what we truly value are strong generalists: those with the critical thinking skills to use a variety of technologies and languages and pick up new concepts when needed. Strong collaboration skills are a must. We offer an opportunity to make a unique impact, not just as an individual but on the entire engineering team.

Requirements

• Prior experience building and operating large-scale data pipelines

• Strong proficiency in modern Java language programming

• Strong computer science fundamentals in design, data structures, and algorithms

• Experience working with a team of engineers, designers, and product owners in delivering a product to end-users

• Excellent (English) written and verbal communication skills

Preferred Skills

• Experience with Python

• Experience with Hadoop, Spark ecosystems

• Experience with Data Lakehouse tech stack, e.g. Apache Iceberg

• Experience with Elasticsearch or Open Search

• Experience with Star Rocks or similar OLAP engines

• Experience with CI/CD and Kubernetes

• Experience working in the IT security domain

Belonging & Inclusion. Bitsight is proud to be an equal opportunity employer. This means we do not tolerate discrimination of any kind and are committed to providing equal employment opportunities regardless of your gender identity, race, nationality, religion, sexual orientation, status as a protected veteran, or status as an individual with a disability.

Culture. We put our people first. Bitsight offers best in class benefits. We devote the same energy to nurturing our company's inclusive culture as we apply to serving our customers' needs. Working at Bitsight will give you the opportunity to fulfill your professional goals and expand your skills.

Open-minded. If you got to this point, we hope you’re feeling excited…