Software Engineer, Data Analyst

Overview

District 4 Labs ("District 4" or "D4") is a cutting-edge data business dedicated to building the open-source intelligence (OSINT) tools and technologies of tomorrow. Its flagship product, DARKSIDE, is one of the world’s largest repositories of breached data, compromised records, and other person of interest information. DARKSIDE was built by investigators for investigators and is critical for any online investigation or intelligence gathering exercise, especially those involving attribution and online account identification.

POSITION SUMMARY

Software Engineers play a critical role in designing, building, and maintaining our in-house dark web and open-source data repositories, search applications, and APIs. They will also work closely with a cross-functional team to improve and maintain the reliability, scalability, and performance of these tools and technologies. Expertise in data ingestion and parsing is especially sought after.

ESSENTIAL JOB FUNCTIONS

Engineers will generally:

• Parse new deep and dark web data sets ahead of addition to DARKSIDE.
• Develop and maintain API endpoints for querying dark web data, ensuring efficient and reliable access to our systems.
• Identify and integrate optimal database solutions.

• Collaborate with other engineers and Dev Ops teams to optimize search algorithms and improve search relevance.
• Work with client-facing team members to understand customer requirements and translate them into technical specifications for enhancements.
• Stay up to date with industry trends and best practices in search technologies and API management to drive innovation and improvement.
• Work with internal and external stakeholders to optimize data infrastructure and identify cost savings, where possible.

COMPETENCIES

• Proficiency in working with large-scale data processing frameworks, especially Elasticsearch

Familiarity with open-source intelligence (OSINT) and/or dark web intelligence collection and/or processes

• Experience with API development and management, including authentication, versioning, and performance optimization
• Proven experience as an engineer, preferably in the development and management of search engines and APIs
• Demonstrated knowledge of cloud platforms, especially AWS and Azure
• Excellent communication and collaboration skills to work effectively in a cross-functional team environment
• Knowledge of data privacy and security considerations when working with sensitive data
• Strong programming skills in Python

EDUCATION & EXPERIENCE REQUIREMENTS

To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. Reasonable accommodations may be made to enable individuals with disabilities to perform essential functions. While not required, candidates typically have a Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field.

-----------------------------------------------------------

District 4 provides equal employment opportunities to all employees and applicants.

Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required of the employee for this job. Duties, responsibilities, and activities may change at any time with or without notice.