Senior Data Engineer

About Crunchbase

Crunchbase is a predictive solution that provides intelligence on private companies, powered by the unique combination of live private company data, AI, and market activity from over 80 million users. We predict private market movements that matter to help investors, deal makers, and analysts make the right decisions.

We are committed to fostering a positive, diverse, and inclusive culture by hiring for potential and embracing individuals with diverse perspectives, backgrounds, experiences, and skill sets. We value transparency and openness, believing that an inclusive environment strengthens our teams and enhances our products.

Crunchbase has a remote‑first approach, and is open to hiring in residents of these states:
California, Colorado, Illinois, Florida, Georgia, Massachusetts, Nevada, New Jersey, New York, North Carolina, Oregon, Pennsylvania, South Carolina, Texas, Virginia, Washington, and Maine.

Our inclusive remote‑first culture, competitive pay, and employee wellness benefits set us apart!

As a Senior Data Engineer, you will be responsible for architecting and implementing robust data solutions to support the growing needs of our organization. You will work collaboratively with cross‑functional teams to design and maintain data pipelines, optimize data storage and retrieval, and contribute to the overall success of our data‑driven initiatives.

• Design and implement scalable and efficient data solutions. Collaborate with stakeholders to understand data requirements and translate them into effective solutions.
• Design, build, and optimize data pipelines for both batch and real‑time processing. Ensure the seamless flow of data across systems, maintaining high standards for data quality and reliability.
• Develop and maintain data models that align with business needs and support analytics, generative AI, and ML workloads. Optimize data storage, processing, and retrieval for maximum efficiency and performance.
• Work closely with data scientists, analysts, and other stakeholders to understand their needs and provide data engineering support. Communicate complex technical concepts to non‑technical team members effectively.
• Implement monitoring solutions to proactively identify and address performance issues. Troubleshoot and resolve data‑related problems in a timely manner.
• Stay abreast of industry trends and evaluate new tools and technologies to enhance our data capabilities. Make recommendations for technology adoption based on the organization’s goals and objectives.
• Performs other related duties as assigned.

• 4+ years of experience in data engineering with a focus on building scalable data solutions.
• Proficiency in Python.
• Experience with streaming data systems (e.g., Kafka) and with using databases such as Postgres, Elasticsearch, and Redis.
• Strong experience with data pipelines, ETL processes, and data warehousing.
• Strong background in developing end‑to‑end solutions in a production environment.
• Strong experience with data modeling, ETL processes, and data warehousing.
• Familiarity with containerization technologies (Docker, Kubernetes).
• Experience with CI/CD tools and practices. Experience with Codex or other agentic/AI‑assisted development tools is a plus.
• Experience with cloud platforms (e.g., AWS, Azure, GCP, Snowflake) is a plus.
• Excellent problem‑solving skills and a proactive approach to addressing challenges.
• Strong communication and interpersonal skills.
• Demonstrated curiosity and comfort using AI tools to enhance productivity and creativity.
• Ability to identify when and how to use AI responsibly while maintaining data privacy and accuracy.

The salary range is $180,000 - $200,000. We also offer equity in the form of stock options on top of that as the total compensation package.

• Competitive compensation and equity — rewarding you for your contributions and ownership mindset
• Remote‑first flexibility — work primarily from home within our list of approved states, with opportunities for in‑person collaboration
• Comprehensive health benefits for you and your family, including medical, dental, and…