Senior Data Engineer

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.
If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!
**** About Quantiphi:
**** Quantiphi is an award-winning Applied AI and Big Data software and services company, driven by a deep desire to solve transformational problems at the heart of businesses. Our signature approach combines groundbreaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at unprecedented speed.

Quantiphi has seen 2.5x growth YoY since its inception in 2013, we don’t just innovate - we lead. Headquartered in Boston, with 4,000+ Quantiphi professionals across the globe. As an Elite/Premier Partner for Google Cloud, AWS, NVIDIA, Snowflake, and others, we’ve been recognized with:

Be part of a trailblazing team that’s shaping the future of AI, ML, and cloud innovation. Your next big opportunity starts here!

For more details, visit: or.

Atlanta, GA (Preferred)/ Anywhere in USA or Canada
*
* About the Role:

** As a Senior Data Engineer, you will play a key role in designing, building, and maintaining scalable data pipelines that power analytics, insights, and business decision-making. You will work across both batch and streaming architectures, leveraging PySpark, SQL, and modern data engineering frameworks to deliver reliable, high-performance data solutions.
** What Success Look Like:
*** Design, develop, and maintain scalable batch and streaming data pipelines using PySpark, SQL, and modern data engineering frameworks.
* Perform deep-dive analysis into complex source systems to define extraction patterns, transformation logic, and integration workflows.
* Implement data models optimized for analytics, performance, and operational excellence.
* Build and manage data systems across AWS or GCP cloud environments, ensuring reliability, scalability, and cost efficiency.
* Lead and participate in design reviews, provide mentorship to junior engineers, and take ownership of code quality and engineering best practices.
* Collaborate with cross-functional teams including architects, analysts, product, and platform engineers to deliver high-quality data solutions.
* Troubleshoot performance bottlenecks, optimize data processing workflows, and improve pipeline robustness.
** Essential Skills/

Qualifications:

*** 8+ years of experience in data engineering or a related field.
* Strong expertise in PySpark, SQL, and data modeling for high-volume datasets.
* Hands-on experience building and optimizing data pipelines in AWS or GCP environments.
* Track record of working with complex source systems and developing accurate extraction and transformation logic.
* Proven experience in mentoring engineers, performing code reviews, and leading technical design discussions.
* Solid understanding of distributed computing, data partitioning, and performance tuning.
** Nice to haves:
*** Expert-level knowledge of Azure and Databricks architecture, including Lakehouse patterns and the Medallion Framework.
* Familiarity with Delta Lake, orchestration tools, or Unity Catalog.
* Experience with CI/CD for data pipelines and automated testing frameworks.
*
* What We Offer:

*** Join a high-growth, AI-first digital engineering and transformation company
* Work with Fortune 500 clients and cutting-edge market disruptors
* Collaborate with a talented, dynamic, and driven team
* Gain exposure to the latest technologies in AI, ML, cloud, and data engineering
* If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us**!
** 17x Google Cloud Partner of the Year awards in the last 8 years.
* 3x AWS AI/ML award wins.
* 3x NVIDIA Partner of the Year titles.
* 2x Snowflake Partner of the Year awards.
* We have also garnered top analyst recognitions from Gartner, ISG, and Everest Group.
* We offer first-in-class industry solutions across Healthcare, Financial Services, Consumer Goods, Manufacturing, and more, powered by cutting-edge Generative AI and Agentic AI accelerators.
* We have been certified as a Great Place to Work for the third year in a row- 2021, 2022, 2023.8+ years of experience  
** Experience Level:
***
* Work Location:

** Thank you for your interest in Quantiphi!
We are a team that dreams together and collaborates to ensure success.  We are currently looking for exceptional individuals who can join us and contribute to a fun, diverse and hybrid work culture. As a part of the Quantiphi family, you will get ample opportunities to learn, grow and interact with colleagues from varied experience and backgrounds around the globe.
If this excites you, explore our current openings and apply to any job roles that suit and interest you.
#J-18808-Ljbffr