Senior Data Engineer

Overview

Direct message the job poster from In Rhythm

InRhythm is a leading modern product consultancy and digital innovation firm with a mission to make a dent in the digital economy. Founded in 2002, InRhythm is currently engaged by Fortune 50 enterprises to bring their next generation of digital products and platforms to market. InRhythm has helped hundreds of teams launch mission-critical products that have created a positive impact worth billions of dollars.

The projects we work on change the world.

InRhythm’s unique capabilities of Product Innovation and Platform Modernization services are the most sought-after. The InRhythm team of A+ thought leaders don’t just “get a job,” they join the company to do what they love. It’s that passion that has helped us grow rapidly and consistently deliver on our commitment to helping clients develop better, faster, and in rhythm.

What We Do At InRhythm? We bring enterprises  most urgent, important products to market with high-velocity, high-quality and 10x impact. We enable innovative high-velocity cultures by coaching teams with the right mix and maturity of modern tools, methods, and thought leadership.

This is a unique opportunity to get in on the ground floor of an evolving team. InRhythm has a “who’s who” clients list and has barely scratched the surface in terms of providing those clients the digital solutions they need to compete. InRhythm clients include a broad range of highly visible and recognizable customers, including, but not limited to:

• Fidelity
• American Express

From greenfield to tier-one builds, our clients look to us to deliver their mission-critical projects in the fields of product strategy, design, cloud native applications, as well as mobile and web development. The projects we work on change the way we live, work, and think in a positive way.

• Advanced PySpark Optimization:
  Write complex business logic and optimize Spark jobs that are hitting performance ceilings.
• AWS Data Ecosystem (EMR & Glue):
  Production experience running Spark workloads on Amazon EMR and AWS Glue.
• Snowflake Architecture:
  Experience modeling and loading data into Snowflake (specifically internal mTw instance).
• Workflow Orchestration (Airflow):
  Proficiency in managing complex dependency chains and DAGs within Airflow.
• REST API Integration:
  Designing patterns for extracting data from various REST API sources reliably.
• Error Handling & Observability:
  Design and implement error handling frameworks to catch failures early and manage production incidents autonomously.

• Java Proficiency:
  While Python is the primary language, the underlying stack is Java-based. The ability to read/debug Java is a differentiator.
• Streaming Patterns (Kafka):
  Familiarity with Kafka for modern engineering environments.
• Consultative Mandate:
  We are looking for owners, not task-executors.
• High-Level Ownership:
  Ability to take vague outcomes and drive to completion without micro-management.
• Business Partner Communication:
  Direct interaction with business stakeholders to define logic for the Case Authorization project.
• Production Maturity:
  Code that survives production volumes and edge cases, not just passing unit tests.
• Outcome Over Tenure:
  Capability over years of experience; a bright engineer with fewer years may be preferred.

We’ve been named an Inc. 5000 Hall of Fame Fastest Growing Company for 9 years, Deloitte Fast 500 company for 5 years, and Consulting Magazine Fastest Growing Company winner several years in a row. If you’re looking forward to working with awesome colleagues in a high-growth environment and tight-knit community, we’re looking forward to hearing from you.

At InRhythm we believe in building a better workplace. When you join our team, you can expect a number of work/life benefits:

• Comprehensive and customizable Medical, Dental, and Vision Plans
• 401(k) + Matching
• Scalable PTO
• Udemy subscription for continuous learning
• Reimbursements for personalized birthday experiences
• Media Streaming, Book, and Fitness Allowances

• Mid-Senior level

• Full-time

• Information Technology
• Industries: IT Services and IT Consulting

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.