AWS​/Databricks Cloud Data Engineer

About Moser

For more than 25 years we have formed partnerships and grown through open and honest collaboration with our clients, partners, and employees. We are best known for taking great care of our clients, our dedication to creating a work environment where employees do their best work, and our deep commitment to continuous improvement. Our consultants work in a collaborative and fast-paced environment, are self-motivated, and are passionate about evolving technology.

It is no accident that we are recognized as one of the Best Places to Work in Indiana for 10 consecutive years.

Internally, we believe in building strong teams from the top down with a focus on values in our Model-Coach-Care philosophy. Our leadership are encouraged and trained to model good practices, mentor other employees and each other, and show empathy and caring in all interactions. This is the base of our core values:
Accountability, Balance, Collaboration, Focus, Integrity, Social Responsibility, Support and Transparency.

Moser Consulting believes in equal opportunity for all people and is committed to enabling a diverse, equitable, and inclusive culture. We foster a spirit of unity that respects the remarkable individuality of everyone's culture, history, and service.

We are seeking a Senior Cloud Data Engineer to join our consulting team. In this role, you will design, build, and maintain scalable data pipelines and acquisition workflows across cloud and on-premises environments, contributing to the full spectrum of data engineering – from ingestion through transformation and delivery. You will collaborate with cross-functional teams to translate business requirements into robust data solutions, while upholding best practices in architecture, cloud infrastructure, documentation, and continuous improvement.

• Participate in team stand-ups and other agile ceremonies to support project delivery
• Assist in building and maintaining data acquisition pipelines from diverse sources including databases, flat-files, and REST APIs
• Leverage development design patterns and best practices across workloads.
• Support data modeling efforts including dimensional models and semantic layers for analytics under senior guidance
• Proactively troubleshoot and resolve pipeline failures, query performance issues, data quality concerns, notebook timeouts, data model consistencies, semantic model refresh errors, and capacity throttling using monitoring tools and query optimization techniques
• Participate in requirement gathering meetings and translate business needs into technical specifications
• Engage in ongoing learning through online trainings, certifications, and mentorship opportunities
• Create and maintain technical documentation, operational documentation, data flow diagrams, and data mapping documents
• Collaborate effectively with cross-functional teams and communicate progress to technical and non-technical stakeholders

• Experience with dimensional modeling, SCDs, and medallion architecture
• Previous cloud experience required; AWS preferred with hands-on exposure to Lambda, S3, and Docker
• Knowledge of Azure Active Directory group management and role-based access control (RBAC)
• Strong Python experience across pipeline development, ETL, and data engineering tasks, with exposure to complex datasets from disparate batch and streaming sources and an emphasis on low latency, high throughput, and cost-efficiency; pandas experience a plu
• Leveraging SQL and python data tooling develop scalable, optimized ETL/ELT pipelines to ingest, transform, and load large, complex datasets from disparate sources (batch and streaming). Streamlining for low latency, high throughput and cost-efficiency.
• Experience with API development in both consumer and producer capacities (REST APIs)
• CI/CD experience with modern Dev Ops tooling and deployment pipelines
• Demonstrated ability to learn new technologies quickly and apply them to solve problems
• Strong attention to detail and commitment to producing high-quality work
• Excellent oral and written communication skills
• Professionalism and ethics including trust, positive attitude, commitment, honesty,…