Senior Data & Analytics Platform Architect – AWS & Databricks Lakehouse

Solution Architect
· Data Science / Data Engineering

The Role

Cogniify is hiring a Senior Data & Analytics Platform Architect to help design and build our cloud-based data and analytics platform on AWS and Databricks. This role defines and designs the platform, including lakehousearchitecture, cloud automation tools and standards, CI/CD pipelines, Dev Ops tooling and AWS account provisioning automation, and works with application support teams on how platform products interface with application installation and configuration.

You will lead large, complex initiatives, refine end-to-end development processes across CI/CD, security scanning and production monitoring, and act as the go-to technical expert on new technology direction.

You will advise management on technical research, mentor engineers and trackindustry trends to plan for future platform needs. This is an individual contributor role.

What You Will Do

• Translate overall direction into plansfor the data and analytics platform, working toward long-range goals with aclear understanding of key business processes.
• Define and design the cloud platform,including cloud automation tools and standards, CI/CD pipelines, Dev Ops tooling and AWS account provisioning automation.
• Lead large, complex projects and major initiatives, setting direction for others and taking many assignments on yourown initiative.
• Refine end-to-end development processes,including CI/CD, security scanning and production monitoring.
• Solve unusually complex technical problems and act as the go-to technical expert on new technology direction.
• Communicate across all organizational levels, including influencing executives when needed, and serve as thespokesperson for advanced platform projects.
• Advise management and business stakeholders on technical research, and coordinate with senior external contacts on significant technical matters.
• Oversee documentation of infrastructure and work instructions for systems and applications.
• Develop approaches to prevent futureincidents, make sure work delivers long-term value, and make decisions onaccess, permissions and security controls.
• Serve as the subject matter expert for general engineering and platform strategy, mentor engineers and track industry trends to plan for future platform needs.

What We Are Looking For

• 11+ years of related experience (9+years with a Master’s degree).
• At least 10 years of experience in cloud infrastructure and/or enterprise data platforms in a highly available production environment.
• Bachelor’s degree in a relevant field,or an equivalent combination of education and experience. A relevant technical certification may be required.
• Advanced knowledge of AWS, especially data storage, data processing, analytics, security and compute services.
• Advanced knowledge of infrastructure ascode, especially Terraform.
• Strong knowledge of Databricks,lakehouse architecture, governance, metadata and data quality.
• Strong working knowledge of Python, SQL,Spark and dbt.
• Intermediate knowledge of cloud and infrastructure automation, and of CI/CD practices.

Preferred Experience

• Proven experience with lakehousearchitectures on AWS data services (Glue, Lake Formation, Redshift, Athena) and Databricks.
• Expertise in dbt, Python, Spark SQL andSQL.
• Knowledge of AWS services, includingIAM.
• Experience with Apache Spark, AWS Glue,Databricks, Apache Iceberg and Delta tables.
• Professional AWS and Databricks certifications.
• Experience in regulated environments,including SOX- and FDA-regulated settings.

Perksand Benefits of Working With Us

• Unlimited PTO and generous parental leave.
• Medical, dental and vision coverage.
• Access to disability and life insurance.
• Mental health and wellbeing support.
• Employer Stock Purchase Program (ESPP).
• Yearly team-building experiences.
• Mentorship and sponsorship opportunities.
• Manager resources and support.
• Small, dynamic teams with opportunities to make an impact.
• Open communication with management andcompany leadership.
• An entrepreneurial culture that encourages initiative and new ideas.

We are an equal opportunity employer.

We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration without regard to race, color, religion, sex, sexual orientation, gender identity,national origin, disability, veteran status or any other protected characteristic.