Senior Manager, Platform Software Engineering

Job Description

Champions cross-team efforts to build data infrastructure to optimize data processing from a variety of data sources. Oversees the implementation of data governance policies and procedures for data handling to manage data consistency, integrity, accuracy, and reliability. Coordinates cross-team efforts to implement rigorous data validation and integrity checks, anticipating and proactively mitigating data quality issues. Oversees the implementation of data storage solutions to store the processed data to be used in a scalable, optimized, and efficient way for access and analysis.

Champions cross-team collaboration in an agile development environment to develop, maintain, and debug data solutions that are scalable, efficient, cost effective, and reliable.

Responsibilities

Key Responsibilities

Data Processing & Pipelining - Data Requirements, Collection, and Infrastructure:

• Proactively identifies data requirements and business objectives of business critical and/or complex projects and/or initiatives.
• Champions cross-team efforts to build data infrastructure to optimize data processing from a variety of data sources.
• Oversees cross-team collaboration to analyze, design, and troubleshoot data flows based on business needs, identifying interdependencies across teams.
• Prioritizes work streams with other teams and product management.
• Holds accountability for the quality and availability of the service.
• Coordinates cross-team efforts to develop data collection processes that involve indexing and query optimizations for optimal performance.

Data Processing & Pipelining - Data Governance:

• Oversees the implementations of data governance policies and procedures for data handling (e.g., data retention) to ensure data consistency, integrity, accuracy, and reliability throughout the data lifecycle.
• Leads the redaction processes for Personally Identifiable Information (PII) and Protected Health Information (PHI) data, ensuring compliance with data privacy and security standards.
• Ensures cross-team data compliance with relevant laws, regulations, and industry standards.

Data Processing & Pipelining - Data Validation & Quality Assurance:

• Supports cross-team efforts to implement rigorous data validation and integrity checks, anticipating and proactively mitigating data quality issues that could impact data pipeline and model performance.
• Coordinates cross-team efforts to establish and drive organizational knowledge of data annotation and labeling processes to ensure data quality, leveraging best practices.
• Supports cross-functional team understanding of and adherence to data security measures to protect data from unauthorized access, use, disclosure, alteration, or destruction.
• Leads multiple teams in proactively identifying and resolving data quality and infrastructure issues.

Data Pipeline and Solutions Engineering - Pipeline Design:

• Champions cross-team efforts to design, develop and optimize automated, scalable, and efficient data pipeline architectures using Extract, Transform, and Load (ETL) processes to build reusable data products.
• Oversees team to implement data storage solutions to store the processed data to be used in a scalable, optimized, and efficient way for access and analysis.
• Coordinates team efforts to manage the flow of data pipeline and storage day-to-day operations.

Data Pipeline and Solutions Engineering - Data Solutions Engineering:

• Champions cross-team collaboration in an agile development environment to develop, maintain, and debug data solutions that are scalable, efficient, cost effective, and reliable.
• Coordinates team efforts to write runnable code and automation tests and perform testing and debugging of data solutions.
• Drives the evaluation and adoption of new technologies by aligning efforts across teams with broader data platform strategies.
• Enforces adherence to coding standards and engineering best practices across teams, fostering a culture of technical excellence and continuous improvement through coaching and regular reviews.
• Oversees the development of documentation, ensuring clear design decisions and collaboration with architecture and cross-functional stakeholders.

Core Responsibilities

Planning & Execution:

• Manages multiple medium- to large-scale projects or initiatives across teams, ensuring timelines, deliverables, and budgets when applicable are monitored and met.
• Provides direction to teams on project work, setting priorities, and aligning with business needs.
• Guides teams on adjusting plans to accommodate resource or timeline changes.

Collaboration & Partnership:

• Drives cross-functional partnerships to align expectations and shared objectives across multiple teams.
• Coaches team members to develop strategic relationships with business leaders, stakeholders, and external partners to foster collaboration and long-term success.
• Promotes inclusivity by actively seeking and listening to diverse perspectives, ensuring others feel heard and respected.

Problem Solving:

• Provides direction to multiple teams…