Lead Data Engineer

Job Description

Responsible for working on big data compilation projects that gather and integrate voluminous enterprise data, perform validation and analysis, develop and implement dataset performance optimization guidelines. This role is crucial in maintaining and improving dataset integrity, ensuring regulatory compliance, and improving operational efficiency.

• Develop and maintain data pipelines to ingest, process, and store financial data from internal and external sources.
• Integrate structured and unstructured data from multiple systems such as accounting software, trading platforms, financial databases, and market feeds.
• Build and optimize relational and non-relational databases (SQL, No
  
  SQL) to store financial data.
• Ensure efficient querying and retrieval of financial data to support reporting and analytics.
• Implement data quality checks to ensure accuracy, consistency, and completeness.
• Establish and enforce data governance policies to ensure compliance with financial regulations such as GDPR, SOX.
• Work with data scientists, financial analysts, and business intelligence teams to understand data needs and ensure accessibility.
• Collaborate with software engineers and IT teams for seamless integration with business systems.
• Automate repetitive data processing tasks to improve operational efficiency.
• Continuously monitor and improve performance of data pipelines and systems.
• Provide financial data to support generation of reports, dashboards, and visualizations.
• Ensure data is structured for effective analysis and decision‑making.
• Maintain high security and privacy standards for all financial data.
• Implement appropriate access controls to sensitive information.
• Troubleshoot issues related to pipelines, databases, and data integrity.
• Provide support for resolving data‑related issues in financial applications or reporting systems.
• Manage the design, development, maintenance, safety and integrity of databases.
• Conduct audits, initiate preventive and corrective actions.
• Coordinate and facilitate the design, implementation, and control of data management concepts and techniques.
• Approve and maintain analysis and development policies, standards, and procedures.
• Analyze short‑ and long‑term requirements for database administration.
• Allocate database resources to ensure project timelines and budgets are met.
• Work with vendors to analyze, recommend, and purchase database tools, products, and services.

• Bachelor's degree or equivalent work experience.
• At least 7 years of experience with tools, facilities, and techniques for managing and administering data.
• Proficiency in programming languages such as Python, SQL, or Scala.

• Application development tools and information management.
• Data warehousing and data movement tools.
• Strong experience with on‑prem and cloud data warehouse solutions (Snowflake, Amazon Redshift, RDS, Oracle, MS SQL).
• Familiarity with data pipeline tools such as Apache Kafka, Airflow, and ETL frameworks.
• Knowledge of cloud technologies (AWS, Azure, Google Cloud).
• Relational databases and dataset architecture design best practices.
• Application delivery process in IT environments.

Mid‑Senior level, Full‑time, Information Technology, Banking.

• Healthcare (medical, dental, vision)
• Basic and optional term life insurance
• Short‑term and long‑term disability
• Pregnancy disability and parental leave
• 401(k) and employer‑funded retirement plan
• Paid vacation (2‑5 weeks depending on salary grade and tenure)
• Up to 11 paid holiday opportunities
• Adoption assistance
• Sick and Safe Leave accruals of one hour for every 30 worked, up to 80 hours per calendar year

U.S. Bank is an equal opportunity employer. We consider all qualified applicants without regard to race, religion, color, sex, national origin, age, sexual orientation, gender identity, disability, veteran status, and other factors protected under applicable law.

If there’s anything we can do to accommodate a disability during any portion of the application or hiring process, please refer to our disability accommodations for applicants.

Posting may be closed earlier due to high volume of applicants.