Senior Data Engineer

Overview

Ingram Content Group (ICG) is currently seeking a Senior Data Engineer to join our team in LaVergne, TN (Greater Nashville area). This person will design, build, and optimize the systems that allow our data to be gathered, ingested, stored, analyzed, transformed, and distributed. You will be responsible for the entire lifecycle of data pipelines, from ingestion to the creation of Operational Data Stores (ODS).

The Senior Data Engineer acts as the senior/lead technical programmer in the team, owns the solution stack, and has an appetite for problem solving. Delivers results through independent contributions and mentoring of junior engineers. Works with the data architect, CI/CD architects, and other data engineers to build and deliver world-class data platforms. This position will be hybrid and work from the Ingram headquarters 4 days per week.

Want to help explore and build new ways to deliver content to the world?

At Ingram, our Technology team is blazing a trail by providing content distribution services to thousands of publishers with key initiatives around business intelligence, machine learning, continuous integration and omnichannel. We support diverse people and technology that highlights innovation through SaaS platforms, metadata, cloud, and containerization. Our teams are agile, and emphasize authenticity, creativity, and transparency upon a fact-based foundation.

The world is reading, and it is our goal to connect as many people as possible to the content they want in the simplest ways. If you are an IT professional who strives to deliver results through collaborative partnerships, understanding what drives business, and enjoys working in a connected culture, we can't wait to meet you!

The ideal candidate will have the following minimum qualifications:

• Education:
  
  Bachelor
  20 9s or master
  20 9s degree in computer science, Computer Engineering, IT, or a closely related technical field.
• 6+ years of professional experience in data engineering or a similar data-intensive role.
• Core
  
  Languages:
  
  Expert-level proficiency in SQL and Python.
• Databases:
  Deep experience with MySQL and at least one major No
  
  SQL provider (e.g., Mongo
  
  DB, Cassandra).
• Integration:
  Hands-on experience creating and deploying SSIS Packages.
• Streaming:
  Proven experience using Apache Kafka for event-driven architecture.
• Concepts:
  Strong understanding of data modeling, schema design, and distributed systems.

We have a preference for:

• Technical expertise in a core technology area Data and Software engineering
• Knowledge of external technologies within domain of expertise
• Knowledge of all phases of applications systems analysis and programming
• Knowledge of Development Tools with demonstrated expert experience in:
  Python, data manipulation packages of Python
• Working knowledge of client-server architectures and RESTFul APIs
• Knowledge of software collaboration platforms like Git Hub, Azure Dev Ops, and JIRA
• Ability to communicate effectively across the organization and with leadership
• Ability to apply new knowledge, technology, and procedure to job responsibilities
• Ability to be flexible/multi-task based on workflow demands

• Pipeline Development:
  Design and implement robust ETL/ELT data pipelines using Apache Kafka for streaming and batch processing.
• Database Management:
  Architect and maintain both Relational (MySQL, SQL Server) and Non-relational (No
  
  SQL) database environments to ensure high performance and scalability.
• SQL server related:
  Transact-SQL, ETL and Data warehousing, SQL server management studio, maintaining and optimizing stored procedures, maintaining and monitoring background jobs.
• ODS Architecture:
  Build and manage Operational Data Stores to integrate data from disparate sources for real-time and batched operational reporting.
• Data Handling:
  Write complex, optimized SQL queries, develop Python scripts using libraries like Pandas, Num Py, and PySpark, and integrate Kafka for sophisticated data transfer, manipulation and cleansing.
• System Optimization:
  Monitor and tune database performance, ensuring data integrity and security across all platforms.
• Lead and execute testing to ensure data validation and data integrity.
• Drives solutions and guides the work of others to provide full application development life cycle support including specifications, prototypes, development, quality assurance, and deployment.
• Works with user/customer community, business analysts, and architects to capture system requirements and design.
• Leverages a technical network to collaborate across the organization s units.

Salary Range: $110,981 - $141,123. This range represents the anticipated low and high end of the salary for this position. It will be determined by factors including but not limited to the applicant
20 9s education, experience, knowledge, skills, and abilities, geographic location, as well as internal equity and alignment with market data.

• A highly competitive compensation package with…