Data Engineer

The Data Engineer role will be responsible for implementing and managing the business's data infrastructure to support operations and strategic initiatives. This position plays a crucial part in developing and maintaining a robust, scalable data architecture that ensures data integrity, security, and accessibility across the organization. A typical day involves designing and building ETL/ELT pipelines, collaborating with the Data Architect and business stakeholders, ensuring high data quality, and exploring opportunities for AI and automation.

Additionally, this role leverages new technologies to continually enhance the overall data ecosystem and support business growth.

Only applicants living in Southern California will be considered.

Design, build, and optimize ETL/ELT pipelines to ingest data from various sources into the data ecosystem.

• Implement processes and tools for data validation, cleaning, and quality assurance to maintain a reliable and accurate data foundation.
• Work closely with the Data Architect to design and implement a scalable and secure data infrastructure, including data lakes and data warehouses.
• Collaborate with business stakeholders to understand their data requirements and deliver solutions that enable data-driven decision-making.
• Utilize container technologies like Docker and Kubernetes to deploy scalable data services and machine learning environments.
• Implement and enforce data governance and security policies to ensure data privacy and compliance throughout the data lifecycle.
• Work with business users to assess opportunities and support AI automation with LLMs and agents.
• Stay current with emerging technologies and best practices in data engineering to continuously improve the data infrastructure.
• Strong programming skills in Python or a similar language.

Proficiency in SQL and experience with relational and non-relational databases.

Demonstrated experience in designing scalable, cost-effective, and maintainable data systems (e.g., data lakes, warehouses, lake houses).

Proven ability to automate and orchestrate complex data pipelines and create resilient, self-healing data systems.

Solid understanding of data governance principles and experience implementing data security best practices.

Experience translating ambiguous business requirements into precise technical specifications.

Experience with cloud platforms like AWS, Azure, or Google Cloud.

Familiarity with data processing frameworks such as Apache Spark and experience with a data lake environment.

Required:

• Bachelor's degree in Computer Science, Data Science, or a related field.

Desired: Master’s Degree in Data Science or equivalent.

• Proactivity/Initiative
  :
  Recognizes what needs to be done and accomplishes it in a manner appropriate for one's level/position and with minimal supervision.
• Perseverance
  :
  Shows wherewithal to fight for difficult goals despite challenges and to bounce back from adversity.
• Motivation/Dedication
  :
  Commits to excellence in pursuing unselfish goals. Initiates action with collective goals, takes responsibility, and shows personal humility.
• Technical Curiosity/Willingness to Learn
  :
  Interest in seeking out new experiences, knowledge, and candid feedback; demonstrating an openness to learning and change.
• Insight
  :
  The ability to gather and make sense of information that suggests new possibilities.
• Engagement
  :
  Shows a knack for using emotion and logic to communicate a persuasive vision and connect with people.
• People Skills
  :
  Is approachable and gains the mutual trust and respect of others. Understands people's strengths & weaknesses and actively seeks to understand other perspectives.
• Communication
  :
  Fosters open, honest, candid and respectful communication. Effectively assesses, defines and communicates issues in a timely manner, both written and verbal.
• Teamwork
  :
  The ability to effectively work toward common goals with others by supporting, encouraging, and sharing information in an authentic and approachable manner.
• Big Picture
  :
  Understands and contributes to the organizations' short- and long-term business strategy. On a personal level has independently…