×
Register Here to Apply for Jobs or Post Jobs. X

Senior AI & Data Engineer

Job in Palo Alto, Santa Clara County, California, 94306, USA
Listing for: Intapp
Full Time position
Listed on 2026-02-16
Job specializations:
  • IT/Tech
    Data Engineer, Cloud Computing
Salary/Wage Range or Industry Benchmark: 60000 - 80000 USD Yearly USD 60000.00 80000.00 YEAR
Job Description & How to Apply Below

Position Summary

We are seeking a Senior Data Engineer to design, build, and optimize scalable data infrastructure that powers business intelligence, analytics, and AI-driven applications. The ideal candidate brings great communication skills, deep expertise in Python, containerization, cloud-native architectures, and modern data warehousing, with a growing interest in AI agents and emerging integration patterns.

What you will do Data Infrastructure & Pipeline Development
  • Design and implement robust, scalable ETL/ELT pipelines to ingest, transform, and deliver data across the organization

  • Build and maintain data models optimized for analytical workloads and downstream consumption

  • Develop reusable frameworks and libraries to accelerate data engineering workflows

Cloud & Platform Engineering
  • Architect and manage cloud-native data solutions on AWS, leveraging services such as S3, EC2, ECS, ECR and Event Bridge

  • Deploy and orchestrate containerized workloads using Docker and Kubernetes in production environments

  • Implement infrastructure-as-code practices using Terraform Cloud Formation, or similar tools

    /li
Data Warehousing
  • Design and optimize data warehouse architectures using Redshift or Snowflake

  • Develop efficient data models, partitioning strategies, and query optimization techniques

  • Manage data lifecycle, governance, and cost optimization within warehouse environments

Emerging Technologies
  • Explore and integrate AI agents and Model Context Protocol (MCP) patterns into data workflows where applicable

  • Collaborate with AI/ML teams to ensure data infrastructure supports model training, inference, and feature engineering needs

  • Stay current with emerging data and AI technologies, evaluating their potential business impact

Collaboration & Leadership
  • Partner with analytics, product, and engineering teams to understand data requirements and deliver solutions

  • Mentor junior engineers and contribute to team best practices, code reviews, and technical documentation

  • Participate in architectural decisions and contribute to the data platform roadmap

What you will need Experience
  • 7+ years of professional experience in data engineering or related roles

  • Proven track record building and operating production data pipelines at scale

Technical Skills
  • Python: Advanced proficiency including data libraries (pandas, PySpark, SQL Alchemy), testing frameworks, and packaging

  • Containerization & Orchestration: Strong hands‑on experience with Docker and Kubernetes (EKS, GKE, or self‑managed clusters)

  • Data Warehousing: Deep expertise with Redshift or Snowflake, including performance tuning, data modeling, and administration including DBT

  • AWS: Extensive experience across the AWS ecosystem, particularly data‑related services (S3, Glue, Lambda, IAM, VPC, Cloud Watch)

  • SQL: Expert‑level SQL skills for complex analytical queries and data transformations

Foundational Skills
  • Experience with workflow orchestration tools (Airflow, Dagster, etc.)

  • Familiarity with version control (Git), CI/CD pipelines, and agile development practices

  • Strong understanding of data governance, security, and compliance principles

Preferred Qualifications
  • Experience with or exposure to AI agents, LLM integrations, or Model Context Protocol (MCP) implementations

  • Background in real‑time streaming architectures (Kafka, Kinesis, Flink)

  • Experience with dbt for transformation layer management

  • Familiarity with data observability and quality tools (Monte Carlo, Great Expectations, dbt tests)

  • Knowledge of additional programming languages (Scala, Java, Go)

  • Experience in professional services, legal tech, or enterprise SaaS environments

Education
  • Bachelor's degree in Computer Science, Engineering, Mathematics, or related field; or equivalent practical experience

  • Relevant certifications a plus (AWS Data Analytics, Snowflake Snow Pro, Kubernetes CKA/CKAD)

What you will gain
  • Expand Your

    Skills:

    Unlock your potential with professional development opportunities supported by a community of experienced professionals. We offer reimbursement for training and continuing education to help you stay ahead in your career.

  • Enjoy Where You Work: Thrive in our modern, open offices designed to inspire creativity and collaboration.…

Position Requirements
10+ Years work experience
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
 
 
 
Search for further Jobs Here:
(Try combinations for better Results! Or enter less keywords for broader Results)
Location
Increase/decrease your Search Radius (miles)

Job Posting Language
Employment Category
Education (minimum level)
Filters
Education Level
Experience Level (years)
Posted in last:
Salary