Software Engineer II - Data Engineer
Listed on 2025-12-21
-
IT/Tech
Data Engineer, Data Analyst
Software Engineer II - Data Engineer
The Trade Desk is a global technology company focused on creating a better, more open internet to enable advertisers worldwide.
Responsibilities- Data Pipeline Development:
Design, build, and optimize scalable ETL/ELT pipelines for both batch and real-time data processing from disparate sources. - Infrastructure Management:
Assist in the design and implementation of data storage solutions, including data warehouses and data lakes (e.g., Snowflake, S3, Spark), ensuring they are optimized for performance and cost efficiency. - Data Quality and Governance:
Implement data quality checks, monitor pipeline performance, and troubleshoot issues to ensure data accuracy, reliability, and security, adhering to compliance standards such as GDPR and CCPA. - Collaboration:
Work closely with product managers, data scientists, business intelligence analysts, and other engineers to understand data requirements and deliver robust solutions. - Automation and Optimization:
Automate data engineering workflows using orchestration tools such as Apache Airflow, Dagster, and Azure Data Factory, and implement internal process improvements for greater scalability. - Mentorship:
Participate in code reviews and provide guidance or mentorship to junior team members on best practices and technical skills. - Documentation:
Produce comprehensive and usable documentation for datasets, data models, and pipelines to ensure transparency and knowledge sharing across teams.
- Bachelor’s degree in computer science, information security, or a related field, or equivalent work experience;
Master’s preferred. - 4+ years of experience in a Data Engineering role with a broad understanding of Data Modeling, SQL, OLAP, and ETL.
- Experience designing and implementing data and analytics solutions using Snowflake, Databricks, Vertica, SQL Server, and MySQL.
- Proficiency in SQL and at least one other programming language (PL/SQL, Python, C#, Scala, or Java).
- Experience with workflow technologies such as Spark, Airflow, Glue, Prefect, or Dagster.
- Experience with version control systems, specifically Git.
- Familiarity with Dev Ops best practices and automation of processes such as build, configuration, deployment, documentation, testing, and monitoring.
- Understanding of BI and reporting platforms and industry trends.
- AdTech industry knowledge preferred.
- Experience with containerization tools like Docker and Kubernetes preferred.
- Familiarity with data modeling and data warehousing concepts.
- Basic understanding of machine learning concepts.
- Strong analytical and problem‑solving skills with attention to detail.
- Excellent communication and collaboration skills.
- A proactive and continuous learning mindset.
Base salary range: $103,200—$189,200 USD. The role includes comprehensive benefits such as medical, dental, vision insurance, 401(k) with company match, short and long‑term disability coverage, life insurance, tuition reimbursement, parental leave, sick time, vacation, paid holidays, and access to the company stock purchase plan.
Equal OpportunityThe Trade Desk is an equal opportunity employer. All aspects of employment are based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, disability, gender identity or expression, sexual orientation, veteran status, or any other status protected under federal, state, or local law.
AccommodationsPlease reach out to ac to request an accommodation or discuss any accessibility needs you may require.
#J-18808-Ljbffr(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).