Engineer, Data Engineering

Overview

Primary Skill:
Data Engineering, Platform Engineering or architecture roles. Deep Expertise in Pyspark.

Experience:

10+ yrs

Bachelor’s or master’s degree in computer science or related field.

• Deep Expertise in PySpark, including performance tuning and optimization
• Solid knowledge of Hadoop ecosystem (HDFS, Hive/Impala, YARN)
• Proven experience designing and governing enterprise, regulatory facing data platforms
• Expertise in designing data lakes, ELT/ETL pipelines, batch and real‑time data processing solutions
• Proficiency in programming languages such as Java, Scala and SQL
• Strong understanding of non‑functional requirements and production support models
• Clear written and verbal communication skills with ability to influence across organizations
• Financial services experience, particularly in Market Surveillance, AML, Fraud, or Risk Technology
• Experience supporting regulatory or audit facing platforms
• Kafka and Spark Structured streaming exposure
• Familiarity with orchestration tools (Airflow, Control‑M, Oozie)
• Knowledge of data governance, lineage, and data quality controls

• Enterprise & Surveillance Architecture:
  Define target state architecture and strategic roadmap for surveillance data processing platforms leveraging Hadoop, Spark, PySpark and Python.
• Establish standard architectural patterns for alert generation, enrichment, aggregation, and reporting pipelines.
• Ensure architecture aligns with enterprise technology standards and Surveillance control expectations.
• Solution Design and Delivery Support:
  Translate surveillance business requirements (e.g., market misconduct detection, regulatory coverage) into scalable technical designs.
• Review and approve detailed technical designs, ensuring alignment with functional intent, regulatory requirements, and architectural standards.
• Provide hands‑on architectural guidance to engineering teams during development, testing and implementation.
• Design and standardize Spark/PySpark frameworks supporting surveillance alert generation and enrichment.
• Modernize and optimize large‑scale Hadoop surveillance workloads to improve performance, stability and control coverage.
• Implement enterprise‑consistent architecture patterns enabling audit readiness, lineage, and regulatory traceability.
• Support end‑to‑end delivery across the SDLC, minimizing rework and technical debt.
• Architecture Governance & Leadership:
  Participate in and lead architecture review forums and design walkthroughs.
• Mentor senior engineers and promote adoption of standard frameworks and best practices.
• Influence enterprise surveillance platform strategy through architecture governance.
• Maintain high‑quality documentation, including business requirement, data definitions, and process flows.
• Proactively communicate risks, dependencies and potential timeline impact to stakeholders.

• Discretionary Annual Incentive
• Comprehensive Medical Coverage:
  Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans
• Family Support:
  Maternal & Parental Leaves
• Insurance Options:
  Auto & Home Insurance, Identity Theft Protection
• Convenience & Professional Growth:
  Commuter Benefits & Certification & Training Reimbursement
• Time Off:
  Vacation, Time Off, Sick Leave & Holidays
• Legal & Financial Assistance:
  Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing

Location:

Addison, TX

Salary Range: $110,000–$130,000 a year