Senior Java Engineer Data Engineering

About SPAN Digital

We're a premium software consulting company with offices in San Francisco, Cape Town, and Guadalajara. We partner with startups to global brands in tech, fintech, and digital media, building category-defining products and helping engineering teams deliver exceptional digital solutions.

At SPAN, we balance structure with flexibility, autonomy with accountability, and learning with doing. It's not about grinding, it's about thriving.

We are seeking a Senior Java Engineer with Data Engineering expertise to join our expert team focused on executing critical enterprise data retention, migration, and privacy enhancement projects. This role combines robust software engineering capabilities with technical leadership skills to deliver production-quality solutions at petabyte scale.

As a Senior Engineer, you will design and deliver robust software solutions while providing technical leadership to engineering teams. You'll combine strong technical capabilities with emerging leadership skills to build production-quality systems that meet our clients' business requirements.

Experience Level:8+ years in data engineering/software engineering with 4-7 years technical leadership

• Design and implement large-scale data migration strategies for identity transformation across multi-petabyte datasets

• Build comprehensive data lineage mapping and validation systemsto ensure migration accuracy and data integrity

• Develop scalable data transformation solutions supporting both batch and streaming processing with parallel pipeline orchestration

• Implement advanced monitoring and observability solutions for data pipeline performance and system health tracking

• Create testing and validation frameworksto ensure data accuracy and consistency during complex migrations

• Provide technical leadership for data migration initiatives, taking responsibility for critical system components and project phases

• Mentor engineers through pair programming, code reviews, and collaborative data pipeline development

• Lead technical design discussionsfor complex data migrations and create solutions meeting enterprise requirements

• Demonstrate deep expertise in data engineering lifecycle management, from migration planning through deployment and operational support

• Drive technical work forwardby identifying and removing blockers, enabling continuous delivery of value

• Collaborate effectively with stakeholders across disciplines, ensuring alignment and successful project outcomes

• Minimum 8 years of experience in data engineering or related engineering role

• Bachelor's or Master's degreeorequivalent experience in Computer Science, Engineering, or related field

• Proven expertise in large-scale data migration and ETL pipeline development

• Advanced proficiency in Java programming language with modern build systems (Gradle or Maven)

• Expertise in distributed file systems (HDFS) or cloud object storage (S3, GCS)

• Experience with cloud data platforms(AWS, GCP, Azure, or Databricks)

• Hands-on experience with AWS EKS (Kubernetes) for containerized data processing environments

• Understanding of data privacy, security, and compliance requirements (GDPR experience preferred)

• Strong knowledgeof data structures, algorithms, and distributed systems design principles

• Experience with Scala or Pythonfor data processing applications

• Experience with Apache Sparkor PySparkfor large-scale data processing and analytics

• Experience with Hadoop ecosystem including
  
  HDFS, Map Reduce, and related tools

• Experience working in enterprise engineering environments with large-scale tools and development processes

• Experience with data lineage analysis, dependency mapping, and data validation frameworks

• Identity management experience in large-scale distributed systems

• Experience with modern data formatslike Apache Iceberg, Parquet, ORC, or Avro

• Proficiency in streaming platforms like Apache Kafka or AWS Kinesis

• Hands-on experience with observability tools(Prometheus, Grafana, Spark UI)

• Opportunity to work on cutting-edge data engineering projectsat petabyte scale

• Technical leadership opportunities with mentorship responsibilities

• Collaborative work environment focused on continuous learning and growth

• Exposure to enterprise clientsin entertainment, technology, and medical industries

• Professional development opportunities with clear career progression paths

• Flexible hybrid work arrangementsacross our global offices, with 2 days in-office per week

• Competitive compensation and benefits package

• Access to latest technologies and toolsin data engineering and cloud platforms

If you're passionate about large-scale data engineering, technical leadership, and delivering world-class solutions, we'd love to hear from you. Join SPAN Digital and help shape the future of data processing at enterprise scale.

SPAN Digital is an equal…