Python Developer

Overview

Born digital, UST transforms lives through the power of technology. We walk alongside our clients and partners, embedding innovation and agility into everything they do. We help them create transformative experiences and human-centered solutions for a better world.

Python Developer —
Lead I - Software Engineering

UST is seeking a Python developer with solid Python fundamentals and strong hands-on expertise in PySpark for building scalable data processing pipelines on AWS.

• Design, build, and optimize PySpark-based data pipelines (batch & streaming) on AWS.
• Tune Spark jobs for performance, reliability, and cost efficiency; monitor using Spark UI/Cloud Watch.
• Collaborate with platform, data, and application teams to integrate pipelines with Glue/EMR/Lambda/Step Functions.
• Establish CI/CD for data workflows and ensure test coverage and deployment automation.
• Contribute to coding standards, documentation, and Agile ceremonies.

This position description identifies the responsibilities and tasks typically associated with the performance of the position. Other relevant essential functions may be required.

• 4+ years of professional experience in software development with a strong focus on Python.
• Solid understanding of core Python concepts, data structures, algorithms, and design patterns.
• Proficiency in Python for scripting, automation, backend services, and data-processing workflows.
• Data modeling for analytics (medallion architecture: bronze/silver/gold), Parquet/Avro/JSON best practices.
• Hands-on expertise with PySpark, including:
  • Working with Data Frames/Datasets and Spark SQL
  • ETL/ELT pipeline development for large-scale, batch and near-real-time workloads.
  • Performance tuning & optimization.
  • Hands on experience on Spark Streaming.
• Excellent knowledge of Lakehouse & table formats:
  Delta Lake (preferred), Apache Hudi or Apache Iceberg.
• Expertise in Data quality & validation.
• Excellent knowledge of Pandas.
• AWS hands-on experience with a strong understanding of cloud principles, including:
  • AWS Glue (ETL jobs, Spark jobs, Glue Studio/Workflows, Glue Data Catalog) and AWS Lambda for serverless integrations.
  • Amazon EMR (cluster sizing, autoscaling, cost optimization with Spot, versioned runtimes).
  • Amazon S3 (data lake layout, partitioning, lifecycle policies).
  • Orchestration & monitoring: AWS Step Functions, Amazon MWAA/Airflow, Cloud Watch Logs/Metrics/Alarms.
  • Experience with Agile development methodologies.
  • Familiarity with CI/CD concepts and tooling such as AWS Code Pipeline/Code Build/Code Deploy; infrastructure as code (Cloud Formation/Terraform) is a plus.
  • Testing & code quality: unit/integration testing for Spark (pytest, chispa), code reviews, PEP 8, type hints/mypy.
• Strong problem solving, analytical, and communication skills.
• Ability to work independently and collaboratively in a team environment.

• Knowledge of Java and the Spring framework.
• Databricks on AWS:
  Jobs, clusters, notebooks, Repos, Delta Live Tables, Unity Catalog.
• Experience with catalog governance and row/column-level security.
• Exposure to cost/performance governance (e.g., file compaction, small-files mitigation, Z-Ordering for Delta).
• Knowledge of REST APIs integration and message-based architectures.

Role

Location:

Remote

Compensation Range: $75,000-$113,000

Full-time, regular employees accrue a minimum of 10 days of paid vacation per year, 6 days of paid sick leave per year (pro-rated for new hires), 10 paid holidays, and are eligible for paid bereavement leave and jury duty. They are eligible to participate in the Company’s 401(k) Retirement Plan with employer matching. Eligible for medical, dental, and vision insurance, plus Company-paid life, accidental death and disability insurance, and short- and long-term disability benefits.

Health Savings Account (HSA) and Flexible Spending Account (FSA) options are available where applicable. Benefits offerings vary in Puerto Rico. Part-time and temporary employees have prorated sick leave and 401(k) options as described in the original text.

We proudly embrace the values that have shaped UST since day…