Python Developer

Role description

Python Developer

Lead I - Software Engineering

Born digital, UST transforms lives through the power of technology. We walk alongside our clients and partners, embedding innovation and agility into everything they do. We help them create transformative experiences and human-centered solutions for a better world.

UST is a mission-driven group of 29,000+ practical problem solvers and creative thinkers in more than 30 countries. Our entrepreneurial teams are empowered to innovate, act nimbly, and create a lasting and sustainable impact for our clients, their customers, and the communities in which we live.

With us, you ll create a boundless impact that transforms your career-and the lives of people across the world.

Visit us at

UST is seeking a Python developer with solid Python fundamentals and strong hands-on expertise in PySpark for building scalable data processing pipelines on AWS.

• Design, build, and optimize PySpark-based data pipelines (batch & streaming) on AWS.
• Tune Spark jobs for performance, reliability, and cost efficiency; monitor using Spark UI/Cloud Watch.
• Collaborate with platform, data, and application teams to integrate pipelines with Glue/EMR/Lambda/Step Functions.
• Establish CI/CD for data workflows and ensure test coverage and deployment automation.
• Contribute to coding standards, documentation, and Agile ceremonies.

This position description identifies the responsibilities and tasks typically associated with the performance of the position. Other relevant essential functions may be required.

• 4+ years of professional experience in software development with a strong focus on Python.
• Solid understanding of core Python concepts, data structures, algorithms, and design patterns.
• Proficiency in Python for scripting, automation, backend services, and data-processing workflows.
• Data modeling for analytics (medallion architecture: bronze/silver/gold), Parquet/Avro/JSON best practices.
• Hands-on expertise with PySpark, including:
  • Working with Data Frames/Datasets and Spark SQL
  • ETL/ELT pipeline development for large-scale, batch and near-real-time workloads.
  • Performance tuning & optimization.
  • Hands on experience on Spark Streaming.
  • Excellent knowledge of Lakehouse & table formats:
    Delta Lake (preferred), Apache Hudi or Apache Iceberg.
  • Expertise in Data quality & validation.
  • Excellent knowledge of Pandas.
• AWS hands-on experience with a strong understanding of cloud principles, including:
• AWS Glue (ETL jobs, Spark jobs, Glue Studio/Workflows, Glue Data Catalog) and AWS Lambda for serverless integrations.
• Amazon EMR (cluster sizing, autoscaling, cost optimization with Spot, versioned runtimes).
• Amazon S3 (data lake layout, partitioning, lifecycle policies).
• Orchestration & monitoring: AWS Step Functions, Amazon MWAA/Airflow, Cloud Watch Logs/Metrics/Alarms.
• Experience with Agile development methodologies.
• Familiarity with CI/CD concepts and tooling such as AWS Code Pipeline/Code Build/Code Deploy; infrastructure as code (Cloud Formation/Terraform) is a plus.
• Testing & code quality: unit/integration testing for Spark (pytest, chispa), code reviews, PEP 8, type hints/mypy.
• Strong problem solving, analytical, and communication skills.
• Ability to work independently and collaboratively in a team environment.

• Knowledge of Java and the Spring framework.
• Databricks on AWS:
  Jobs, clusters, notebooks, Repos, Delta Live Tables, Unity Catalog.
• Experience with catalog governance and row/column-level security.
• Exposure to cost/performance governance (e.g., file compaction, small-files mitigation, Z-Ordering for Delta).
• Knowledge of REST APIs integration and message-based architectures.

Role

Location:

Remote

Compensation Range: $75,000-$113,000

Full-time, regular employees accrue a minimum of 10 days of paid vacation per year, 6 days of paid sick leave, 10 paid holidays, and are eligible for paid bereavement leave and jury duty. They are eligible for the 401(k) Retirement Plan with employer matching and medical, dental, and vision insurance. Benefits offerings vary by tenure and location.

We proudly embrace the values that have shaped UST since day one. We build a culture of Humility, Humanity, and Integrity. These values inspire us to nurture a people-first, human-centric culture that fosters diversity, prioritizes sustainable solutions, and keeps our people and clients at the forefront of all decisions.

UST is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other applicable characteristics protected by law. We will consider qualified applicants with arrest or conviction records in accordance with state and local laws and "fair chance" ordinances.

UST reserves the right to periodically redefine your roles and…