More jobs:
Pyspark Engineer
Job in
Phoenix, Maricopa County, Arizona, 85044, USA
Listed on 2026-06-02
Listing for:
Texas State Library and Archives Commision
Full Time
position Listed on 2026-06-02
Job specializations:
-
IT/Tech
Data Engineer, Big Data, Cloud Computing, Data Science Manager
Job Description & How to Apply Below
, optimizing data workflows
, and ensuring data integrity for analytical and machine learning applications.
Key Responsibilities:
- Develop and optimize ETL pipelines using Py Spark for data ingestion, transformation, and processing.
- Design, implement, and maintain big data solutions on platforms such as Hadoop, Databricks, or AWS Glue
. - Work with structured and unstructured data from multiple sources, ensuring data quality and consistency
. - Collaborate with data scientists, analysts, and business teams to understand data requirements and deliver efficient solutions.
- Optimize Spark jobs for performance tuning
, cost reduction
, and scalability
. - Implement data security and governance best practices.
- Troubleshoot issues related to data pipelines
, Spark jobs, and distributed computing environments. - Automate workflows using Apache Airflow, Cron Jobs, or other orchestration tools
. - Write clean, maintainable, and well-documented PySpark code following best practices.
- Stay up to date with the latest developments in big data, cloud computing, and distributed systems
.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×