Senior Data Engineer PySpark Python

Senior Data Engineer PySpark Python

Location:

Tampa, FL, USA 33612

Work model:
Hybrid – 3 days onsite and 2 days remote

Employment type:

Temp to Hire (Full‑Time, 6‑month estimate)

Hourly rate: $65.00 - $77.00

We are seeking a highly skilled and experienced Senior PySpark Developer to join our dynamic technology team. This role requires deep expertise in Python, PySpark, Big Data technologies, and SQL, as well as the ability to work independently and contribute significantly to complex data engineering initiatives. You should have a proven track record in designing, developing, and optimizing scalable data solutions with experience in ETL processes, and a keen interest in leveraging the latest technologies.

Domain knowledge in Finance and financial‑crime compliance projects will be an advantage.

• Design, develop, and implement robust, scalable, and high‑performance data pipelines and applications using Python, PySpark, and Big Data technologies.
• Work autonomously to analyze requirements, propose technical solutions, and deliver high‑quality code and data products, ensuring alignment with architectural standards and business objectives.
• Utilize experience with Big Data platforms (Hadoop, Hive, Kafka, Spark) to process, transform, and manage large datasets efficiently.
• Write complex SQL queries, stored procedures, and optimize database performance for large‑scale data warehousing and analytics solutions.
• Develop and enhance ETL processes to ensure data quality and timely delivery; familiarity with ETL tools and methodologies is a plus.
• Research, evaluate, and integrate new emerging technologies, frameworks, and tools to improve development processes.
• Ensure adherence to coding standards, conduct code reviews, and implement best practices for data governance and security.
• Diagnose and resolve complex technical issues related to data pipelines, performance bottlenecks, and system integrations.
• Collaborate with architects, data scientists, business analysts, and QA engineers; provide technical guidance and mentorship to junior team members.
• Explore opportunities to leverage AI tools to accelerate development, reviews, testing, and deployment.

• Expert-level proficiency in Python programming, including object‑oriented design, data structures, algorithms, and extensive experience with Python libraries.
• Deep expertise in developing, optimizing, and deploying PySpark applications for large‑scale data processing, ETL, and real‑time analytics.
• Strong understanding of Apache Spark architecture, Hadoop ecosystem, and distributed computing concepts; familiarity with big data storage formats such as Parquet and ORC.
• Solid experience with relational databases (Oracle) and No
  
  SQL databases (MongoDB); strong SQL writing and optimization skills.
• Experience designing, developing, and consuming RESTful APIs using Python frameworks (Flask, FastAPI, Django REST Framework).
• Proficiency with CI/CD tools (Jenkins) and containerization technologies (Docker, Kubernetes).
• Expert‑level proficiency with Git.
• Experience with unit, integration, and performance testing for Python and PySpark applications.
• Exposure to or direct experience with AI and ML concepts, frameworks (Tensor Flow, PyTorch); experience is an advantage.

• Exposure to at least one major cloud provider (AWS, Azure, GCP), especially compute, storage, and data services such as S3, ADLS, EMR, Databricks, Azure Synapse.

• Exceptional analytical and problem‑solving abilities.
• Team leadership, management, and mentoring capabilities.
• Superior verbal and written communication skills.
• Strong collaboration and interpersonal skills.
• Highly proactive, results‑oriented, and committed to delivering high‑quality solutions.
• Ability to thrive in an agile, dynamic, fast‑paced environment.

• Required:
  
  Bachelor’s degree in computer science, engineering, or related field.
• Preferred:
  Master’s degree.

Rose International is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, sexual orientation, gender expression or identity, national origin, arrest and conviction records, disability, veteran status, or any other characteristic protected by law. Positions located in San Francisco and Los Angeles, California will be administered in accordance with their respective Fair Chance Ordinances.

Only candidates lawfully authorized to work in the United States are eligible for consideration.

Rose International is a participant in the E‑Verify program under agreement , effective June 30, 2008.