Big Data Developer- Pyspark, SQL, Scala

Work Location:

Irving, Texas Job Description

• Seeking a Senior Big Data Engineer with 5 to 10 years of experience proficient in Apache Spark and Python to design and implement scalable data processing solutions within the Python Data domain
• Scala, PL/SQL
• Develop and maintain robust and scalable data pipelines using Apache Spark and Python. Collaborate with data scientists and analysts to optimize data workflows and enhance data quality. Ensure data integrity and consistency across large and complex datasets. Implement efficient data transformations and aggregations to support analytics and reporting needs. Work closely with cross-functional teams to integrate data solutions seamlessly into existing systems.
  
  Monitor and troubleshoot data processing jobs to maintain high reliability and performance. Stay updated with emerging trends, technologies and best practices in big data and Python development

• Design, develop and optimize high performance data processing applications leveraging Apache Spark. Write clean, reusable and efficient Python code to support various data engineering initiatives.
• Analyze complex datasets to extract actionable insights and identify data trends.
• Collaborate with stakeholders to gather requirements and deliver tailored data solutions that meet business objectives.
• Mentor junior team members and promote knowledge sharing within the team.
• Participate actively in code reviews to ensure adherence to coding standards and best practices.
• Manage deployment of data pipelines and continuously monitor their health and performance in production environments.

• Comprehensive Medical Plan Covering Medical, Dental, Vision
• Short Term and Long-Term Disability Coverage
• 401(k) Plan with Company match
• Life Insurance
• Paid Paternity and Maternity Leave

The range displayed on each job posting reflects the minimum and maximum salary target for the position across all Canada locations. Within the range, individual pay is determined by work location and job level and additional factors including job-related skills, experience, and relevant education or training. Depending on the position offered, other forms of compensation may be provided as part of overall compensation like an annual performance-based bonus, sales incentive pay and other forms of bonus or variable compensation.

LTIMindtree is an equal opportunity employer that is committed to diversity in the workplace. Our employment decisions are made without regard to race, colour, creed, religion, sex (including pregnancy, childbirth or related medical conditions), gender identity or expression, national origin, ancestry, age, family‑care status, veteran status, marital status, civil union status, domestic partnership status, military service, handicap or disability or history of handicap or disability, genetic information, atypical hereditary cellular or blood trait, union affiliation, affectional or sexual orientation or preference, or any other characteristic protected by applicable federal, state, or local law, except where such considerations are bona fide occupational qualifications permitted by law.