PySpark Developer

Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This is an opportunity to contribute to technology initiatives in a collaborative environment with opportunities for professional growth.

U.S. Citizens, Green Card holders, EAD holders, and H-1B transfer candidates are encouraged to apply. Bright Vision Technologies is unable to sponsor new H-1B visa petitions for this position.

Bright Vision Technologies is seeking a PySpark Developer to design, build, validate, and support data solutions that make trusted information available for enterprise operations, analytics, and decision-making. The work includes data integration, modeling, quality, performance, and governance. The successful candidate will apply practical expertise in Apache Spark, PySpark/Scala, Spark SQL, distributed processing, partitioning, tuning, and batch/streaming pipelines, work with cross-functional teams, and contribute to reliable, maintainable solutions through the delivery lifecycle.

• Develop and maintain data pipelines, transformations, reports, models, or platform components as required by the role.
• Translate source-to-target and business requirements into validated technical data solutions.
• Implement data quality checks, access controls, monitoring, and failure-recovery procedures.
• Tune SQL, processing jobs, models, dashboards, or platform resources for performance and cost.
• Document data definitions, lineage, operational procedures, and technical decisions.

• Experience
  
  Required:
  
  typically 4+ years in a related professional role; exact threshold must match the approved requisition.
• Practical experience with the role-specific technology stack:
  Apache Spark, PySpark/Scala, Spark SQL, distributed processing, partitioning, tuning, and batch/streaming pipelines.
• Professional experience in data engineering, analytics, data management, or the platform area relevant to this role.
• Strong SQL skills and practical experience with the data technologies identified for the position.
• Understanding of data modeling, ETL/ELT, data validation, and integration patterns.
• Experience with data quality, security, access controls, and production support.
• Ability to translate business requirements into accurate and maintainable data solutions.
• Strong analytical, documentation, and stakeholder communication skills.

• Additional hands‑on depth in Apache Spark, PySpark/Scala, Spark SQL, distributed processing, partitioning, tuning, and batch/streaming pipelines.
• Experience with cloud services, automation, and modern delivery practices relevant to the project.
• Familiarity with secure development, accessibility, governance, or regulatory requirements where applicable.
• Relevant professional certifications or advanced training in the role’s technology area.

Bright Vision Technologies is an Equal Opportunity Employer.

Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.

BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.