Starburst Engineer​/SME

Seeking an Application Development Lead with deep knowledge and hands-on experience with the Starburst Data Federation and Virtualization platform for a key initiative in the organization’s Data Strategy.

• Serve as the primary technical interface between downstream analytical consumers and upstream data source owners.
• Lead the end-to-end technical onboarding of new data catalogs in Starburst using native Starburst connectors (Hive/Iceberg, Oracle, S3).
• Establish operational guidelines with resource and query limits to prevent federated queries from causing performance degradation on critical transactional databases.
• Partner with upstream data stewards to ensure accuracy of business glossaries, data dictionaries, lineage mappings, and data classification tags.
• Implement and govern centralized authorization policies using Role-Based Access Control (RBAC) and Row-Level Filters in Apache Ranger.
• Define data onboarding standards for Hive/Iceberg table formats, including partitioning schemes, sorting keys, file formats (Parquet/ORC), and statistics collection strategies.
• Validate and tune pushdown capabilities (predicate pushdown, projection pushdown, join pushdown) for newly onboarded data sources to ensure query federation performance.
• Conduct capacity forecasting, analyze query cost efficiency, and implement optimization strategies such as materialization to maximize cluster throughput.
• Partner closely with enterprise technology enablement teams, data architects, and domain engineers to design, build, and publish standardized, reusable Data Products using Starburst and open data formats.
• Integrate data products with enterprise data catalogs, governance marketplaces, and BI consumption tools, ensuring end-to-end discoverability, automated lineage, and governed access.

Required Qualifications:

• 2+ years of hands-on experience with the Starburst Data Federation and Virtualization platform.
• Deep understanding of Trino architecture, Apache Ranger policies, Starburst Data Products, and the Iceberg table format.
• 6+ years of hands-on experience in Application Development.
• Strong understanding of software architecture principles and distributed system design (Microservices, Event-Driven Architecture).
• Extensive experience with relational (Oracle) and No
  
  SQL databases (MongoDB), including advanced SQL.
• Experience with Big Data technologies (Apache Spark, Hadoop, Kafka) and data warehousing.
• Proven expertise in designing, developing, and securing RESTful APIs and integration patterns.
• Hands-on experience with CI/CD systems (Jenkins, Git Hub Actions, Bitbucket Pipelines) for automated deployment.
• Highly experienced with Unix-based operating systems and shell scripting.
• Strong background in cloud platforms (AWS, Azure, GCP), including containerization (Docker) and contributing to Kubernetes orchestration.
• Advanced troubleshooting, debugging, and performance optimization for distributed systems.
• Proficiency in automated testing frameworks (Pytest, unittest) and TDD methodologies.
• Solid understanding of secure coding practices and application security principles (OWASP Top 10).
• Expertise in Git (Bitbucket, Git Hub) for advanced branching and pull request workflows.
• Proven ability to lead and mentor a global data engineering and platform operations team across multiple time zones.
• Practical experience with AI tools (Copilot, Devin, Claude/Gemini/GPT) for development workflows.

Desirable

Qualifications:

• Deep understanding and practical experience with Agile/Scrum methodologies.
• Exceptional ability to manage priorities and tasks effectively.
• Strong analytical, logical, systems thinking, and critical analysis skills.
• Excellent written and verbal communication for diverse audiences.
• Ability to work independently, take…