Data Engineer

About

the job:
Data Engineer

Career Level:

Mid-level

Location:

Hybrid / Onsite

We are Spearhead Technology — where every challenge is an opportunity, and every solution is a masterpiece in the making.

As a full‑lifecycle IT company, we transcend mere delivery; we engineer success.

From inception to implementation, our seasoned expertise shepherds every phase of the journey. Be it planning, analysis, design, development, testing, or the seamless transition to production, we stand as steadfast partners in our clients’ progress.

At Spearhead Technology, quality isn’t a mere aspiration— it’s our ethos. Rooted in Tech Advisory, our methodology is guided by insights that spark transformative outcomes. We recognize the paramount importance of talent retention. Through a steadfast commitment to work‑life balance, competitive remuneration packages, and an optimized operational model, we ensure our team remains as exceptional as our services.

Step into Spearhead Technology, where innovation meets precision, and together, let’s sculpt the future of technology with finesse and distinction.

We are seeking individuals who demonstrate exceptional skills and are passionate about making a difference.

• Work with a team of data and software engineers to deliver big data streaming platform and data management capabilities.
• Develop cutting edge software solutions by writing maintainable, extensible, tested code, while complying with coding standards.
• Be hands‑on and lead from the front in following best practices in development, microservices design and CI / CD methodologies.
• Facilitate end‑to‑end user testing with customers.
• Troubleshoot, debug and upgrade existing systems.
• Help bridge gaps between Toyota Connected, other Toyota Entities, and 3rd party suppliers.
• Work closely with product owners to shape and deliver features to customers.
• Embrace emerging technology opportunities and contribute to our best practices, driving overall architecture, security, design.
• Write full‑stack software and tooling, ensuring code is well‑tested and performant.
• Develop tools and libraries that will enable rapid and scalable development in the future.
• Contribute to all aspects of the software development life cycle across multiple, interconnected software products.
• Support responsibilities will include investigating issues our customers have with retrieving data via our data products.
• Debugging APIs, cloud services, and data lake technologies.

• 3+ years of data engineering experience.
• Solid experience writing clean, concise, tested, maintainable code in Python.
• Experience building and deploying applications in AWS.
• API development experience.
• Experience utilizing Spark and SQL.
• Experience with Databricks or EMR.
• Experience with CI / CD and updating build pipelines and pipeline tasks.
• Hands‑on production experience working with Big Data platforms, building and optimizing data pipelines that involve data processing and streaming platforms.
• Experience in test automation frameworks, optimizing performance and security enabling delivery of robust and maintainable architecture.
• Ability to learn and apply new technologies, programming practices, patterns, and methods.
• Demonstrates advanced problem‑solving, troubleshooting, decision‑making skills.
• Organized and detail‑oriented.
• Ability to develop healthy working relationships and collaborate with peers and leaders.
• Exhibits integrity and high standards in work quality.
• Excellent verbal and written communication skills.
• Values diversity and differences amongst individuals in interactions.

• Achieve a healthy work‑life balance.
• Competitive compensation and abundant growth opportunities.
• Enjoy a standard 5‑day workweek with 2 fixed weekly offs.
• Experience an employee‑centric environment with supportive policies.
• Benefit from family‑friendly and flexible work arrangements.
• Access our Performance Advancement and Career Enhancement (PACE) initiative and discover opportunities for both personal and professional growth. From tailored career development plans to expert counseling services, PACE empowers you to chart your course to success with confidence and clarity.
• Elevate your…