Engineer II – Big Data, GCP Java SpringBoot

Job Title

Technical

Skills:

1. Core Data Engineering Skills

Proficiency in using GCP's big data tools like:

Big Query:
For data warehousing and SQL analytics

Dataproc:
For running Spark and Hadoop clusters.

GCP Dataflow:
For stream and batch data processing (High level Idea

GCP Pub/Sub:
For real-time messaging and event ingestion. (High level Idea

Expertise in building automated, scalable, and reliable pipelines using custom Python/Scala solutions or Cloud Data Functions.

2. Programming and Scripting

Strong coding skills in SQL, and Java

Familiarity with APIs and SDKs for GCP services to build custom data solutions.

3. Cloud Infrastructure

Understanding of GCP services such as Cloud Storage, Compute Engine, and Cloud Functions.

Familiarity with Kubernetes (GKE) and containerization for deploying data pipelines. (Optional but Good to have)

4. Dev Ops and CUCD

Experience setting up CICD pipelines using Cloud Build, Git Hub Actions, or other tools

Monitoring and logging tools like Cloud Monitoring and Cloud Logging for production workflows.

5. Backend Development (Spring Boot & Java)

Design and develop RESTful APIs and microservices using Spring Boot.

Implement business logic, security, authentication (JWT/OAuth), and database operations.

Work with relational databases (MySQL, PostgreSQL, MongoDB. Cloud SQL).

Optimize backend performance, scalability, and maintainability.

Implement unit testing and integration testing

Soft Skills:

1. Innovation and Problem-Solving

Ability to think creatively and design innovative solutions for complex data challenges.

Experience in prototyping and experimenting with cutting-edge GCP tools or third-party integrations.

Strong analytical mindset to transform raw data into actionable insights.

2. Collaboration

Teamwork:
Ability to collaborate effectively with data analysts, and business stakeholders.

Communication:
Strong verbal and written communication skills to explain technical concepts to non-technical audiences.

3. Adaptability and Continuous Learning

Open to exploring new GCP features and rapidly adapting to changes in cloud technology.