Senior Software Engineer

Job Title:

Senior Software Engineer (Java & Spark)

Job Location:

Canada

About the job you’re considering
As Senior Software Engineer, you will work on one of the world's largest social media platform which deals with a few petabytes of data coming to the system daily. You will contribute as part of R&D self‑organized team working in a challenging, innovative environment for our client.

Investigate, create, and implement the solutions for many technical challenges using cutting edge technologies, including building/enhancing Data processing platform enabling work of software used by hundreds of millions of users.

Your role

Obtains tasks from the project lead or Team Lead (TL), prepares functional and design specifications, approves them with all stakeholders.

Ensures that assigned area/areas are delivered within set deadlines and required quality objectives.

Provides estimations, agrees task duration with the manager and contributes to project plan of assigned area.

Developing best practices for data coding to ensure consistency within the system.

Updating and optimizing local and metadata models.

Evaluating implemented data systems for variances, discrepancies, and efficiency.

Troubleshooting and optimizing data systems.

Understand the business drivers and analytical use‑cases and translate these to data products.

Design, implement and maintain pipelines that produce business critical data reliably and efficiently using cloud technology.

Addresses area‑level risks, provides and implements mitigation plan.

Reports about area readiness/quality, and raise red flags in crisis situations which are beyond his/her AOR.

Initiates and conducts code reviews, creates code standards, conventions, and guidelines.

Suggests technical and functional improvements to add value to the product.

Constantly improves his/her professional level.

Collaborates with other teams.

Design and implement Fine Grained Access Control system for Client’s big data platform (Spark, Flink, PyTorch, Ray and other ML/AI frameworks).

Improve and customize the internals of open source Spark to meet our challenges at scale and actively participate in open source community.

Build and scale big data processing frameworks and infrastructure to process petabytes‑scale datasets.

Your skills and experience

5+ years of experience as Software Engineer with Solid Java, Python coding skill with Spark.

3+ years of experience of building and support large scalable big data infrastructure/platform.

Knowledge of big data technologies (e.g. Spark, Hadoop, Parquet/ORC, Flink).

Ability to organize and document solutions.

A passion for streamlining systems and processes to make the difficult trivial.

Effective communication (oral & written), collaboration, and interpersonal skills.

Nice to have

Experience with AWS & K8S.

Compensation range for this role in the posted location is: $65,200- $158,550.

Capgemini provides compensation range information in accordance with applicable national, state, provincial, and local pay transparency laws. The base compensation range listed for this position reflects the minimum and maximum target compensation Capgemini, in good faith, believes it may pay for the role at the time of this posting. This range may be subject to change as permitted by law.

The actual compensation offered to any candidate may fall outside of the posted range and will be determined based on multiple factors legally permitted in the applicable jurisdiction.

These may include, but are not limited to:
Geographic location, Education and qualifications, Certifications and licenses, Relevant experience and skills, Seniority and performance, Market and business consideration, Internal pay equity.

It is not typical for candidates to be hired at or near the top of the posted compensation range.

In addition to base salary, this role may be eligible for additional compensation such as variable incentives, bonuses, or commissions, depending on the position and applicable laws.

Capgemini offers a comprehensive, non‑negotiable benefits package to all regular, full‑time employees.

Paid time off based on employee grade (A-F), defined by policy:
Vacation: 12-25 days, depending on grade, Company…