Senior Database Engineer; Elastic​/Mongo​/Hadoop

Senior Database Engineer(Elastic/Mongo/Hadoop)

Workplace Type : Remote -Region : San Francisco, CA

Job Description

• Must have experience with Mongo

DB installations, upgrades, support on MongoDB

• Responsible for administration, maintenance, Performance analysis, and Capacity planning for Mongo dB/Elastic/Hadoop clusters.

• Coordinate and plan with Application teams on Mongodb capacity planning for new applications.

• Should have knowledge of using mongo base tools - like mongodump , mongoexport ,mongorestore, mongoimport , mongostat , mongotop

• Must be well-versed with JSON scripting , writing queries in mongo in shell scripts and in the mongo shell

• Should be able to support sharded clusters and perform upgrades and other config maintenance on sharded clusters

• Must be able to address , monitor and manage capacity requirements - all aspects CPU , memory and storage .

• Must be able to assist application teams with assessment and/or resolution of performance bottlenecks observed in the Mongo

DB Database tier of their stack

• Must be aware of different authentication/authorization methods used in Mongo - SCRAM-SHA1 , X509 , LDAP - including reconfiguration of instances with TLS/SSL and/or LDAP

• Candidate must also be able to develop automated solutions for ad-hoc script execution requests, ad-hoc report generation, upgrades , installs

• Experienced in No

SQL DB technologies

• Must be aware of how to use Cloud manager and share relevant metrics for a given deployment when an issue arises

• Must have experience with docker, deploying Mongo containers running on docker and supporting all aspects of Mongo

DB administration needs within a docker container

• Knowledge of administration and support of Hadoop systems will be an added advance.

• Deploy Hadoop(Bigdata) cluster, Comm/decommissioning of nodes, track jobs, monitor services like zookeeper, hbase, SOLR indexing, configure name-node HA, schedule, configuring backups & restore

• To develop script to review logs and alert us in case of long running queries.

• Demonstrable expertise (deployment, use) in some of the following data storage technologies:
Postgres/MySQL (“on-prem”, RDS, Aurora), Kafka / Kinesis (“on-prem” or managed),

• Strong scripting experience with Python (preferred), and Shell (secondary).

• Individually build services, and expose internal APIs for these services that allow other teams, and workflows to use data infrastructure automation components.

Required Skills

• Strong Understanding of various relational and non-relational database technologies along with their benefits, downsides and best use-case and help application teams to use the correct database technology based on their specific business use case.

• 5+ year installing, automating, scaling and supporting No

SQL databases such as Mongo

DB, Elastic Search, Hadoop, among other emerging technologies.

• 1-2 years Experience working with the databases in public Clouds like Hetzner, AWS, Azure and GCP.

• Proficiency in automation

• Knowledge of Ansible, Python, Terraform

• Willingness and commitment to learn other database, automation, and Cloud technologies

• Great communication and collaboration skills

• Software development experience and knowledge of modern software development processes.

• Knowledge/experience in development programming languages such as Java, Go, Nodejs, html, CSS, bootstrap etc. is a plus.

• Knowledge/experience on AI/ML is a big plus.

• Ability to multi-task and prioritize with little to no supervision, providing team leadership skills.

• Ability to work well under pressure

• Consistent exercise of independent judgment and discretion in matters of significance

• Excellent communication skills

• Highly driven, highly involved, highly proactive

• Datalake cluster ownership and Technical point of contact for all applications on Hadoop cluster

• Responsible for new application on-boarding in Datalake by reviewing requirement and design.

• Assist existing and new applications to come up with most optimized and suitable solutions for their requirement

• L3 point of contact for issues related to Hadoop platform

Core Responsibilities

• Develops…