Software Engineer, Data Infrastructure; Hybrid

Software Engineer, Data Infrastructure (Hybrid) page is loaded## Software Engineer, Data Infrastructure (Hybrid) locations:
USA - Sunnyvale, CA:
USA - Austin, TX:
USA - Remote, NYtime type:
Full time posted on:
Posted Todayjob requisition :
R26380

As a global leader in cybersecurity, Crowd Strike protects the people, processes and technologies that drive modern organizations. Since 2011, our mission hasn’t changed — we’re here to stop breaches, and we’ve redefined modern security with the world’s most advanced AI-native platform. We work on large scale distributed systems, processing almost 3 trillion events per day and this traffic is growing daily.
*
* About the Role:

** Crowd Strike is looking to hire a Senior Systems Engineer to join the Data Engineering team as a Senior Distributed Systems Engineer. In this team, we are on a mission to create a hyper scale data lake, which helps finding bad actors and stopping breaches. The team builds and operates systems to centralize all of the data the falcon platform collects, making it easy for internal and external customers to transform and access the data for analytics, machine learning, and threat hunting.

As a Software Engineer in this team you will be responsible for building our Spark ecosystem in our Data Center that  includes but not limited to Kubernetes, Spark, MinIO, HDFS etc. We are looking for candidates that have setup big data scale clusters in the Data Center or Cloud (PB-scale would be a plus) in the Data Center/AWS and are passionate about solving problems at high scale.

This role involves leading efforts to build State-of-the-art Spark k8 platform.

This role can be based out of Sunnyvale/Silicon Valley Metro, Austin Metro or New York City Metro and will likely include 1-3 days in-office per week on average (NYC office is in development, so workers her will remain fully remote for likely 18-24 months)
** What You'll Do:
*** Design and implement extremely scalable large scale distributed Spark cluster on Kubernetes platform optimized for Data center environment.
* Perform and oversee a variety of functions to ensure that our Spark infrastructure on Kubernetes is available, reliable, stable and secure
* Applies judgment in analyzing and selecting technologies, installation and maintenance of software and hardware systems that allow multiple Engineering and Data Science teams to interact with this system
* Design, writes and own APIs, automate and generate reports to visualize cluster health.
* Has responsibility for building and maintaining the Spark infrastructure such that software engineers, data analysts and data scientists can run jobs to gather data and insights.
* Work on Query systems, like Apache Presto or Trino, Jupyter Notebooks
** What You'll Need:
*** Strong in one or both of field i.e., Spark ecosystem or Kubernetes ecosystem
* Strong analytical skills and  with deep understanding of Distributed Systems
* Strong programming skills in languages as Go, Java or Python
* Understanding of Apache Spark ecosystem technologies (Deltalake/Iceberg, YARN, HDFS, Kafka, Zookeeper, Hive, Jupyter notebooks)
* Experience with large-scale business critical platforms with Spark on Kubernetes on data center or cloud.
* Experience with continuous deployment on K8 with Helm, flux

CD etc
* Solid understanding of Spark(data) and K8 storage systems (Object stores S3/Minio, Spark ephemeral storage, Persistent volumes mapping and claims)
* Understanding or spark memory management and experience with spark internals.
* Familiarity with Chef is preferred.
* Proven ability to work with both local and remote teams
* Strong communication skills both verbal and written#LI-MP2#LI-DG1#LI-Hybrid#LI-HTF#HTFThis role will require the candidate to periodically undergo and pass additional background and fingerprint check(s) consistent with government customer requirements.
** Benefits of Working at Crowd Strike:
*** Market leader in compensation and equity awards
* Comprehensive physical and mental wellness programs
* Competitive vacation and holidays for recharge
* Paid parental and adoption leaves
* Professional development opportunities for all employees regardless of level or role
*…