Software Engineer II

This position is eligible for a hybrid work schedule, which includes the ability to work from home, while also requiring to be in person as needed at our St. Louis locations.

As a Senior Software Engineer on the Cloud Data Engineering Product Services team, you will be responsible for creating workflows to ingest data into our enterprise Data Lake. In addition, you will provide initial Tier 1 support of Databricks workflows, Spark streaming applications, and Azure Function applications for our Cloud Data Engineering ecosystem.

In this role you will be a part of a shared services team responsible for initial triage of production products, supporting domain teams development projects, and identifying and implementing hardening and resiliency opportunities across our environment.

You will also collaborate with other engineers to develop new data pipelines. You will use Microsoft Azure Cloud PaaS technologies to engineer our data solutions in a way that allows us to optimize our information, make better decisions, and meet our customer’s needs.

If you have a passion for engineering, working with massive amounts of data and being a part of a shared service organization that supports multiple engineering teams, this is the role for you.

• Ability to participate in the teams on-call rotation
• Must have good oral and written communication skills to effectively communicate with various IT teams and business representatives
• Must be able to both collaborate in a team-oriented environment and work independently with direction
• Must have good troubleshooting and problem-solving skills, including debugging multi-threaded applications
• Familiarity with Databricks workspace, notebooks, clusters, and jobs
• Familiarity with CI/CD pipelines and Dev Ops tools (e.g., Git Hub Actions, Azure Dev Ops)

Equal Opportunity Employer/Disability/Veterans

• Must be presently authorized to work in the U.S. without a requirement for work authorization sponsorship by our company for this position now or in the future
• Must reside in St. Louis, Missouri, or immediate surrounding area
• Must be able to work a schedule within U.S. Central Standard Time core business hours
• Must have 3 or more years’ experience in full lifecycle development and end-to-end testing and data validation
• Apache Spark Fundamentals:
  Understanding Spark architecture, distributed computing, Data Frames, and Spark SQL
• Experience with relational databases such as Oracle, SQL Server, Postgres, or Teradata
• Hands-on experience supporting applications deployed on Azure services such as Spark, Azure Functions, and Azure SQL
• Experience writing scalable data pipelines and transformations (e.g., Python, Scala, or Java)
• Must be committed to incorporating security into all decisions and daily job responsibilities

• Bachelor's degree in Computer Science, Computer Information Systems, Management Information Systems, or related field preferred
• Experience with Big Data Solutions and No
  
  SQL DBMSs
• Experience working with ADLSg2 or other Blob Storage solutions
• Experience with change data capture (CDC) and identifying data deltas for incremental data processing (e.g. SCD type 1 / SCD type
  2)
• Experience with API development and support of Azure functions
• Experience with Azure, AWS, or other Public Cloud environments
• Experience with Microsoft Azure platform technologies like Event Hubs, Data Factory, Delta Lake, Cosmos DB, or Dev Ops
• Prior experience leading large-scale projects