Senior Software Engineer

** Overview*
* Microsoft is a company where passionate innovators come to collaborate, envision what can be and take their careers further. This is a world of more possibilities, more innovation, more openness, and the sky is the limit thinking in a cloud-enabled world.

Microsoft's Azure Data engineering team is leading the transformation of analytics in the world of data with products like databases, data integration, big data analytics, messaging & real-time analytics, and business intelligence. The products our portfolio include Microsoft Fabric, Azure SQL DB, Azure Cosmos DB, Azure Postgre

SQL, Azure Data Factory, Azure Synapse Analytics, Azure Service Bus, Azure Event Grid, and Power BI. Our mission is to build the data platform for the age of AI, powering a new class of data-first applications and driving a data culture.

Within Azure Data, the Azure Data Analytics team builds the core analytics experiences in Microsoft Fabric. We own the Data Warehouse, Data Engineering, Data Science, AI, and Power BI workloads, enabling customers to ingest, transform, analyze, and derive insights from structured, semi-structured, and unstructured data at enterprise scale. Our team is at the center of Microsoft's strategy to deliver a seamless, end-to-end analytics experience in Fabric.

Microsoft is a company where passionate innovators come to collaborate, envision what can be and take their careers further. This is a world of more possibilities, more innovation, more openness, and the sky is the limit thinking in a cloud-enabled world.

Microsoft's Azure Data engineering team is leading the transformation of analytics in the world of data with products like databases, data integration, big data analytics, messaging & real-time analytics, and business intelligence. The products our portfolio include Microsoft Fabric, Azure SQL DB, Azure Cosmos DB, Azure Postgre

SQL, Azure Data Factory, Azure Synapse Analytics, Azure Service Bus, Azure Event Grid, and Power BI. Our mission is to build the data platform for the age of AI, powering a new class of data-first applications and driving a data culture.

Within Azure Data, the big data analytics team provides a range of products that enable data engineers and data scientists to extract intelligence from all data - structured, semi-structured, and unstructured. We build the Data Engineering, Data Science, and Data Integration pillars of Microsoft Fabric.

The Fabric Data Engineering Experience & Infrastructure team is looking for a passionate engineer to help build the next generation of infrastructure services for Microsoft Fabric Data Engineering, powered by Apache Spark.

If you enjoy working on high-scale distributed systems, developer experiences, and platform infrastructure that makes engineers more productive, this is a great place to do it.

What you'll work on

+ Build and operate core infrastructure services that power Fabric Data Engineering on Spark

+ Improve scalability, resiliency, and observability across Spark-based services

+ Partner closely with product, client/UX, and runtime teams to ship end-to-end experiences

+ Drive engineering excellence through design reviews, testing, incident learnings, and performance tuning

+ Intelligent job/session orchestration and scheduling improvements

+ Runtime performance optimizations (caching, adaptive execution, cost/perf tuning)

+ Debuggability & observability (logs/metrics/traces, diagnostics experiences)

+ Reliability tooling (auto-heal, safe rollouts, incident reduction)

+ Data engineering developer experience improvements (config, templates, integrations)
What we're looking for

+ Strong software engineering fundamentals and experience shipping production services

+ Comfort working with distributed systems and performance-critical code

+

Experience with Spark and/or big data systems is a big plus (but not required if you're eager to learn)

+ Collaborative mindset and ownership mentality-someone who likes building, iterating, and improving systems over time

We do not just value differences or different perspectives. We seek them out and invite them in so we can tap into the collective power of everyone in the company. As a result,…