Data Engineer
Listed on 2026-02-07
-
IT/Tech
Data Engineer -
Engineering
Data Engineer, Software Engineer
Location: someone from Redmond, WA is an ideal candidate. Next preference is within Pacific timezone.
Mandatory skills: Working experience on KUSTO.
Job Description:
10 years of Microsoft experience is a MUST with the last 3-4 years in Pyspark. Working experience on KUSTO for telemetry data is required. Candidates should be able to write Python code in Azure Synapse Notebook and possess a good understanding of Azure Synapse end-to-end. Experience with Spark structured streaming data, possibly from Event Hubs, is essential. Candidates should have experience handling large volumes of data, possibly in the 100s of GB.
They must be able to debug and fine-tune notebooks for optimum memory consumption and processing. Knowledge of data warehousing and data management for efficient data handling is necessary. A good understanding of data modeling and data engineering work is important. Experience working with large datasets using SQL, Azure Data Lake, PySpark, ADF, Synapse, etc., to derive actionable insights is highly desirable.
Candidates should be productive as soon as possible after joining.
Nice to Have:
Local Redmond resource, PST working hour resource, Microsoft ecosystem knowledge, Azure Dev Ops, Azure Web Apps, Azure Functions, Azure Cosmos DB, Event Hub.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).