Data Engineer; Databricks

Com Resource is searching for a highly skilled Data Engineer with a background in SQL and Databricks that can handle the design and construction of scalable management systems, ensure that all data systems meet company requirements, and also research new uses for data acquisition.

• Design, construct, install, test and maintain data management systems.
• Build high-performance algorithms, predictive models, and prototypes.
• Ensure that all systems meet the business/company requirements as well as industry practices.
• Integrate up-and-coming data management and software engineering technologies into existing data structures.
• Develop set processes for data mining, data modeling, and data production.
• Create custom software components and analytics applications.
• Research new uses for existing data.
• Employ an array of technological languages and tools to connect systems together.
• Recommend different ways to constantly improve data reliability and quality.

• 5+ years data quality engineering
• Experience with Cloud-based systems, preferably Azure
• Databricks and SQL Server testing
• Experience with ML tools and LLMs
• Python and SQL for data quality checks
• Data profiling and anomaly detection
• Documentation and quality metrics
• Test automation and quality process development

• Python and NLP frameworks (spaCy, Hugging Face, NLTK)

Associate

Full-time

Information Technology

IT Services and IT Consulting

Referrals increase your chances of interviewing at Com Resource by 2x