LLMOps Engineer

Fractal Analytics is a strategic AI partner to Fortune 500 companies with a vision to power every human decision in the enterprise. Fractal is building a world where individual choices, freedom, and diversity are the greatest assets. An ecosystem where human imagination is at the heart of every decision. Where no possibility is written off, only challenged to get better. We believe that a true Fractalite empowers imagination with intelligence.

And that it will be such Fractalites that will continue to build the company for the next 100 years.

Please visit Fractal | Intelligence for Imagination for more information about Fractal.

Location:

MN

Note:

This Position Is Not Eligible For Immigration Sponsorship At This Time.

Primary Responsibilities:

• Design, develop, and deploy AI solutions leveraging cutting-edge tools, frameworks, and best practices.

• Fine-tune and deploy Large Language Models (LLMs) such as OpenAI and Azure-based services to deliver scalable AI applications.

• Implement and optimize Retrieval-Augmented Generation (RAG) architectures, leveraging vector databases for efficient data retrieval.

• Write clean, maintainable Python code following software development best practices, including GIT workflows, code reviews, and CI/CD pipelines.

• Collaborate with cross-functional teams to integrate AI solutions with existing data engineering pipelines and cloud infrastructure.

• Build and manage containerized AI applications using Docker and Kubernetes for scalability and reproducibility.

• Leverage Azure services for deploying, monitoring, and scaling AI applications in the cloud.

Required Qualifications:

• Strong proficiency in Python programming with a deep understanding of the software development lifecycle.

• Expertise in working with LLMs, including fine-tuning, prompt engineering, and deployment.

• Hands-on experience with RAG architectures and vector databases for knowledge retrieval.

• Familiarity with SQL Server and/or Snowflake for data storage and retrieval.

• Proficiency in Docker for containerization and Kubernetes for orchestration of containerized applications.

• Solid understanding of Azure services for deploying and managing AI applications.

Preferred Qualifications:

• Experience with advanced optimization techniques for LLMs in production.

• Exposure to managing and deploying large-scale AI systems in cloud environments.

• Knowledge of best practices in logging, monitoring, and debugging AI workflows.

• Ability to collaborate effectively with data engineering teams for seamless integration of AI pipelines.

Pay:

The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled.

At Fractal, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is: $140,000 - $180,000. In addition, you may be eligible for a discretionary bonus for the current performance period.

As a full-time employee of the company or as an hourly employee working more than 30 hours per week, you will be eligible to participate in the health, dental, vision, life insurance, and disability plans in accordance with the plan documents, which may be amended from time to time. You will be eligible for benefits on the first day of employment with the Company.

In addition, you are eligible to participate in the Company 401(k) Plan after 30 days of employment, in accordance with the applicable plan terms. The Company provides for 11 paid holidays and 12 weeks of Parental Leave. We also follow a “free time” PTO policy, allowing you the flexibility to take time needed for either sick time or vacation.

Fractal provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.