Trust & Safety ML Engineer: Build Safe AI

We are looking for ML engineers to help build safety and oversight mechanisms for our AI systems. As a Trust and Safety Machine Learning Engineer, you will work to train models which detect harmful behaviors and help ensure user well-being. You will apply your technical skills to uphold our principles of safety, transparency, and oversight while enforcing our terms of service and acceptable use policies.

About Anthropic

Anthropic is an AI safety and research company that’s working to build reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our customers and for society as a whole. Our interdisciplinary team has experience across ML, physics, policy, business and product.

Responsibilities:

• Build machine learning models to detect unwanted or anomalous behaviors from users and API partners, and integrate them into our production system
• Improve our automated detection and enforcement systems as needed
• Analyze user reports of inappropriate accounts and build machine learning models to detect similar instances proactively
• Surface abuse patterns to our research teams to harden models at the training stage

You may be a good fit if you:

• Have 4+ years of experience in a data scientist, research scientist, or research/ML engineering position, preferably with a focus on trust and safety.
• Have proficiency in SQL, Python, and data analysis/data mining tools.
• Have proficiency in building trust and safety AI/ML systems, such as behavioral classifiers or anomaly detection.
• Have strong communication skills and ability to explain complex technical concepts to non-technical stakeholders.
• Care about the societal impacts and long-term implications of your work.

Strong candidates may also:

• Have experience with machine learning frameworks like Scikit-Learn, Tensorflow, or Pytorch
• Have experience with full stack engineering to build internal tooling
• Have experience with high performance, large-scale ML systems
• Have experience with language modeling with transformers
• Have experience with reinforcement learning
• Have experience with large-scale ETL

Annual Salary

• The expected salary range for this position is $300k - $450k USD

Hybrid policy & visa sponsorship:
Currently, we expect all staff to be in our office at least 25% of the time. We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate; operations roles are especially difficult to support. But if we make you an offer, we will make every effort to get you into the United States or United Kingdom, and we retain an immigration lawyer to help with this.

We encourage you to apply even if you do not believe you meet every single qualification. Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work.

We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team.

Compensation and Benefits

Anthropic’s compensation package consists of three elements: salary, equity, and benefits. We are committed to pay fairness and aim for these three elements collectively to be highly competitive with market rates.

Equity - On top of this position's salary (listed above), equity will be a major component of the total compensation. We aim to offer higher-than-average equity compensation for a company of our size, and communicate equity amounts at the time of offer issuance.

US Benefits - The following benefits are for our US-based employees:

• Optional equity donation matching at a 3:1 ratio, up to 50% of your equity grant.
• Comprehensive health, dental, and vision insurance for you and all your dependents.
• 401(k) plan with 4% matching.
• 22 weeks of paid parental leave.
• Unlimited PTO – most staff take between 4-6 weeks each year, sometimes more!
• Stipends for education, home…