Machine Learning Senior Software Engineer; AWS, LLMs, Python

Essential Job Functions

• Design, build, and deploy machine learning models and pipelines using Python, AWS services, and Amazon Bedrock.
• Develop scalable APIs and microservices to expose ML/LLM capabilities using FastAPI
• Build automated CI/CD pipelines using Jenkins or Git Lab CI/CD for model training, testing, and deployment with robust monitoring, logging, and alerting for ML systems in production.
• Optimize ML workloads using AWS services such as Sage Maker, Lambda, ECS/EKS, Step Functions, and KMS.
• Familiarity with containerization using Docker and orchestration with ECS, EKS, or Kubernetes.
• Experience implementing RAG pipelines with vector databases (e.g., Open Search, Pinecone, Dynamo
  
  DB, Aurora Postgre
  
  SQL + pgvector)
• Knowledge of modern MLOps tools (MLflow, Sage Maker Pipelines, Weights & Biases)
• Experience working with API frameworks (FastAPI, Flask)
• Background in security, compliance, or responsible AI principles.

• Bachelor’s degree in Computer Science, Information Systems or related discipline with at least 5 years of related experience, or equivalent training and/or work experience.
• System design experience
• Strong experience in object‑oriented development
• Strong experience with cloud technologies
• Strong experience in data storage technologies
• Experience in performance tuning and optimization
• Experience in Dev Ops and CI/CD technologies
• Experience test automation and unit testing
• Experience software security

• Hybrid work environment, with defined in‑person presence requirements.
• Occasional travel and extended hours may be required.

Salary information follows:

For work that is performed in CA, CO, FL, TX, IL, PA, MA, MD, VA, Washington, DC, NY and NJ, please refer to the chart below for the salary range for the corresponding location. In addition to location, actual compensation is based on various factors, including but not limited to, the candidate’s skill set, level of experience, education, and internal peer compensation comparisons.

CA:
Minimum Salary $109,600, Maximum Salary $206,200

CO/FL/TX:
Minimum Salary $95,300, Maximum Salary $171,800

IL/PA:
Minimum Salary $104,900, Maximum Salary $189,400

MA/MD/VA/Washington DC:
Minimum Salary $109,600, Maximum Salary $197,600

NY/NJ:
Minimum Salary $109,600, Maximum Salary $206,200

* Including positions performed outside the state but reporting to an office or manager in that state.

Candidates can expect salary offers that range from the minimum to the mid‑point of the salary range. FINRA provides full pay ranges so that the candidate can consider their growth potential while at FINRA.

#LI‑Hybrid

To be considered for this position, please submit an application.
Applications are accepted on an ongoing basis.

The information provided above has been designed to indicate the general nature and level of work of the position. It is not a comprehensive inventory of all duties, responsibilities and qualifications required.

Please note:
If the “Apply Now” button on a job board posting does not take you directly to the FINRA Careers site, enter (Use the "Apply for this Job" box below). into your browser to reach our site directly.

FINRA strives to make our career site accessible to all users. If you need a disability‑related accommodation for completing the application process, please contact FINRA’s Employee Relations team at  or by email at Employee Relations. Please note that this process is exclusively for inquiries regarding application accommodations.

Employees may be eligible for a discretionary bonus in addition to base pay. Non‑exempt employees are also eligible for overtime pay in accordance with federal, state, or local law. As part of its dedication to employee wellness, FINRA provides comprehensive health, dental and vision insurance. Additional insurance includes basic life, accidental death and dismemberment, supplemental life, spouse/domestic partner and dependent life, accident and dismemberment, short‑ and long‑term disability, long‑term care, business travel accident, disability and legal.

FINRA offers immediate participation and vesting in a 401(k) plan with company match and eligibility for participation in…