OpenSearch Engineer

Job Title: Open Search Engineer

Location: New York, NY

We are seeking a highly skilled Open Search Engineer with strong experience in AWS, .NET, and Python to design, build, optimize, and manage search and analytics solutions. The ideal candidate will have hands‑on expertise with distributed systems, large‑scale search infrastructures, and application development, while supporting enterprise‑grade observability and indexing pipelines.

• Design, deploy, and manage Open Search clusters for high availability, scalability, and performance.
• Create and optimize index mappings, analyzers, tokenizers, relevance models, and search queries.
• Implement Open Search ingestion pipelines using Logstash, Fluent Bit, Beats, or custom ETL.
• Architect and manage cloud infrastructure using:
  • Amazon Open Search Service
  • EC2, S3, Lambda, IAM, Cloud Watch, Kinesis, MSK
• Automate provisioning using Terraform/Cloud Formation (nice to have).
• Implement secure access controls, VPC design, and encryption strategies.
• Build real‑time streaming pipelines for logs, metrics, and application data.
• Develop backend services, APIs, and data pipelines in Python and .NET (C#).
• Write microservices that interface with Open Search queries and aggregations.
• Build automation tools for cluster maintenance, indexing, and monitoring.
• Integrate Open Search with enterprise applications using SDKs/REST APIs.

• 6–8 years of hands‑on experience with Open Search (or Elasticsearch).
• Strong knowledge of:
  • Search indexing concepts
  • Query DSL
  • Aggregations
  • Relevance tuning
  • Solid experience with AWS cloud services.
• Strong programming skills in:
  • Python
  • .NET/C#
• Understanding of distributed systems and cluster architecture.
• Experience with CI/CD pipelines (Git Hub Actions, Azure Dev Ops, Jenkins).
• Strong troubleshooting, analytical, and performance optimization skills.
• Knowledge of containers (Docker) and orchestration (Kubernetes/EKS) is a plus.