Full Stack Developer OpenSearch Development

Full Stack Developer Open Search Development

2 days ago Be among the first 25 applicants

About US: We are a company that provides innovative, transformative IT services and solutions. We are passionate about helping our clients achieve their goals and exceed their expectations. We strive to provide the best possible experience for our clients and employees. We are committed to continuous improvement and innovation, and we are always looking for ways to improve our services and solutions.

We believe in working collaboratively with our clients and employees to achieve success.

DS Technologies Inc is looking for a Full Stack Developer Open Search Development role for one of our premier clients.

Job Title: Full Stack Developer Open Search Development

Team: Open Search Development

Position Type: Contract (Only W2)

Role

Summary:

The Open Search Developer / Data Engineer will design, build, and maintain large‑scale data ingestion, transformation, and indexing pipelines supporting T‑Mobile’s observability and analytics ecosystem. This role is responsible for migrating critical network telemetry and log data from Splunk to Open Search
, implementing efficient ETL processes, and ensuring high‑performing, scalable, and secure data workflows. The engineer will collaborate closely with data scientists, architects, and application developers to optimize search performance, enforce data governance, and reduce operational cost while ensuring reliable and actionable insights from network data.

• Open Search Integration & Administration
• Application & Microservices Development
• Quality, Testing & Deployment
• Governance, Documentation & Collaboration

• Data Engineering & ETL Development
• Design and implement ETL (Extract, Transform, Load) processes to handle complex data ingestion workflows.
• Develop data pipelines to collect, normalize, and route high‑volume log and telemetry data from multiple sources (network, OSS/BSS, application systems).
• Migrate existing data sets from Splunk to Open Search, ensuring data integrity, consistency, and traceability.
• Optimize ingestion and query performance through indexing, partitioning, and caching strategies.
• Configure, manage, and maintain Open Search clusters, ensuring scalability, fault tolerance, and performance optimization.
• Design and implement indexing strategies and mappings for high‑volume network data.
• Implement fine‑grained access control, data lifecycle management, and retention policies.
• Create dashboards and analytics visualizations for operational insights, where applicable.
• Develop Java‑based backend services and utilities that support data ingestion, query processing, and API integrations.
• Write efficient scripts and automation utilities using Python, Perl, or JavaScript for ETL orchestration and validation.
• Develop and maintain Kafka producers/consumers for real‑time event streaming and data flow into Open Search.
• Write and execute unit, integration, and performance tests to validate data migration and ingestion workflows.
• Implement CI/CD automation using Git Lab pipelines for build, test, and deployment.
• Deploy services and data pipelines in Linux‑based environments, ensuring robust monitoring and rollback capabilities.
• Troubleshoot data ingestion or indexing issues and optimize for minimal latency and maximum reliability.
• Establish data governance standards to ensure only relevant and useful data is logged and retained in Open Search.
• Document system architecture, APIs, data schemas, ETL workflows, and deployment pipelines.
• Work with architects, data scientists, and observability leads to align Open Search development with broader platform goals.
• Contribute to the team’s knowledge base and technical best practices for maintainability and future scalability.

• Programming
  
  Languages:
  
  Java, Python, JavaScript, Perl
• Data Engineering: ETL workflow design, data transformation, and ingestion pipeline management
• Search Technologies:
  Open Search (or Elasticsearch), index tuning, query optimization, cluster scaling
• Streaming:
  Kafka (producers, consumers, schema design, delivery guarantees)
• Version Control & CI/CD:
  Git Lab
• Operating Systems:
  L…