Search Relevance Product Manager – eCommerce

Responsibilities

• Own search relevance strategy, including ranking signals and query understanding
• Define and evolve ranking policies (availability, price, popularity, fitment, recency)
• Lead improvements in query handling (synonyms, typo correction, rewriting)
• Run a zero-results reduction program with effective fallbacks
• Establish quality gates (offline evaluation + A/B testing) for all releases
• Design and evaluate experiments to drive measurable improvements
• Build and maintain a gold standard evaluation dataset ("truth set")
• Prioritize and deliver a relevance roadmap across key query types
• Work closely with Engineering and Data Science to define features, signals, and evaluation criteria

• Business Analysis:
  Knowledge of business analysis and the set of tasks, techniques and tools required to identify business needs; ability to recommend solutions that deliver value to stakeholders.
• Decision Making and Critical Thinking:
  Knowledge of the decision-making process and associated tools and techniques; ability to accurately analyze situations and reach productive decisions based on informed judgment.
• Software Change Request Management:
  Knowledge of software change request management; ability to manage software product change requests from customers, prospective customers, vendors, and internal staff.
• Software Engineering:
  Knowledge of software engineering; ability to deliver new or enhanced fee-based software products.
• Software Product Business Knowledge:
  Knowledge of and experience with the business aspects and operation of a software product; ability to manage install base, current uses, future plans, and product vision.
• User Acceptance Testing (UAT):
  Knowledge of UAT activities, tasks, tools and techniques; ability to design, implement and evaluate acceptance tests for end-users.
• Consideration for top candidates:
  Experience with search platforms (e.g., Elasticsearch, Solr, vector or hybrid search)
• Experience with LLM-powered search or query understanding, including semantic search, embeddings, or retrieval augmented generation
• Experience with eCommerce search behavior (e.g., part number, fitment, attribute-driven queries)
• Digital product management, user experience, user research, digital strategy, or related function
• Experience managing projects using Product Management and/or Agile software tools such as Aha, Product Board, Azure Dev Ops
• Human-centered design, lean innovation, or design thinking methodologies
• Product Owner certification (Certified Scrum Product Owner from Scrum Alliance)
• Knowledge of Software Development Lifecycle (SDLC) and demonstrated experience employing SDLC in aspects of the project management process
• Improved NDCG@10 and MRR (ranking quality)
• Reduced zero-results rate
• Fewer manual fixes (boosts, one-off rules) over time
• 5–7 years of product management experience in search, recommendations, or data-driven products
• Hands‑on experience designing and interpreting A/B tests and experiments
• Strong understanding of ranking, relevance, or information retrieval concepts
• Ability to define and use metrics and evaluation frameworks (e.g., NDCG, MRR, CTR)
• Experience working closely with Data Science or ML teams
• Proven ability to lead complex, cross‑functional initiatives
• Strong analytical thinking and communication skills