AI-Enhanced Enterprise Search Experience
This case presents the enhancement of The World Bank’s enterprise search as the first entry layer into a broader AI ecosystem, designed to introduce users to AI through one of its most frequently used internal tools. Built on existing search infrastructure powered by Google Vertex AI, it transforms keyword-based retrieval into AI-generated, grounded summaries with full source traceability. The experience also serves as a gateway into conversational AI via an option to continue the query in an AI Chat interface.
Role and Recommendation:
I played a key role in shaping and driving the product evolution from early planning and exploration through implementation, organization-wide rollout, and multiple iterative releases. Worked cross-functionally with engineering, data architecture, and business stakeholders to define workflows and feature logic, align priorities, and translate user and organizational needs into actionable product improvements. Continuous feedback loops, pilot testing, and adoption insights guided ongoing iterations and expansion of the platform capabilities.
Product position at the World Bank's AI Ecosystem
Problem Statement
- Lack of centralized AI governance and guardrailsEmployees increasingly engaged with AI tools without a clear, easily accessible source of guidance on responsible usage, safety boundaries, and internal policies, leading to inconsistency in understanding “how to use AI correctly” across teams.
- Fragmented access to AI knowledge and learning materialsTraining resources, guidelines, and educational content were spread across different internal channels, making it difficult for employees to discover structured learning paths or understand how to effectively apply AI in their day-to-day work.
- Dispersed AI product ecosystem across departmentsAI-driven internal products were being developed independently across multiple units, with no single place to explore, understand, or compare existing solutions, limiting reuse, visibility, and cross-team collaboration.
- Low discoverability of internal AI capabilitiesEmployees often lacked awareness of what AI tools, APIs, and solutions already existed within the organization, leading to duplication of effort and missed opportunities for reuse of existing assets.
- Low discoverability of internal AI capabilitiesEmployees often lacked awareness of what AI tools, APIs, and solutions already existed within the organization, leading to duplication of effort and missed opportunities for reuse of existing assets.
AI-enhanced Product Vision
- Answer-First ExperienceEnterprise search evolves from document discovery to direct, structured answers, enabling employees to receive synthesized insights immediately after query submission.
- Time-Optimized Knowledge FlowTime-efficient knowledge workflows enabling faster access to actionable insights and improved decision-making speed.
- AI Search-to-AI Chat ContinuityAI Search is seamlessly connected with AI Chat, enabling users to continue exploring queries in natural language, ask follow-ups, and extend understanding within a unified AI ecosystem.
- Trusted First Point of SearchEnterprise search becomes the primary access point for World Bank internal knowledge, replacing users’ reliance on external search tools through AI-generated contextual summaries that reduce effort and increase adoption.
High-Level Product Logic. Before vs After AI Integration
AI-enhanced Product
The updated experience was designed to preserve familiarity for existing users while gradually introducing AI capabilities into the established enterprise search workflow, maintaining a largely consistent interface to avoid disrupting frequent usage patterns. At the same time, the product was reintroduced as Enterprise AI Search, highlighting the integration of AI-driven capabilities.
Entry Point
2. Accuracy disclaimers and AI Guardrails were incorporated directly into the entry experience, encouraging users to validate AI-generated information before using it.
3. To support different levels of user familiarity with AI, the interface also introduced suggested prompts as a secondary entry point, allowing users to quickly select pre-defined queries and immediately navigate to relevant results.
AI-Generated Overview Layer
An AI-generated overview layer positioned above traditional search results. This layer provides a synthesized, grounded response to the user’s query, supported by relevant institutional knowledge. Through an “Ask AI Chat” action, users can seamlessly transition from search into a conversational AI experience within the World Bank AI Chat product, enabling deeper exploration and follow-up questions.
5. An integrated Ask AI Chat action allowed users to seamlessly continue the query in a conversational AI environment for deeper exploration and follow-up interaction.
6. Traditional keyword-based search results remained accessible below the AI overview layer, preserving continuity for existing enterprise search workflows while supporting deeper manual exploration when needed.
8. For People-related queries, the system uses structured template that quickly surfaces key profile information such as role, department, reporting line, internal contact details and more, enabling fast identification of relevant colleagues.
9. Traditional search results are enhanced with structured entity cards in specific cases, where relevant profiles are surfaced using keyword-based matching.
10. AI-generated related search suggestions extend the original query by surfacing context-aware follow-up questions, enabling users to further refine exploration of the topic.
Instead of requiring navigation through multiple internal documents or contacting IT support, AI Search delivers an answer-first result that surfaces the relevant information within a structured template.
12. A floating feedback button is available throughout the experience, allowing users to share feedback without leaving the page. This creates a continuous feedback loop that supports iterative improvement.
13. Each regular search result now includes an actions menu, enabling users to provide feedback, save, and share items directly for easier collaboration and future access.
Delivery Process
The product was developed over a 3 year period using an iterative, Agile-based approach, with continuous validation and close cross-functional collaboration.
1. Problem Framing & Product Vision
The process started with identifying key challenges around secure AI usage, fragmented tools, and limited access to internal knowledge.
These insights informed a clear product vision, defining the shift toward a unified, secure, AI-driven workspace for employees.
2. Roadmap Definition
and Alignment
Based on the product vision, a clear and transparent roadmap was established, outlining key milestones, priorities, and expected evolution of the product.
The roadmap was accessible across teams, enabling shared understanding of:
- Product direction
- Scope and priorities
- Team involvement and timelines.
3. Cross-functional Discovery
Early-stage exploration involved close collaboration across product, design, engineering, and architecture.
Work was driven through:
- Collaborative workshops (whiteboards, workshop sessions)
- Alignment discussions with technical architects
- Iterative exploration of possible solutions
- This helped translate complex requirements into feasible product directions.
4. Agile Delivery
via Azure DevOps
The delivery process was structured using MS Azure DevOps, with work broken down into:
- Epics
- User stories
- Tasks
This ensured clear traceability from high-level goals to implementation.
5. Sprint Execution
and Scrum
Development followed an Agile sprint cycle, including:
- Sprint planning
- Backlog grooming
- Daily syncs
- Sprint reviews
- Regular Scrum ceremonies ensured alignment, prioritization, and continuous progress across teams.
6. Iterative Development
Each phase incorporated iterative improvements, with 3 Beta cycles focused on validating user feedback and continuously refining retrieval quality, AI grounding, and overall search experience.
7. User Feedback and Validation
Continuous feedback loops were embedded throughout the process via:
- Usability testing sessions
- Internal feedback channels
- Direct user observation
- Insights were used to refine features, improve usability, and guide prioritization.
8. Continuous Alignment & Delivery
Ongoing collaboration across teams ensured alignment between:
- User needs
- Technical constraints
- Business goals
- This enabled consistent delivery of a complex product while maintaining clarity, usability, and strategic direction.
- 80%Reduction in Manual Discovery Time
Significant decrease in time spent manually navigating, filtering, and reviewing information across systems and result pages.
- 75%AI Search-to-Chat Engagement
A significant share of users continued their discovery flow into AI Chat, using follow-up questions and conversational exploration to deepen understanding beyond initial search results.
- 70%Reduction in Time-to-Answer
AI-powered response generation reduced the time required to identify, review, and synthesize information across enterprise-scale knowledge, with grounded answers delivered in an average of 3 seconds.
- 65%Increase in Enterprise Search Reliance
AI-generated grounded answers improved confidence in internal enterprise search, reducing dependency on external search tools and fragmented knowledge discovery.
© Fox Alice
