Fix: consolidated get_azure_ai_resources_details tool not triggered by Cognitive Search / knowledge source prompts#3041
Open
LarryOsterman with Copilot wants to merge 3 commits into
Open
Fix: consolidated get_azure_ai_resources_details tool not triggered by Cognitive Search / knowledge source prompts#3041LarryOsterman with Copilot wants to merge 3 commits into
get_azure_ai_resources_details tool not triggered by Cognitive Search / knowledge source prompts#3041LarryOsterman with Copilot wants to merge 3 commits into
Conversation
|
Azure Pipelines: Successfully started running 1 pipeline(s). There may be pipelines that require an authorized user to comment /azp run to run. |
…xplicitly mention Cognitive Search, knowledge sources, knowledge bases, and indexes
…(under 500 chars)
Copilot
AI
changed the title
[WIP] Fix prompts for get_azure_ai_resources_details tool in consolidated mode
Fix: consolidated Jul 14, 2026
get_azure_ai_resources_details tool not triggered by Cognitive Search / knowledge source prompts
LarryOsterman
approved these changes
Jul 15, 2026
LarryOsterman
requested review from
RickWinter,
chidozieononiwu,
jongio,
msalaman,
saikoumudi,
tmeschter and
vukelich
|
Azure Pipelines: Successfully started running 1 pipeline(s). There may be pipelines that require an authorized user to comment /azp run to run. |
Contributor
There was a problem hiding this comment.
Pull request overview
Updates the consolidated-mode tool description for get_azure_ai_resources_details so user prompts about Azure AI Search / Azure Cognitive Search (services, indexes, knowledge sources, knowledge bases) are more likely to route to the correct consolidated tool rather than falling back to unrelated tooling.
Changes:
- Expanded
get_azure_ai_resources_detailsdescription to explicitly include common Azure AI Search / Azure Cognitive Search vocabulary and operations (list/get/query). - Added a changelog entry documenting the routing/description fix.
Invoking Livetests
Copilot submitted PRs are not trustworthy by default. Users with write access to the repo need to validate the contents of this PR before leaving a comment with the text /azp run mcp - pullrequest - live. This will trigger the necessary livetest workflows to complete required validation.
Reviewed changes
Copilot reviewed 2 out of 2 changed files in this pull request and generated 1 comment.
| File | Description |
|---|---|
| servers/Azure.Mcp.Server/src/Resources/consolidated-tools.json | Refines consolidated tool description keywords for better prompt routing to Azure AI Search/Cognitive Search operations. |
| servers/Azure.Mcp.Server/changelog-entries/copilot-fix-ai-search-consolidated-description.yml | Adds a Bug Fixes changelog entry describing the consolidated description update. |
| { | ||
| "name": "get_azure_ai_resources_details", | ||
| "description": "Get details about Azure AI resources including listing and querying AI Search services, knowledge base and source information.", | ||
| "description": "Get details about Azure AI Search (also known as Azure Cognitive Search) services, indexes, knowledge sources, and knowledge bases. List all Cognitive Search services in a subscription; list or get details of indexes (knowledge indexes) in a search service; list or get details of knowledge sources in a search service; list or get details of knowledge bases in a search service; or query an Azure AI Search index for specific content.", |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
In consolidated mode, the AI model failed to route prompts about "Cognitive Search services", "knowledge sources", and "indexes" to
get_azure_ai_resources_details— instead falling back to Azure CLI or unrelated tools. Root cause: the tool description lacked the exact vocabulary users employ.Changes
servers/Azure.Mcp.Server/src/Resources/consolidated-tools.json: Rewroteget_azure_ai_resources_detailsdescription to explicitly surface all covered capabilities and their common aliases:"Get details about Azure AI resources including listing and querying AI Search services, knowledge base and source information.""Get details about Azure AI Search (also known as Azure Cognitive Search) services, indexes, knowledge sources, and knowledge bases. List all Cognitive Search services in a subscription; list or get details of indexes (knowledge indexes) in a search service; list or get details of knowledge sources in a search service; list or get details of knowledge bases in a search service; or query an Azure AI Search index for specific content."Key terms added: Cognitive Search, knowledge indexes, knowledge sources, explicit listing/getting actions per resource type.
changelog-entries/: Added bug fix entry.