[BUG] Investigate High Error Rate for keyvault_secret_list & keyvault_secret_get Tool Calls

[yunjchoi]

Describe the bug

We are observing a high error rate when invoking the following tools:

• keyvault_secret_list
• keyvault_secret_get

These failures appear to be occurring consistently across various versions and may be impacting downstream workflows or feature reliability.

Expected behavior

Tool calls should execute reliably and return expected secret metadata or values from Key Vault.

Actual behavior

Telemetry indicates a significant portion of requests are failing. Error types and frequency require investigation.

Reproduction Steps

Trigger a call to keyvault_secret_list
Trigger a call to keyvault_secret_get
Observe error response

Environment

No response

[github-actions]

Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @JonathanCrd @vcolin7.

[lfraleigh]

key vault errors.csv

Analysis of errors for Key Vault in the last 28 days

[anannya03]

Hi @yunjchoi ,

As part of our recent efforts to reduce the overall tool count in the Azure MCP server, we are consolidating separate list and get tools into a single get tool wherever possible. This consolidation has now been applied to Key Vault secrets as well.

The keyvault_secret_get tool now supports both:

• Listing all secrets within a specified Key Vault (when no secret name is provided), and
• Retrieving detailed information for a specific secret (when a secret name is specified).

I’ve validated this behavior using all prompts listed in e2etestprompts.md, and the correct tool invocation is occurring as expected.

These updates are available starting from Azure MCP server version 2.0.0-beta.19.