We pinned every stable release of 4 official
@modelcontextprotocol/server-*reference servers, diffed each version against the next, and counted every contract change between them. 66 version pairs · 43 clean · 23 pairs with silent changes · 140 findings — not one of them announced in a changelog.
Findings split: 43 BREAKING (schema changed) · 28 ANNOTATION (behavioral hints flipped, compared through spec defaults) · 7 COSMETIC (description reworded) · 1 PROMPT/RESOURCE (server prompt content changed) · 37 NEW items (of them: 24 tools, 5 prompts, 8 resources) · 24 REMOVED.
| Server | Pairs | Clean | Drifted | BREAKING | COSMETIC | ANNOTATION | NEW | REMOVED |
|---|---|---|---|---|---|---|---|---|
| filesystem | 18 | 11 | 7 | 14 | 5 | 14 | 5 | 0 |
| memory | 13 | 10 | 3 | 18 | 0 | 9 | 1 | 0 |
| everything | 27 | 18 | 9 | 9 | 1 | 4 | 31 | 24 |
| sequential-thinking | 8 | 4 | 4 | 2 | 1 | 1 | 0 | 0 |
0.6.2→2025.1.14: 2 new itemsedit_file— appeareddirectory_tree— appeared
2025.3.28→2025.7.1: 1 cosmetic, 1 new itemread_file— cosmetic change- was:
… examine the contents of a single file. Only works within allowed directories. - now:
… examine the contents of a single file. Use the 'head' parameter to read only the first N lines of a file, or …
- was:
list_directory_with_sizes— appeared
2025.7.1→2025.7.29: 2 cosmetic, 2 new itemsread_file— cosmetic change- was:
…Read the complete contents of a file from the file system. Handles various text encodings and provides detaile… - now:
…Read the complete contents of a file as text. DEPRECATED: Use read_text_file instead.
- was:
read_text_file— appearedread_media_file— appearedlist_allowed_directories— cosmetic change- was:
…Returns the list of directories that this server is allowed to access. Use this to understand which directorie… - now:
…Returns the list of root directories that this server is allowed to access. Use this to understand which direc…
- was:
2025.7.29→2025.8.18: 1 cosmeticlist_allowed_directories— cosmetic change- was:
…Returns the list of root directories that this server is allowed to access. Use this to understand which direc… - now:
…Returns the list of directories that this server is allowed to access. Subdirectories within these allowed dir…
- was:
2025.8.21→2025.11.25: 14 breakingread_file— breaking changeread_text_file— breaking changeread_media_file— breaking changeread_multiple_files— breaking changewrite_file— breaking changeedit_file— breaking changecreate_directory— breaking changelist_directory— breaking changelist_directory_with_sizes— breaking changedirectory_tree— breaking changemove_file— breaking changesearch_files— breaking change- was:
…les and directories matching a pattern. Searches through all subdirectories from the starting path. The search… - now:
…les and directories matching a pattern. The patterns should be glob-style patterns that match paths relative t…
- was:
get_file_info— breaking changelist_allowed_directories— breaking change
2026.1.14→2026.7.4: 1 annotationmove_file— annotation change- hints:
{"readOnlyHint":false,"idempotentHint":false,"destructiveHint":false}→{"readOnlyHint":false,"idempotentHint":false,"destructiveHint":true}
- hints:
2026.7.4→2026.7.10: 1 cosmetic, 13 annotationread_file— annotation change- hints:
{"readOnlyHint":true}→{"readOnlyHint":true,"openWorldHint":false}
- hints:
read_text_file— annotation change- hints:
{"readOnlyHint":true}→{"readOnlyHint":true,"openWorldHint":false}
- hints:
read_media_file— cosmetic change- was:
…Read an image or audio file. Returns the base64 encoded data and MIME type. Only works within allowed director… - now:
…Read a file and return it as a base64-encoded content block with its MIME type. Image and audio files are retu…
- was:
read_multiple_files— annotation change- hints:
{"readOnlyHint":true}→{"readOnlyHint":true,"openWorldHint":false}
- hints:
write_file— annotation change- hints:
{"readOnlyHint":false,"idempotentHint":true,"destructiveHint":true}→{"readOnlyHint":false,"idempotentHint":true,"destructiveHint":true,"openWorldHint":false}
- hints:
edit_file— annotation change- hints:
{"readOnlyHint":false,"idempotentHint":false,"destructiveHint":true}→{"readOnlyHint":false,"idempotentHint":false,"destructiveHint":true,"openWorldHint":false}
- hints:
create_directory— annotation change- hints:
{"readOnlyHint":false,"idempotentHint":true,"destructiveHint":false}→{"readOnlyHint":false,"idempotentHint":true,"destructiveHint":false,"openWorldHint":false}
- hints:
list_directory— annotation change- hints:
{"readOnlyHint":true}→{"readOnlyHint":true,"openWorldHint":false}
- hints:
list_directory_with_sizes— annotation change- hints:
{"readOnlyHint":true}→{"readOnlyHint":true,"openWorldHint":false}
- hints:
directory_tree— annotation change- hints:
{"readOnlyHint":true}→{"readOnlyHint":true,"openWorldHint":false}
- hints:
move_file— annotation change- hints:
{"readOnlyHint":false,"idempotentHint":false,"destructiveHint":true}→{"readOnlyHint":false,"idempotentHint":false,"destructiveHint":true,"openWorldHint":false}
- hints:
search_files— annotation change- hints:
{"readOnlyHint":true}→{"readOnlyHint":true,"openWorldHint":false}
- hints:
get_file_info— annotation change- hints:
{"readOnlyHint":true}→{"readOnlyHint":true,"openWorldHint":false}
- hints:
list_allowed_directories— annotation change- hints:
{"readOnlyHint":true}→{"readOnlyHint":true,"openWorldHint":false}
- hints:
2025.8.4→2025.9.24: 9 breakingcreate_entities— breaking changecreate_relations— breaking changeadd_observations— breaking changedelete_entities— breaking changedelete_observations— breaking changedelete_relations— breaking changeread_graph— breaking changesearch_nodes— breaking changeopen_nodes— breaking change
2025.9.25→2025.11.25: 9 breakingcreate_entities— breaking changecreate_relations— breaking changeadd_observations— breaking changedelete_entities— breaking changedelete_observations— breaking changedelete_relations— breaking changeread_graph— breaking changesearch_nodes— breaking changeopen_nodes— breaking change
2026.1.26→2026.7.4: 9 annotation, 1 new itemcreate_entities— annotation change- hints:
null→{"readOnlyHint":false,"destructiveHint":false,"idempotentHint":false,"openWorldHint":false}
- hints:
create_relations— annotation change- hints:
null→{"readOnlyHint":false,"destructiveHint":false,"idempotentHint":false,"openWorldHint":false}
- hints:
add_observations— annotation change- hints:
null→{"readOnlyHint":false,"destructiveHint":false,"idempotentHint":false,"openWorldHint":false}
- hints:
delete_entities— annotation change- hints:
null→{"readOnlyHint":false,"destructiveHint":true,"idempotentHint":true,"openWorldHint":false}
- hints:
delete_observations— annotation change- hints:
null→{"readOnlyHint":false,"destructiveHint":true,"idempotentHint":true,"openWorldHint":false}
- hints:
delete_relations— annotation change- hints:
null→{"readOnlyHint":false,"destructiveHint":true,"idempotentHint":true,"openWorldHint":false}
- hints:
read_graph— annotation change- hints:
null→{"readOnlyHint":true,"destructiveHint":false,"idempotentHint":true,"openWorldHint":false}
- hints:
search_nodes— annotation change- hints:
null→{"readOnlyHint":true,"destructiveHint":false,"idempotentHint":true,"openWorldHint":false}
- hints:
open_nodes— annotation change- hints:
null→{"readOnlyHint":true,"destructiveHint":false,"idempotentHint":true,"openWorldHint":false}
- hints:
knowledge-graph(resource) — appeared
0.6.2→2025.1.14: 1 new itemprintEnv— appeared
2025.1.14→2025.3.19: 1 new itemannotatedMessage— appeared
2025.3.19→2025.4.8: 2 new itemsgetResourceReference— appearedresource_prompt(prompt) — appeared
2025.7.1→2025.7.29: 3 new itemsstartElicitation— appearedgetResourceLinks— appearedstructuredContent— appeared
2025.8.18→2025.9.12: 1 removedstartElicitation— disappeared
2025.9.25→2025.11.25: 1 new itemzip— appeared
2025.12.18→2026.1.14: 1 cosmetic, 22 new items, 23 removedecho— cosmetic changeget-annotated-message— appearedget-env— appearedget-resource-links— appearedget-resource-reference— appearedget-structured-content— appearedget-sum— appearedget-tiny-image— appearedgzip-file-as-resource— appearedtoggle-simulated-logging— appearedtoggle-subscriber-updates— appearedtrigger-long-running-operation— appearedadd— disappearedlongRunningOperation— disappearedprintEnv— disappearedsampleLLM— disappearedgetTinyImage— disappearedannotatedMessage— disappearedgetResourceReference— disappearedgetResourceLinks— disappearedstructuredContent— disappearedzip— disappearedsimple-prompt(prompt) — appearedargs-prompt(prompt) — appearedcompletable-prompt(prompt) — appearedresource-prompt(prompt) — appearedsimple_prompt(prompt) — disappearedcomplex_prompt(prompt) — disappearedresource_prompt(prompt) — disappearedarchitecture.md(resource) — appearedextension.md(resource) — appearedfeatures.md(resource) — appearedhow-it-works.md(resource) — appearedinstructions.md(resource) — appearedstartup.md(resource) — appearedstructure.md(resource) — appearedResource— disappearedResource— disappearedResource— disappearedResource— disappearedResource— disappearedResource— disappearedResource— disappearedResource— disappearedResource— disappearedResource— disappeared
2026.1.14→2026.1.26: 1 new itemsimulate-research-query— appeared
2026.1.26→2026.7.4: 9 breaking, 4 annotationecho— breaking changeget-annotated-message— breaking changeget-env— annotation changeget-resource-links— breaking changeget-resource-reference— breaking changeget-structured-content— breaking changeget-sum— breaking changeget-tiny-image— annotation changegzip-file-as-resource— breaking changetoggle-simulated-logging— annotation changetoggle-subscriber-updates— annotation changetrigger-long-running-operation— breaking changesimulate-research-query— breaking changeargs-prompt(prompt) — drift change
2025.7.1→2025.11.25: 1 breakingsequentialthinking— breaking change- was:
…eration * Hypothesis verification - next_thought_needed: True if you need more thinking, even if at what seeme… - now:
…eration * Hypothesis verification - nextThoughtNeeded: True if you need more thinking, even if at what seemed …
- was:
2025.11.25→2025.12.18: 1 cosmeticsequentialthinking— cosmetic change- was:
…er as the final output 11. Only set next_thought_needed to false when truly done and a satisfactory answer is … - now:
…er as the final output 11. Only set nextThoughtNeeded to false when truly done and a satisfactory answer is re…
- was:
2025.12.18→2026.7.4: 1 annotationsequentialthinking— annotation change- hints:
null→{"readOnlyHint":true,"destructiveHint":false,"idempotentHint":true,"openWorldHint":false}
- hints:
2026.7.4→2026.8.31: 1 breakingsequentialthinking— breaking change
- For each stable version
Vof a server: installV, runrugsnare scan— the baseline pin of{name, description, inputSchema}+ prompts + resources + behavioral annotations. - Install
V+1over it (the silent upgrade an agent would get fromnpx -y), runrugsnare diff. - Every difference is classified deterministically: BREAKING (schema changed, e.g. a required param appeared), COSMETIC (prose reworded), ANNOTATION (behavioral hints flipped — compared through MCP spec defaults, where an absent
destructiveHintmeans destructive). No LLM, no judgment calls.
bash repro/backtest-multi.sh # ~20 minutes, four official servers, full historyCoverage: complete — all 66 stable release pairs across the four servers were measured, zero skipped.
Your agent obeys tool descriptions. When a server changes a description, a schema, or a behavioral hint after you approved it, the agent's instructions change — silently. Scanners check once at install; npx -y pkg@latest re-rolls the dice on every launch. This report is what that looks like on the four servers everyone installs first.
Generated 2026-10-03T09:56:35.994Z by repro/backtest-multi.sh + repro/build-report.mjs ( RugSnare v0.5.1, 66 pairs ). Zero dependencies, no telemetry, every number reproducible on your machine.