Skip to main content
MCP Failure ObservatoryBuilt on MCP Failure Lab + Sanity
OverviewTest RunsFindingsComparisons
◈ Powered by Sanity

Compatibility intelligence

MCP Failure Observatory

Explore how MCP implementations handle real failure scenarios across transports.

View on GitHub
Data synced Nov 15, 2026, 11:08 AM2995943
Implementations1476 scenarios represented
Test Runs926Across all scenarios
Findings11Captured observations
Verified11Human-confirmed findings

Compatibility Matrix

Latest recorded outcome for each implementation and scenario

76 scenarios
Latest compatibility result for each implementation and scenario
ImplementationLate Response After CancellationBaselineDelayDelay TimeoutDuplicateLiveness LegacyMalformed MissingMalformed VersionMalformed BothLate CancellationDisconnectSession LossHang TimeoutLiveness ModernDuplicate ResponseBounded DelayDelay Timeout and RecoveryHang Timeout/Cancellation and RecoveryInitializeInjected Disconnect ObservedList All Five ToolsMissing/Invalid JSON-RPC Detection and RecoveryPing ToolProtocol PingReject Result-With-Error and RecoverSame-Client Recovery After DisconnectAuthenticated get_meTool Filter ExclusionInvalid AuthorizationMissing AuthorizationRegressing progressBaseline Ping64 KiB response recoveryResult With Error RecoveryBounded delayDuplicate Response RecoveryUnknown progress tokenMissing Jsonrpc RecoveryInvalid Jsonrpc Version RecoveryProgress after completionLivenessSession Loss AvailabilityTwo-second Delay Timeout and RecoveryMissing JSON-RPC VersionInvalid JSON-RPC VersionLate Response After CancellationDisconnect RecoveryProtocol LivenessTimeout RecoveryDisconnect ReconnectResponse After Cancellation RecoveryHang Timeout RecoverySession Loss After Response250 ms Bounded DelayResult and Error ResponseBaseline Echo400 ms TimeoutRecovery After TimeoutInvalid Tool InputRecovery After Input ErrorCleanup After Timeout500 ms Bounded DelayNormal CleanupLiveness SuccessLiveness RejectedLiveness TimeoutSession Loss During Active RequestProtocol Ping LivenessHang Cancellation RecoveryRequested Modern Liveness FallbackClean Install StartupNew Session After ReconnectGraceful Proxy ShutdownControl Route IsolationPrimary Auto-ReconnectPrimary Child Disconnect
C#C# MCP SDKv2.2.0——————————————————————————————————————————————————
GitHub MCP Serverv1.12.2————————————————————————————————————————————————————————————————————————
GOGo MCP SDKv1.8.0—————————————————————————————————————————
Java MCP SDKv2.0.1———————————————————————————————————————————————————————
MCP Inspector CLIv2.7.0—————————————————————————————————————————————————————————————————
Official Everything Serverv2026.8.31————————————————————————————————————————————————————————————————————
Python MCP SDKv2.3.0—————————————————————————————————————
Ruby MCP SDKv1.6.1—————————————————————————————————————————————————————————————————
RRust MCP SDKv3.4.0——————————————————————————————————————————————————
Supergatewayv4.0.0——————————————————————————————————————————————————————————————————
TypeScript MCP SDKv2.4.0—————————————————————————————————————
punkpeye/mcp-proxyv6.7.19——————————————————————————————————————————————————————————————————
sparfenyuk/mcp-proxyv0.12.0———————————————————————————————————————————————————————————————————
tbxark/mcp-proxyv1.1.0———————————————————————————————————————————————————————————————
PassedFailedNeeds reviewUnsupportedNot runN/A

Shows stdio when available. Transport detail remains in each test run.

Recent Test Runs

Latest records added to the observatory

8 shown
GO
Go MCP SDKRegressing progress
stdioNeeds reviewNov 4, 2026
GO
Go MCP SDKRegressing progress
stdioNeeds reviewNov 4, 2026
GO
Go MCP SDKRegressing progress
HTTPNeeds reviewNov 4, 2026
GO
Go MCP SDK64 KiB response recovery
HTTPPassedNov 4, 2026
GO
Go MCP SDKDuplicate Response Recovery
HTTPPassedNov 4, 2026
GO
Go MCP SDKRegressing progress
stdioNeeds reviewNov 4, 2026
GO
Go MCP SDKRegressing progress
HTTPNeeds reviewNov 4, 2026
GO
Go MCP SDKUnknown progress token
HTTPNeeds reviewNov 4, 2026

MCP compatibility data, with evidence and limitations in context.

Methodology & limitationsSource codeMCP Failure Lab