Backtestslitellmrun-20261111-220245#24769

Issue #24769 Merged fix PR # Run 11 Nov 2026 · run-20261111-220245 BerriAI/litellm

MCP Registry: Browserbase server has wrong npm package name

Better

Our patch was judged better than the merged fix.

In this judgment, Patch A = our agent, Patch B = the merged fix.

Both patches apply the exact fix the issue asks for: Browserbase now launches `@browserbasehq/mcp`. Patch A makes that change plus two closely analogous one-line corrections (tavily, playwright) and adds focused tests in the existing registry test class that pin the correct package names and would fail on the old `@anthropic/...` values. Patch B bundles the fix into a sweeping registry overhaul: it deletes eight server entries (discord, sqlite, mysql, google_calendar, obsidian, docker, shopify, twilio), renames env vars for MongoDB and Supabase, switches Redis and AWS from npx to uvx (introducing a new runtime dependency in the container), adds a GEMINI_API_KEY requirement to Browserbase, appends `--headless` to Playwright, and edits a UI test. None of these changes are asked for, none can be verified from the evidence, and several are breaking for users who already configured those entries or lack uvx. That churn adds real risk and obscures the actual fix. B's single test asserting no `@anthropic/` scoped packages remain is reasonable but less precise than A's assertions of the correct package names. On correctness both resolve the ticket; on tests A is at least as good; on scope A is clearly better. A wins.

Four judges ruled on this ticket in parallel, and the verdict comes from counting their votes. Each saw the issue and the two patches, labelled A and B in random order (two of them saw ours as A), with issue links and version numbers removed. Where tests could check the fix, they also saw the results of tests a separate agent wrote for the issue, run on both patches. None was told which patch was ours. The reasoning above is one judge's, shown verbatim.

Solve

11m 19s

Wall-clock time in the container

Full test suite

No new failures

130 passed · 0 skipped · 130 total

Contamination audit

Clean

No sign the agent saw the real fix

Patch size

30vs 178 merged

Changed lines, ours vs merged

Bug

The built-in MCP registry (litellm/proxy/mcp_registry.json) defines the Browserbase server with the wrong npm package name:

Current (broken):

"command": "npx",
"args": ["-y", "@anthropic/mcp-server-browserbase"]

Correct:

"command": "npx",
"args": ["-y", "@browserbasehq/mcp"]

Error

npm error 404 Not Found - GET https://registry.npmjs.org/@anthropic%2fmcp-server-browserbase - Not found
npm error 404  The requested resource '@anthropic/mcp-server-browserbase@*' could not be found or you do not have permission to access it.

Steps to Reproduce

  1. Go to LiteLLM UI → MCP Servers → Add from registry → Browserbase
  2. Enter API key and Project ID
  3. Save and wait 30s
  4. Tool discovery fails with 404 from npm

Fix

Update litellm/proxy/mcp_registry.json line ~311:

-  "args": ["-y", "@anthropic/mcp-server-browserbase"],
+  "args": ["-y", "@browserbasehq/mcp"],

Verified @browserbasehq/mcp works correctly inside the LiteLLM container.

The two patches

Our patch+27 −3
litellm/proxy/mcp_registry.jsonindex 70e81f127c..245269f127 100644@@ -278,7 +278,7 @@       "registry_url": null,       "transport": "stdio",       "command": "npx",-      "args": ["-y", "@anthropic/mcp-server-tavily"],+      "args": ["-y", "tavily-mcp"],       "env_vars": [         {"name": "TAVILY_API_KEY", "description": "Tavily API Key", "secret": true}       ]@@ -304,7 +304,7 @@       "registry_url": null,       "transport": "stdio",       "command": "npx",-      "args": ["-y", "@anthropic/mcp-server-playwright"],+      "args": ["-y", "@playwright/mcp"],       "env_vars": []     },     {@@ -316,7 +316,7 @@       "registry_url": null,       "transport": "stdio",       "command": "npx",-      "args": ["-y", "@anthropic/mcp-server-browserbase"],+      "args": ["-y", "@browserbasehq/mcp"],       "env_vars": [         {"name": "BROWSERBASE_API_KEY", "description": "Browserbase API Key", "secret": true},         {"name": "BROWSERBASE_PROJECT_ID", "description": "Browserbase Project ID", "secret": false}tests/unit/proxy/_experimental/mcp_server/test_mcp_discovery.pyindex d35cb7234d..3766f6c500 100644@@ -91,6 +91,30 @@ class TestMCPRegistryFile:         assert linear["url"] == "https://mcp.linear.app/mcp"         assert "/sse" not in linear["url"] +    def test_browserbase_launches_published_npm_package(self, registry_path):+        """npx must fetch Browserbase's own @browserbasehq/mcp; @anthropic/mcp-server-browserbase 404s on npm."""+        with open(registry_path, "r") as f:+            data = json.load(f)+        browserbase: Final = next(s for s in data["servers"] if s["name"] == "browserbase")+        assert browserbase["transport"] == "stdio"+        assert browserbase["command"] == "npx"+        assert browserbase["args"] == ["-y", "@browserbasehq/mcp"], browserbase["args"]++    @pytest.mark.parametrize(+        "server_name, package",+        [("tavily", "tavily-mcp"), ("playwright", "@playwright/mcp")],+    )+    def test_server_launches_published_npm_package(+        self, registry_path, server_name, package+    ):+        """npx must fetch the vendor's published package, not a nonexistent @anthropic/mcp-server-* name."""+        with open(registry_path, "r") as f:+            data = json.load(f)+        server: Final = next(s for s in data["servers"] if s["name"] == server_name)+        assert server["transport"] == "stdio"+        assert server["command"] == "npx"+        assert server["args"] == ["-y", package], server["args"]+     def test_well_known_servers_present(self, registry_path):         """Ensure key well-known MCPs are in the registry."""         with open(registry_path, "r") as f: 
Merged fix · PR #+47 −131
litellm/proxy/mcp_registry.jsonindex 70e81f127c9..17b77201fe7 100644@@ -77,20 +77,6 @@         {"name": "SLACK_TEAM_ID", "description": "Slack Team/Workspace ID", "secret": false}       ]     },-    {-      "name": "discord",-      "title": "Discord",-      "description": "Discord server management, messaging, and bot integration",-      "icon_url": "https://cdn.simpleicons.org/discord",-      "category": "Communication",-      "registry_url": null,-      "transport": "stdio",-      "command": "npx",-      "args": ["-y", "@anthropic/mcp-server-discord"],-      "env_vars": [-        {"name": "DISCORD_BOT_TOKEN", "description": "Discord Bot Token", "secret": true}-      ]-    },     {       "name": "postgresql",       "title": "PostgreSQL",@@ -105,37 +91,6 @@         {"name": "POSTGRES_CONNECTION_STRING", "description": "PostgreSQL connection string (e.g., postgresql://user:pass@host:5432/db)", "secret": true}       ]     },-    {-      "name": "sqlite",-      "title": "SQLite",-      "description": "Query and manage SQLite databases",-      "icon_url": "https://cdn.simpleicons.org/sqlite",-      "category": "Databases",-      "registry_url": null,-      "transport": "stdio",-      "command": "npx",-      "args": ["-y", "@modelcontextprotocol/server-sqlite"],-      "env_vars": [-        {"name": "SQLITE_DB_PATH", "description": "Path to SQLite database file", "secret": false}-      ]-    },-    {-      "name": "mysql",-      "title": "MySQL",-      "description": "Query and manage MySQL databases",-      "icon_url": "https://cdn.simpleicons.org/mysql",-      "category": "Databases",-      "registry_url": null,-      "transport": "stdio",-      "command": "npx",-      "args": ["-y", "@anthropic/mcp-server-mysql"],-      "env_vars": [-        {"name": "MYSQL_HOST", "description": "MySQL host", "secret": false},-        {"name": "MYSQL_USER", "description": "MySQL username", "secret": false},-        {"name": "MYSQL_PASSWORD", "description": "MySQL password", "secret": true},-        {"name": "MYSQL_DATABASE", "description": "MySQL database name", "secret": false}-      ]-    },     {       "name": "mongodb",       "title": "MongoDB",@@ -145,9 +100,9 @@       "registry_url": null,       "transport": "stdio",       "command": "npx",-      "args": ["-y", "@anthropic/mcp-server-mongodb"],+      "args": ["-y", "mongodb-mcp-server"],       "env_vars": [-        {"name": "MONGODB_CONNECTION_STRING", "description": "MongoDB connection string", "secret": true}+        {"name": "MDB_MCP_CONNECTION_STRING", "description": "MongoDB connection string", "secret": true}       ]     },     {@@ -158,10 +113,13 @@       "category": "Databases",       "registry_url": null,       "transport": "stdio",-      "command": "npx",-      "args": ["-y", "@anthropic/mcp-server-redis"],+      "command": "uvx",+      "args": ["redis-mcp-server"],       "env_vars": [-        {"name": "REDIS_URL", "description": "Redis connection URL (e.g., redis://localhost:6379)", "secret": true}+        {"name": "REDIS_HOST", "description": "Redis host (e.g., localhost)", "secret": false},+        {"name": "REDIS_PORT", "description": "Redis port (e.g., 6379)", "secret": false},+        {"name": "REDIS_USERNAME", "description": "Redis username", "secret": false},+        {"name": "REDIS_PWD", "description": "Redis password", "secret": true}       ]     },     {@@ -202,21 +160,6 @@       "url": "https://drivemcp.googleapis.com/mcp/v1",       "env_vars": []     },-    {-      "name": "google_calendar",-      "title": "Google Calendar",-      "description": "Manage events and calendars in Google Calendar",-      "icon_url": "https://cdn.simpleicons.org/googlecalendar",-      "category": "Productivity",-      "registry_url": null,-      "transport": "stdio",-      "command": "npx",-      "args": ["-y", "@anthropic/mcp-server-google-calendar"],-      "env_vars": [-        {"name": "GOOGLE_CLIENT_ID", "description": "Google OAuth Client ID", "secret": false},-        {"name": "GOOGLE_CLIENT_SECRET", "description": "Google OAuth Client Secret", "secret": true}-      ]-    },     {       "name": "microsoft_365",       "title": "Microsoft 365 (Graph)",@@ -228,20 +171,6 @@       "url": "http://localhost:3000/mcp",       "env_vars": []     },-    {-      "name": "obsidian",-      "title": "Obsidian",-      "description": "Read, search, and manage Obsidian vault notes and files",-      "icon_url": "https://cdn.simpleicons.org/obsidian",-      "category": "Productivity",-      "registry_url": null,-      "transport": "stdio",-      "command": "npx",-      "args": ["-y", "@anthropic/mcp-server-obsidian"],-      "env_vars": [-        {"name": "OBSIDIAN_VAULT_PATH", "description": "Path to Obsidian vault directory", "secret": false}-      ]-    },     {       "name": "brave_search",       "title": "Brave Search",@@ -278,7 +207,7 @@       "registry_url": null,       "transport": "stdio",       "command": "npx",-      "args": ["-y", "@anthropic/mcp-server-tavily"],+      "args": ["-y", "tavily-mcp"],       "env_vars": [         {"name": "TAVILY_API_KEY", "description": "Tavily API Key", "secret": true}       ]@@ -304,7 +233,7 @@       "registry_url": null,       "transport": "stdio",       "command": "npx",-      "args": ["-y", "@anthropic/mcp-server-playwright"],+      "args": ["-y", "@playwright/mcp", "--headless"],       "env_vars": []     },     {@@ -316,10 +245,11 @@       "registry_url": null,       "transport": "stdio",       "command": "npx",-      "args": ["-y", "@anthropic/mcp-server-browserbase"],+      "args": ["-y", "@browserbasehq/mcp"],       "env_vars": [         {"name": "BROWSERBASE_API_KEY", "description": "Browserbase API Key", "secret": true},-        {"name": "BROWSERBASE_PROJECT_ID", "description": "Browserbase Project ID", "secret": false}+        {"name": "BROWSERBASE_PROJECT_ID", "description": "Browserbase Project ID", "secret": false},+        {"name": "GEMINI_API_KEY", "description": "Gemini API Key for the default Stagehand model", "secret": true}       ]     },     {@@ -330,8 +260,8 @@       "category": "Cloud",       "registry_url": null,       "transport": "stdio",-      "command": "npx",-      "args": ["-y", "@anthropic/mcp-server-aws"],+      "command": "uvx",+      "args": ["awslabs.aws-api-mcp-server"],       "env_vars": [         {"name": "AWS_ACCESS_KEY_ID", "description": "AWS Access Key ID", "secret": true},         {"name": "AWS_SECRET_ACCESS_KEY", "description": "AWS Secret Access Key", "secret": true},@@ -361,18 +291,6 @@       "args": ["-y", "@modelcontextprotocol/server-filesystem"],       "env_vars": []     },-    {-      "name": "docker",-      "title": "Docker",-      "description": "Manage Docker containers, images, and networks",-      "icon_url": "https://cdn.simpleicons.org/docker",-      "category": "System",-      "registry_url": null,-      "transport": "stdio",-      "command": "npx",-      "args": ["-y", "@anthropic/mcp-server-docker"],-      "env_vars": []-    },     {       "name": "stripe",       "title": "Stripe",@@ -384,36 +302,6 @@       "url": "https://mcp.stripe.com",       "env_vars": []     },-    {-      "name": "shopify",-      "title": "Shopify",-      "description": "Manage Shopify stores, products, orders, and customers",-      "icon_url": "https://cdn.simpleicons.org/shopify",-      "category": "E-Commerce",-      "registry_url": null,-      "transport": "stdio",-      "command": "npx",-      "args": ["-y", "@anthropic/mcp-server-shopify"],-      "env_vars": [-        {"name": "SHOPIFY_ACCESS_TOKEN", "description": "Shopify Admin API Access Token", "secret": true},-        {"name": "SHOPIFY_STORE_URL", "description": "Shopify Store URL (e.g., mystore.myshopify.com)", "secret": false}-      ]-    },-    {-      "name": "twilio",-      "title": "Twilio",-      "description": "Send SMS, make calls, and manage communication via Twilio",-      "icon_url": "/ui/assets/logos/twilio.svg",-      "category": "Communication",-      "registry_url": null,-      "transport": "stdio",-      "command": "npx",-      "args": ["-y", "@anthropic/mcp-server-twilio"],-      "env_vars": [-        {"name": "TWILIO_ACCOUNT_SID", "description": "Twilio Account SID", "secret": false},-        {"name": "TWILIO_AUTH_TOKEN", "description": "Twilio Auth Token", "secret": true}-      ]-    },     {       "name": "supabase",       "title": "Supabase",@@ -423,10 +311,9 @@       "registry_url": null,       "transport": "stdio",       "command": "npx",-      "args": ["-y", "@anthropic/mcp-server-supabase"],+      "args": ["-y", "@supabase/mcp-server-supabase"],       "env_vars": [-        {"name": "SUPABASE_URL", "description": "Supabase Project URL", "secret": false},-        {"name": "SUPABASE_SERVICE_ROLE_KEY", "description": "Supabase Service Role Key", "secret": true}+        {"name": "SUPABASE_ACCESS_TOKEN", "description": "Supabase Personal Access Token", "secret": true}       ]     }   ]tests/unit/proxy/test_mcp_registry.pynew file mode 100644index 00000000000..86990486be6@@ -0,0 +1,30 @@+import json+from collections.abc import Iterator, Mapping, Sequence+from pathlib import Path+from typing import Final++import litellm.proxy++REGISTRY_SERVERS: Final[Sequence[Mapping[str, object]]] = json.loads(+    (Path(litellm.proxy.__file__).parent / "mcp_registry.json").read_text()+)["servers"]+++def _scoped_npm_packages() -> Iterator[str]:+    for server in REGISTRY_SERVERS:+        if server.get("command") != "npx":+            continue+        args = server.get("args")+        yield from (arg for arg in args if isinstance(arg, str) and arg.startswith("@")) if isinstance(args, list) else ()+++def test_no_stdio_server_installs_from_the_nonexistent_anthropic_npm_scope() -> None:+    """+    https://github.com/BerriAI/litellm/issues/24769 - picking one of these from the discovery+    page failed tool discovery with an npm 404. registry.npmjs.org answered 404 for every+    `@anthropic/mcp-server-*` name the registry used when checked on 2026-09-29+    """+    packages: Final = tuple(_scoped_npm_packages())++    assert packages+    assert [package for package in packages if package.startswith("@anthropic/")] == []ui/litellm-dashboard/src/app/(dashboard)/mcp-servers/_components/mcp_discovery.integration.test.tsxindex 02e04a0aa97..5aeb0cbf45a 100644@@ -57,7 +57,6 @@ describe("MCPDiscovery", () => {       ["exa", "/ui/assets/logos/exa_ai.png"],       ["tavily", "/ui/assets/logos/tavily.png"],       ["slack", "/ui/assets/logos/slack.svg"],-      ["twilio", "/ui/assets/logos/twilio.svg"],       [         "playwright",         "https://raw.githubusercontent.com/microsoft/playwright/2f6148bcd1a96ec687d55ce08645fc6315b1514e/packages/recorder/public/playwright-logo.svg",