What is llmprobe?
llmprobe is a MCP server by Jwrede that synthetic monitoring for cloud and local LLM inference endpoints: TTFT, latency, throughput and errors, with Prometheus and OpenTelemetry export. It is listed under Cloud & infra and has 7 GitHub stars.
| Type | Mcp server |
|---|---|
| Author | Jwrede |
| Repository | Jwrede/llmprobe |
| Popularity | 7 GitHub stars |
| Category | Cloud & infra |
| Security | Low risk (84/100) |
| Rank | #1,982 of 4,418 MCP servers; #107 in Cloud & infra |
| License | MIT |
| Last commit | 2026-05-16 |
| Runs | Locally and in the cloud |
| Language | Go |
| Platforms | macOS, Windows, Linux |
Is llmprobe safe to install?
llmprobe scores 84/100 on the MCPMods security check: Low risk. Things to review: sends your data to a cloud service. It passed 4 of 6 checks.
MCP server results come from listing signals: who publishes it, where your data goes and what it can do. The code itself is not scanned yet.
| Check | Result |
|---|---|
| Community-built server | Note |
| Sends your data to a cloud service | Review |
| No credentials mentioned | Pass |
| Read-only by description | Pass |
| No code execution | Pass |
| Source on GitHub | Pass |
How do I install llmprobe?
- Find the launch command. The README says how the server starts (npx, uvx, docker or a remote URL) and which API keys it needs.
https://github.com/Jwrede/llmprobe
- Add it to Claude Code. Replace the part after -- with the command from the README. Remote servers use --transport http with a URL.
claude mcp add llmprobe -- <command from README> claude mcp add --transport http llmprobe <server-url>
- Check it connected. This lists your MCP servers and their status.
claude mcp list
Or ask Claude to set it up
Paste this into Claude Code and it installs llmprobe for you:
Add the "llmprobe" MCP server from https://github.com/Jwrede/llmprobe to Claude Code. Read its README for the launch command and any API keys I need, run claude mcp add, then check that it connects.