mcp-evals
A Node.js package and GitHub Action for evaluating MCP (Model Context Protocol) tool implementations using LLM-based scoring.
No README could be loaded. View the project on GitHub for full documentation.
Frequently asked questions
What is mcp-evals?
mcp-evals is A Node.js package and GitHub Action for evaluating MCP (Model Context Protocol) tool implementations using LLM-based scoring.
How do I install mcp-evals?
Open the GitHub repository and follow its README. Most MCP servers are added to your client's MCP config, then called by your agent.
Is mcp-evals open source?
Yes — it is hosted on GitHub at https://github.com/mclenhard/mcp-evals and has 116 stars.
Related MCP tools
mastraThe TypeScript AI agent framework. ⚡ Assistants, RAG, observability. Supports any LLM: GPT-4, Claude, Gemini, Llama. Built for the Model Context Protocol to enh
librechatEnhanced ChatGPT Clone: Features Agents, MCP, DeepSeek, Anthropic, AWS, OpenAI, Responses API, Azure, Groq, o1, GPT-5, Mistral, OpenRouter, Vertex AI, Gemini...
composioComposio equips your AI agents & LLMs with 100+ high-quality integrations via function calling for the Model Context Protocol. Enhance AI assistants with powerf
repomix📦 Repomix is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to Large Lan...
plateRich-text editor with AI, MCP, and shadcn/ui TypeScript-based implementation. Trusted by 15300+ developers. Trusted by 15300+ developers.
figma-context-mcpMCP server to provide Figma layout information to AI coding agents like Cursor TypeScript-based implementation. Trusted by 11600+ developers.
Run your own MCP server? See who uses it and what to fix.
Measure it with TrackMCP