Skip to content

Evals - Education and Airline scenarios #140

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 4 commits into
base: main
Choose a base branch
from
Open

Evals - Education and Airline scenarios #140

wants to merge 4 commits into from

Conversation

MahtabSarvmaili
Copy link 

  1. MCP Education Agent example - A tutor agent for educational scenarios
  that guides students with homework
  2. MCP Evaluation Framework - A comprehensive tool for evaluating agent
  performance with metrics for progress rate, grounding accuracy, and task
  completion
  3. Example results and visualizations for airline assistance scenario

@petersonbill64
This commit adds:
aa00708 
      1. MCP Education Agent example - A tutor agent for educational scenarios
      that guides students with homework
      2. MCP Evaluation Framework - A comprehensive tool for evaluating agent
      performance with metrics for progress rate, grounding accuracy, and task
      completion
      3. Example results and visualizations for airline assistance scenario
@petersonbill64
Add agent evaluation framework and test results
fe8f17e 
Implements a comprehensive evaluation framework for MCP agents that measures performance metrics including response time, success rate, and task completion across different examples.
Includes visualization utilities and automated testing tools for benchmarking agents.
@petersonbill64
Add agent evaluation framework and test results
4a37ccb
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@petersonbill64 petersonbill64 Awaiting requested review from petersonbill64

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@MahtabSarvmaili @petersonbill64