Home › Evaluation Tools › EvoMaster

EvoMaster - AI Evaluation Tools Tool

Overview

EvoMaster is an open-source tool for automatically generating system-level test cases and performing fuzzing on web and enterprise applications, with first-class support for APIs (REST, GraphQL, RPC). It applies search-based and evolutionary techniques to explore application behavior, aiming to discover faults, exceptions, and security-relevant failures without requiring extensive manual test scripting. EvoMaster can be used to produce executable tests that exercise real deployments and integrate into continuous-integration workflows. According to the GitHub repository, EvoMaster is actively maintained (657 stars, 101 forks, 23 contributors) under the LGPL-3.0 license with commits as recent as 2026-01-09. The project is designed to work at the system level against running services and can be configured to drive HTTP-based APIs. Typical use cases include automated regression test generation, API fuzzing during CI, and augmenting manual test suites with generated test cases to increase fault detection and coverage.

GitHub Statistics

  • Stars: 657
  • Forks: 101
  • Contributors: 23
  • License: LGPL-3.0
  • Primary Language: Kotlin
  • Last Updated: 2026-01-09T11:01:58Z
  • Latest Release: v5.0.0

The repository shows healthy community interest with 657 stars and 101 forks and a modest contributor base (23 contributors). The LGPL-3.0 license makes it usable within many open-source and mixed-source workflows. Recent commits (last recorded 2026-01-09) indicate ongoing maintenance. Activity suggests a mature research-to-engineering project: active issue reports and PRs are handled by a small core team, suitable for users comfortable with open-source tooling and occasional tooling adjustments.

Installation

Install via docker:

git clone https://github.com/WebFuzzing/EvoMaster.git
docker build -t evomaster https://github.com/WebFuzzing/EvoMaster.git
docker run --rm evomaster --help

Key Features

  • Automated system-level test generation using evolutionary/search-based algorithms
  • Targets HTTP APIs including REST and GraphQL endpoints and other RPC-style interfaces
  • Produces executable, repeatable tests suitable for CI integration and regression suites
  • Configurable search budgets and generation strategies to control run time and depth
  • Fault detection and assertion generation to surface exceptions and failing responses

Community

EvoMaster has a focused, active open-source community (657 stars, 101 forks, 23 contributors). Development is ongoing with recent commits and issue/PR activity on GitHub. Users typically engage via the repository issue tracker for bug reports, feature requests, and support; contributions and reproducible test cases are welcomed.

Last Refreshed: 2026-01-09

Key Information

  • Category: Evaluation Tools
  • Type: AI Evaluation Tools Tool
Visit Official Website

Related Tools

Lighteval

An all-in-one toolkit for evaluating LLMs on multiple backends, offering detailed sample-by-sample performance metrics and task customization options.
AI-DEBAT

AI-DEBAT is a Streamlit-based web app that enables users to pit two AI models against each other in a turn-based debate. Users select from models like OpenAI GPT-3.5/4, Anthropic Claude 3, Google Gemini, and Hugging Face models, provide respective API keys, and watch an interactive debate unfold with unused models acting as judges. It also allows downloading the final debate report.
DeepEval

DeepEval is an open-source evaluation toolkit for AI models that provides advanced metrics for both text and multimodal outputs. It supports features like multimodal G-Eval, conversational evaluation using a list of Turns, and integrates platform support along with comprehensive documentation.
Dataset-to-Model Monitor

A tool that monitors datasets and tracks models trained on them, helping users manage and oversee AI model performance.
seismometer

seismometer is an open-source Python package for evaluating AI model performance with a focus on healthcare. It provides templates and tools to analyze statistical performance, fairness, and the impact of interventions on outcomes using local patient data. Although designed for healthcare applications, it can be used to validate models in any field.
Dataset to Model Monitor

A Hugging Face Space tool that automatically tracks and notifies users when new models are trained on a specified dataset (HuggingFaceM4/VQAv2). It leverages the librarian bot to post alerts in a discussion thread, enabling developers and researchers to keep up-to-date with models built on this dataset.