Skip to content

v0.0.1

Choose a tag to compare

View all tags
@CatherineSue CatherineSue released this 26 Jun 21:33
· 88 commits to main since this release
v0.0.1
a3060d2
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

🎉 Initial Release

This is the first public release of genai-bench - a comprehensive benchmarking tool for generative AI models and inference servers.

✨ Features

  • Support for text-to-text, image-to-text, and embedding benchmarks
  • Flexible dataset configuration with HuggingFace integration
  • Multiple API backends (OpenAI, OCI Cohere, custom)
  • Comprehensive metrics and reporting
  • Docker support for containerized benchmarking
  • Traffic scenario modeling with concurrency controls

🚀 Getting Started

pip install genai-bench
genai-bench --help
genai-bench benchmark --help

See the USER_GUIDE.md for detailed usage instructions.

📊 What's Included

  • CLI tool with comprehensive options
  • Pre-configured traffic scenarios
  • Excel and plot generation for results analysis
  • Support for distributed benchmarking

🛠️ Requirements

  • Python 3.11+
  • See pyproject.toml for full dependencies
Assets 2
Loading