pytest-benchmark - py.test fixture for benchmarking code

  •        27

A py.test fixture for benchmarking code. It will group the tests into rounds that are calibrated to the chosen timer. See calibration and FAQ. For latest release:



Related Projects

BenchmarkDotNet - Powerful .NET library for benchmarking

  •    CSharp

BenchmarkDotNet is a powerful .NET library for benchmarking.Benchmarking is really hard (especially microbenchmarking), you can easily make a mistake during performance measurements. BenchmarkDotNet will protect you from the common pitfalls (even for experienced developers) because it does all the dirty work for you: it generates an isolated project per each benchmark method, does several launches of this project, run multiple iterations of the method (include warm-up), and so on. Usually, you even shouldn't care about a number of iterations because BenchmarkDotNet chooses it automatically to achieve the requested level of precision.

pytest-django - A Django plugin for pytest.

  •    Python

pytest-django allows you to test your Django project/applications with the pytest testing tool. See the pytest documentation for more information on pytest itself.

NBench - Performance benchmarking and testing framework for .NET applications

  •    CSharp

Cross-platform performance benchmarking and testing framework for .NET applications. NBench is designed for .NET developers who need to care about performance and want the ability to "unit test" their application's performance just like XUnit or NUnit tests their application code.

go-web-framework-benchmark - :zap: Go web framework benchmark

  •    Go

This benchmark suite aims to compare the performance of Go web frameworks. It is inspired by Go HTTP Router Benchmark but this benchmark suite is different with that. Go HTTP Router Benchmark suit aims to compare the performance of routers but this Benchmark suit aims to compare whole HTTP request processing.

pytest-asyncio - Pytest support for asyncio.

  •    Python

pytest-asyncio is an Apache2 licensed library, written in Python, for testing asyncio code with pytest. asyncio code is usually written in the form of coroutines, which makes it slightly more difficult to test using normal testing tools. pytest-asyncio provides useful fixtures and markers to make testing easier.

pytest-cov - Coverage plugin for pytest.

  •    Python

All features offered by the coverage package should work, either through pytest-cov's command line options or through coverage's config file. pytest-cov 2.0 is using a new .pth file (pytest-cov.pth). You may want to manually remove the older init_cov_core.pth from site-packages as it's not automatically removed.

phpbench - PHP Benchmarking framework

  •    PHP

PhpBench is a benchmarking framework for PHP. You can install PHPBench either as as a PHAR or as a project dependency.

bench-rest - bench-rest - benchmark REST (HTTP/HTTPS) API's

  •    Javascript

bench-rest - benchmark REST (HTTP/HTTPS) API's. Node.js client module for easy load testing / benchmarking REST API' using a simple structure/DSL can create REST flows with setup and teardown and returns (measured) metrics.

athletic - PHP Benchmarking Framework

  •    PHP

Athletic is a benchmarking framework. It allows developers to benchmark their code without littering microtime() calls everywhere. Athletic was inspired by the annotation format that PHPUnit uses. Benchmark tests extend the AthleticEvent class and are annotated with specific docblock parameters. The benchmark suite is then run with the Athletic command-line tool.


  •    Java

OO7J is a Java version of the original OO7 benchmark (written in C++) from Mike Carey, David DeWitt and Jeff Naughton = Univ Wisconsin-Madison.The original benchmark tested ODBMS performance. This project also includes benchmarking ORM Tools

linkbench - Facebook Graph Benchmark

  •    Java

LinkBench is a database benchmark developed to evaluate database performance for workloads similar to those of Facebook's production MySQL deployment. LinkBench is highly configurable and extensible. It can be reconfigured to simulate a variety of workloads and plugins can be written for benchmarking additional database systems. LinkBench is released under the Apache License, Version 2.0.

Rally - Macrobenchmarking framework for Elasticsearch

  •    Python

Rally is the macrobenchmarking framework for Elasticsearch. It helps to setup and teardown of an Elasticsearch cluster for benchmarking, Running benchmarks and recording results, Finding performance problems by attaching so-called telemetry devices, Management of benchmark data and specifications even across Elasticsearch versions and lot more.

pytest-sugar - a plugin for py

  •    Python

pytest-sugar is a plugin for py.test that shows failures and errors instantly and shows a progress bar. If you are seeing gibberish, you might want to try changing charset and fonts. See this comment for more details.

pytest-xdist - pytest plugin for distributed testing and loop-on-failures testing modes.

  •    Python

Before running tests remotely, pytest efficiently "rsyncs" your program source code to the remote place. All test results are reported back and displayed to your local terminal. You may specify different Python versions and interpreters. If you would like to know how pytest-xdist works under the covers, checkout OVERVIEW.

basho_bench - A load-generation and testing tool for basically whatever you can write a returning Erlang function for

  •    Erlang

Basho Bench is a benchmarking tool created to conduct accurate and repeatable performance tests and stress tests, and produce performance graphs. Originally developed to benchmark Riak, it exposes a pluggable driver interface and has been extended to serve as a benchmarking tool across a variety of projects.

Siege - Http load tester and benchmarking utility

  •    C

Siege is an open source regression test and benchmark utility. It can stress test a single URL with a user defined number of simulated users, or it can read many URLs into memory and stress them simultaneously. The program reports the total number of hits recorded, bytes transferred, response time, concurrency, and return status. Siege supports HTTP/1.0 and 1.1 protocols, the GET and POST directives, cookies, transaction logging, and basic authentication. Its features are configurable on a per user basis.

nativejson-benchmark - C/C++ JSON parser/generator benchmark

  •    Javascript

This benchmark evaluates the conformance and performance of 41 open-source C/C++ libraries with JSON parsing/generation capabilities. Performance means speed, memory, and code size. Performance should be concerned only if the results are correct. This benchmark also test the conformance of library towards the JSON standards (RFC7159, ECMA-404).

Celero - C++ Benchmark Authoring Library/Framework

  •    C++

Developing consistent and meaningful benchmark results for code is a complex task. Measurement tools exist (Intel® VTune™ Amplifier, SmartBear AQTime, Valgrind, etc.) external to applications, but they are sometimes expensive for small teams or cumbersome to utilize. This project, Celero, aims to be a small library which can be added to a C++ project and perform benchmarks on code in a way which is easy to reproduce, share, and compare among individual runs, developers, or projects. Celero uses a framework similar to that of GoogleTest to make its API easier to use and integrate into a project. Make automated benchmarking as much a part of your development process as automated testing. Celero uses CMake to provide cross-platform builds. It does require a modern compiler (Visual C++ 2012+, GCC 4.7+, Clang 2.9+) due to its use of C++11.

rally - Rally provides a framework for performance analysis and benchmarking of individual OpenStack components as well as full production OpenStack cloud deployments

  •    Python

Rally is a Benchmark-as-a-Service project for OpenStack.Rally is intended to provide the community with a benchmarking tool that is capable of performing specific, complicated and reproducible test cases on real deployment scenarios.

pytest - The pytest framework makes it easy to write small tests, yet scales to support complex functional testing

  •    Python

The pytest framework makes it easy to write small tests, yet scales to support complex functional testing for applications and libraries. Due to pytest's detailed assertion introspection, only plain assert statements are used. See getting-started for more examples.