Fastest - simple parallel testing execution

This is not stable, things will change... :)

Only one thing

Execute parallel testing, creating a process for each Processor (with some goodies for functional tests).

find tests/ -name "*Test.php" | ./bin/fastest "bin/phpunit -c app {};"

This tool works with any testing tool available! It just executes it in parallel.

It is optimized for functional tests, giving an easy way to work with N databases in parallel.

Motto

"I had a problem,

so I decided to use threads.

tNwoowp rIo bhlaevmes.

Why

We were tired of not being able to run paratest with our project (big complex functional project).

Parallel is a great tool but not so nice for functional tests.

There were no simple tool available for functional tests.

Our old codebase run in 30 minutes, now in 7 minutes with 4 Processors.

Features

1. Functional tests could use a database per processor using the environment variable.
2. Tests are randomized by default.
3. Is not coupled with PhpUnit you could run any command.
4. Is developed in PHP with no dependencies.
5. As input you could use a phpunit.xml.dist file or use pipe (see below).
6. Increase Verbosity with -v option.

How

100% written in PHP, inspired by parallel.

Simple usage

Piping tests

It pushes into a queue and executes all the tests in your project:

find tests/ -name "*Test.php" | ./bin/fastest

or with ls

ls -d test/* | ./bin/fastest

calling with placeholders:

find tests/ -name "*Test.php" | ./bin/fastest "/my/path/phpunit -c app {};"

{} is the current test file. {p} is the current process number.

Using the phpunit.xml.dist as input

You can use the option -x and import the test suites from the phpunit.xml.dist

./bin/fastest -x phpunit.xml.dist

If you use this option make sure the test-suites contains a lot of directory, is not suggested.

Functional tests and database

Each Process has its Env number

echo getenv('TEST_ENV_NUMBER');        // Current process number eg.2
echo getenv('ENV_TEST_DB_NAME');       // Name for the database eg. test_2
echo getevn('ENV_TEST_MAX_PROCESSES'); // Number of CPUs on the system eg. 4
echo getevn('ENV_TEST_SUITE_NAME');    // Number of the input file eg. ManagerTest.php

Setup the database before

you can also run a script per process before the tests, useful for init schema and fixtures loading.

find tests/ -name "*Test.php" | ./bin/fastest -b"app/console doc:sch:create -e test";

The arguments:

Usage:
 fastest [-p|--process="..."] [-b|--before="..."] [-x|--xml="..."] [-o|--preserve-order] [execute]

Arguments:
 execute               Optional command to execute.

Options:
 --process (-p)        Number of parallel processes, default: available CPUs.
 --before (-b)         Execute a process before consuming the queue, it executes this command once per process, useful for init schema and load fixtures.
 --xml (-x)            Read input from a phpunit xml file from the '<testsuites>' collection. Note: it is not used for consuming.
 --preserve-order (-o) Queue is randomized by default, with this option the queue is read preserving the order.
 --help (-h)           Display this help message.
 --quiet (-q)          Do not output any message.
 --verbose (-v|vv|vvv) Increase the verbosity of messages: 1 for normal output, 2 for more verbose output and 3 for debug
 --version (-V)        Display this application version.
 --ansi                Force ANSI output.
 --no-ansi             Disable ANSI output.
 --no-interaction (-n) Do not ask any interactive question.

Symfony and Doctrine DBAL Adapter

If you want to parallel functional tests, and if you have a machine with 4 CPUs, the best think you could do is create a db foreach parallel process, fastest gives you the opportunity to work easily with Symfony.

Modifying the config_test config file in Symfony, each functional test will look for a database called test_x automatically (x is from 1 to CPUs number).

config_test.yml

parameters:
    # Stubs
    doctrine.dbal.connection_factory.class: Liuggio\Fastest\Doctrine\DbalConnectionFactory

Install

if you use Composer just run composer require-dev 'liuggio/fastest' 'dev-master'

or simply add a dependency on liuggio/fastest to your project's composer.json file:

{
    "require-dev": {
	"liuggio/fastest": "dev-master"
    }
}

For a system-wide installation via Composer, you can run:

composer global require "liuggio/fastest=dev-master"

Make sure you have ~/.composer/vendor/bin/ in your path, read more at getcomposer.org

If you want to use it with phpunit you may want to install phpunit/phpunit as dependency.

Run this test with fastest

Easy see .travis.yml file

TODO

• Rerun only failed tests
• Add the db_name variable Done!
• Remove redis ad dependency Done!
• Remove parallel_tests ad dependency Done!
• Behat provider?
• Develop ProcessorCounter for Windows/Darwin.
• Improve the Progress bar.