PFTT Command - Run this command in the PFTT Shell to reproduce the same tests. Use the `rg` command to get the same release if you don't already have it. Download and install PFTT from https://qa.php.net/pftt.php.
Scenario Set - Scenarios that are tested (CLI, Apache mod_php ; Opcache, Filesystem, etc...)
FAILED - PHPT tests that failed
TIMEOUT - PHPT tests that did not finish after a minute
CRASH - PHPT tests that CRASHed PHP
SKIP - PHPT test that was not run. Should minimize this count as much as possible for better code coverage
XSKIP - PHPT test that could not be run on OS. It is ok to skip these tests (whereas SKIP tests should be run if possible)
Report compares ERROR, FAILURE, TIMEOUT, CRASH and PASS for two PHP Builds, the Base Build with the Test Build. A +X indicates the count increased from Base to Test. A -X indicates the count decreased from Base to Test. If the difference is good, it is shown in green (fe increase in PASS, decrease in FAIL). If the difference is bad, it is shown in red (fe increase in FAIL).
Result-Pack All the test logs are compressed into result-packs, which can be downloaded using the two links in the report.