-
Notifications
You must be signed in to change notification settings - Fork 45
Add HTML report specification. #19
Changes from 3 commits
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,95 @@ | ||
# Terms | ||
|
||
* Test is a single functionality check. | ||
* Properties: | ||
* package name; | ||
* class name; | ||
* name; | ||
* duration; | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. + completion status: passed | failed | ignored; There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
|
||
* log; | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. logcat |
||
* stacktrace (optional); | ||
* completion status (passed | failed | ignored); | ||
* device name; | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. It's more abstract thing than device and combines both emulators and real devices |
||
* list of properties — property is a key-value pair; | ||
* list of files; | ||
* list of screenshots. | ||
* Test suite is a combination of all tests available. | ||
* Properties: | ||
* list of tests; | ||
* success tests count; | ||
* failure tests count; | ||
* ignored tests count; | ||
* list of devices: | ||
* device id; | ||
* instrumentation output; | ||
* logcat; | ||
* duration. | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. + list of devices; |
||
* Test suite can be run different ways. | ||
* Single device — just a single run of all tests in a test suite. | ||
* Multiple devices. | ||
* Sharding — all tests in a test suite are being split evenly between all devices. | ||
* Duplicating — all tests in a test suite are being run the same way on each device available. | ||
|
||
# Report Pages | ||
|
||
## Device List | ||
|
||
This page should be skipped if sharding was used to run the test suite. | ||
|
||
Contains a list of items with following properties: | ||
|
||
* device name; | ||
* test run duration; | ||
* instrumentation output; | ||
* logcat output; | ||
* test suite success tests count; | ||
* test suite failure tests count; | ||
* test suite ignored tests count. | ||
|
||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. test suite duration |
||
Available actions: | ||
|
||
* click on the list item opens the Test Suite page. | ||
|
||
## Test Suite | ||
|
||
Contains following blocks from top to bottom. | ||
|
||
* Summary with following properties: | ||
* success tests count; | ||
* failure tests count; | ||
* ignored tests count; | ||
* duration. | ||
* Search input. | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. (for now simple text search) |
||
* List of tests with following properties: | ||
* package name; | ||
* class name; | ||
* name; | ||
* device name. | ||
|
||
Available actions: | ||
|
||
* click on the list item opens the Test page; | ||
* changing search input contents changes list of tests content. | ||
|
||
## Test | ||
|
||
Contains following blocks from top to bottom. | ||
|
||
* Summary: | ||
* package name; | ||
* class name; | ||
* name; | ||
* device name; | ||
* duration. | ||
* Properties: | ||
* list of key-value pairs. | ||
* Files: | ||
* list of file links. | ||
* Screenshots: | ||
* list of screenshot images. | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. grid There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. |
||
* Log. | ||
|
||
Available actions: | ||
|
||
* click on a file starts its downloading; | ||
* click on a screenshot opens in a new tab full-size. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
?