Skip to content
This repository has been archived by the owner on Dec 7, 2019. It is now read-only.

Add HTML report specification. #19

Merged
merged 4 commits into from
May 19, 2017
Merged
Changes from 3 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
95 changes: 95 additions & 0 deletions spec/REPORT.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,95 @@
# Terms

* Test is a single functionality check.
* Properties:
* package name;
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

* package name;
* class name;
* name;

?

* class name;
* name;
* duration;
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+ completion status: passed | failed | ignored;

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

  • optional stacktrace

* log;
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

logcat

* stacktrace (optional);
* completion status (passed | failed | ignored);
* device name;
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's more abstract thing than device and combines both emulators and real devices

* list of properties — property is a key-value pair;
* list of files;
* list of screenshots.
* Test suite is a combination of all tests available.
* Properties:
* list of tests;
* success tests count;
* failure tests count;
* ignored tests count;
* list of devices:
* device id;
* instrumentation output;
* logcat;
* duration.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+ list of devices;

* Test suite can be run different ways.
* Single device — just a single run of all tests in a test suite.
* Multiple devices.
* Sharding — all tests in a test suite are being split evenly between all devices.
* Duplicating — all tests in a test suite are being run the same way on each device available.

# Report Pages

## Device List

This page should be skipped if sharding was used to run the test suite.

Contains a list of items with following properties:

* device name;
* test run duration;
* instrumentation output;
* logcat output;
* test suite success tests count;
* test suite failure tests count;
* test suite ignored tests count.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

test suite duration

Available actions:

* click on the list item opens the Test Suite page.

## Test Suite

Contains following blocks from top to bottom.

* Summary with following properties:
* success tests count;
* failure tests count;
* ignored tests count;
* duration.
* Search input.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

(for now simple text search)

* List of tests with following properties:
* package name;
* class name;
* name;
* device name.

Available actions:

* click on the list item opens the Test page;
* changing search input contents changes list of tests content.

## Test

Contains following blocks from top to bottom.

* Summary:
* package name;
* class name;
* name;
* device name;
* duration.
* Properties:
* list of key-value pairs.
* Files:
* list of file links.
* Screenshots:
* list of screenshot images.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

grid

Copy link
Member Author

@arturdryomov arturdryomov Apr 14, 2017

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Welcome to the Grid!

* Log.

Available actions:

* click on a file starts its downloading;
* click on a screenshot opens in a new tab full-size.