2.3. Testing

This section describes the testing of the Manifesting API that we do.

Unittests

Our unittests can be found here. Each folder that starts with test_* is a set of unittests that tests a specific section of the API. It is structured in such a way for organizational purposed (a section can have many unittests), but mostly for ease of automation. From this directory you can run a test_all.sh script that loops through each test_* folder and runs the tests (*.py scripts).

We focus our test around sections that are critical for booting the node: image building, uploading\deleting manifests, bind\unbind nodes and etc. Needless to say that these tests are not perfect and could be improved. They also doesn't test everything even in the focused areas, since we are testing things we are expecting to break or those that broke several times during manual testing.

Manifesting API included a Command Line Tool that is used for interaction with Manifesting Server. Thus, our unittests uses this command line tool to test the API functionalities. With that, we can test both the server side of the API as well as the client side at the same time.