Skip to content

Manual Testing

Jump to bottom
Sarath edited this page Mar 18, 2021 · 3 revisions

Cleanup Mac:

rm -r /Applications/OONI\ Probe.app \
~/Library/ApplicationSupport/OONI\ Probe/ \
~/Library/LaunchAgents/org.ooni.probe-desktop.plist

Cleanup Windows:

Uninstall app
rm -rf ~/AppData/Roaming/OONI\ Probe/

Fresh Install

  • Starts with onboarding

  • Shows dashboard after onboarding

  • Click "Run" on top

  • Runs all tests one after another

  • Shows results screen after tests

  • Wait a few seconds for the autorun prompt

  • Select "Remind me Later"

  • Open each result and each measurement (one or two for websites)

  • Make sure raw data can be inspected and explorer link opens page

  • Go to Dashboard -> Websites -> Choose Websites

  • Add a couple of websites, delete a few and run test

  • Shows results screen after tests

  • Wait for autorun prompt again and click "Sounds Great"

  • Confirm the websites chosen were tested

  • Go to settings and confirm "Run tests automatically" is enabled

  • Change language, look around and come back to switch to English

  • Edit categories to test, de-select all, select one (like gambling), run websites from dashboard and confirm in results

  • This time there should be no prompt on results screen

  • Enable all categories again

  • Disable "Limit test duration" and run websites test again

  • After a while "Estimated time left" should be a few hours

  • Click the 'X' icon at top-right of screen to show confirmation to stop.

  • 'Cancel' should continue testing

  • 'OK' should show "Stopping test..." and waits for the ongoing experiment to end

  • Shows results

  • Go back to settings and enable 'Limit test duration'

  • Change duration to 180 (lowest allowed is 60, UI flash is known bug)

  • Run websites test again and confirm ETA matches duration

  • To check if autorun task is scheduled:

    On MacOS

    launchctl print gui/$(id -u)/org.ooni.probe-desktop

    Shows screenful of information. Confirm:

    • arguments has /path/to/ooniprobe, run unattended, --software-name=ooniprobe-desktop-unattended
    • environment has OONI_HOME pointing to path ending _autorun
    • run interval is 3600

    On Windows

    Open Task Scheduler application and look for task named `org.ooni.probe-desktop`

  • Disable 'Run tests automatically' and run the same command above to see Could not find service "org.ooni.probe-desktop" in domain for login:

  • Enable autorun again and immediately check if background task is running with the command launchctl list org.ooni.probe-desktop

  • The output should have PID=<ooniprobe process id>

  • To check if autorun is collecting measurements, run:
    On MacOS

    OONI_HOME=~/Library/Application\ Support/OONI\ Probe/ooni_home_autorun /Applications/OONI\ Probe.app/Contents/Resources/bin/ooniprobe list

    On Windows

    OONI_HOME=~/AppData/Roaming/OONI\ Probe/ooni_home_autorun ~/AppData/Local/Programs/ooniprobe-desktop/resources/bin/ooniprobe.exe list

  • It should show at least 8 results (4 for each time autorun was enabled)

  • Menubar -> OONI Probe -> About OONI Probe should open the about window with valid debugging information.

  • Close all windows.

    • On MacOS, the app icon should stay in dock with the dot. Clicking on icon should show the dashboard again. Cmd-Q to quit
    • On Windows, app quits.

Reinstall (without cleanup)

  • Move app to Bin / Uninstall Program
  • Install again
  • Run app again to show dashboard, not onboarding
  • Settings shows autorun disabled
  • Check that past results are still available
  • Shows autorun prompt again

Reinstall (after cleanup)

  • Starts with onboarding
  • Select "Change defaults"
  • Goes to Settings with "Share app usage..." and "Send crash reports" disabled
  • Go to Results and wait for autorun prompt. Click 'No Thanks'.
  • Go to Dashboard and back to Results. There should be no autorun prompt until next install.
Clone this wiki locally