Skip to content
This repository has been archived by the owner on Dec 11, 2019. It is now read-only.

Manual tests for Ubuntu 0.11.1 Beta2 #2565

Closed
78 tasks done
luixxiul opened this issue Jul 18, 2016 · 11 comments
Closed
78 tasks done

Manual tests for Ubuntu 0.11.1 Beta2 #2565

luixxiul opened this issue Jul 18, 2016 · 11 comments
Assignees
@luixxiul
Labels
OS/unix-like/linux tests
Milestone
0.11.1dev

Comments

@luixxiul
Copy link
Contributor

luixxiul commented Jul 18, 2016 •
edited
Loading

Installer

  1. Check that installer is close to the size of last release.
  2. Check signature: If OS Run spctl --assess --verbose /Applications/Brave.app/ and make sure it returns accepted. If Windows right click on the installer exe and go to Properies, go to the Digital Signatures tab and double click on the signature. Make sure it says "The digital signature is OK" in the popup window.
  3. Check Brave, electron, and libchromiumcontent version in About and make sure it is EXACTLY as expected.

About pages

  1. Test that about:bookmarks loads bookmarks
  2. Test that about:downloads loads downloads
  3. Test that about:preferences changing a preference takes effect right away
  4. Test that about:preferences language change takes effect on re-start
  5. Test that about:passwords loads

Context menus

  1. Make sure context menu items in the URL bar work
  2. Make sure context menu items on content work with no selected text.
  3. Make sure context menu items on content work with selected text.
  4. Make sure context menu items on content work inside an editable control (input, textarea, or contenteditable).

Find on page

  1. Ensure search box is shown with shortcut
  2. Test successful find
  3. Test forward and backward find navigation
  4. Test failed find shows 0 results
  5. Test match case find

Site hacks

  1. Test twitch.tv sub-page loads a video and you can play it

Downloads

  1. Test downloading a file works and that all actions on the download item works.

Fullscreen

  1. Test that entering full screen window works View -> Toggle Full Screen. And exit back (Not Esc).
  2. Test that entering HTML5 full screen works. And Esc to go back. (youtube.com)

Tabs and Pinning

  1. Test that tabs are pinnable
  2. Test that tabs are unpinnable
  3. Test that tabs are draggable to same tabset
  4. Test that tabs are draggable to alternate tabset

Zoom

  1. Test zoom in / out shortcut works
  2. Test hamburger menu zooms.
  3. Test zoom saved when you close the browser and restore on a single site.
  4. Test zoom saved when you navigate within a single origin site.
  5. Test that navigating to a different origin resets the zoom

Bookmarks

  1. Test that creating a bookmark on the bookmarks toolbar works
  2. Test that creating a bookmark folder on the bookmarks toolbar works
  3. Test that moving a bookmark into a folder by drag and drop on the bookmarks folder works
  4. Test that clicking a bookmark in the toolbar loads the bookmark.
  5. Test that clicking a bookmark in a bookmark toolbar folder loads the bookmark.

Bravery settings

  1. Check that HTTPS Everywhere works by loading http://www.apple.com
  2. Turning HTTPS Everywhere off and shields off both disable the redirect to apple.com
  3. Check that ad replacement works on http://slashdot.org
  4. Check that toggling to blocking and allow ads works as expected.
  5. Test that clicking through a cert error in badssl.com works.
  6. Test that Safe Browsing works (excellentmovies.net)
  7. Turning Safe Browsing off and shields off both disable safe browsing for excellentmovies.net.
  8. Visit brianbondy.com and then turn on script blocking, nothing should load. Allow it from the script blocking UI in the URL bar and it should work.
  9. Test that about:preferences default Bravery settings take effect on pages with no site settings.
  10. Test that turning on fingerprinting protection in about:preferences shows 3 fingerprints blocked at https://jsfiddle.net/bkf50r8v/11/. Test that turning it off in the Bravery menu shows 0 fingerprints blocked.
  11. Test that 3rd party storage results are blank at https://jsfiddle.net/7ke9r14a/7/ when 3rd party cookies are blocked.
  12. Test that audio fingerprint is blocked at https://audiofingerprint.openwpm.com/ when fingerprinting protection is on.

Content tests

  1. Load twitter and click on a tweet so the popup div shows. Click to dismiss and repeat with another div. Make sure it shows.
  2. Go to brianbondy.com and click on the twitter icon on the top right. Test that context menus work in the new twitter tab.
  3. Go to http://www.bennish.net/web-notifications.html and test that clicking on 'Show' pops up a notification asking for permission. Make sure that clicking 'Deny' leads to no notifications being shown.
  4. Go to https://trac.torproject.org/projects/tor/login and make sure that the password can be saved. Make sure the saved password shows up in about:passwords.
  5. Open a github issue and type some misspellings, make sure they are underlined.
  6. Make sure that right clicking on a word with suggestions gives a suggestion and that clicking on the suggestion replaces the text.
  7. Make sure that Command + Click (Control + Click on Windows, Control + Click on Ubuntu) on a link opens a new tab but does NOT switch to it. Click on it and make sure it is already loaded.
  8. Make sure that clicking links from gmail or inbox.google.com works.
  9. Test that PDF is loaded at http://www.orimi.com/pdf-test.pdf

Flash tests

  1. Turn on Flash in about:preferences#security. Test that clicking on 'Install Flash' banner on myspace.com shows a notification to allow Flash and that the banner disappears when 'Allow' is clicked.
  2. Test that flash placeholder appears on http://www.y8.com/games/superfighters

Per release specialty tests

  • Added built-in PDF reader with PDF.js. Can be disabled in preferences. (#1084)
  • Added more data clearing options, including on shutdown. (#2472)
  • Added support for navigator.registerProtocolHandler (Mostly used for gmail mailto: and bitcoin: handling). (#1583)
  • Added Copy Image to clipboard option through the context menu. (#1174)
  • Added a customized Windows 10 Start Menu tile. (#2372)
  • Added edit bookmark ability when staring a site. (#2439)
  • Added Lastpass preferences. (#2411)
  • Added Command + Shift + Click support for various UI elements to open and focus a new tab. (#2436)
  • Fixed Vimeo player not playing due to referrer blocking. (#2474)
  • Fixed crashes with notifications. (#1931)
  • Fixed new-tab ordering from pinned tabs. ([Opening another tab from pinned tab does not order correctly #2453](Opening another tab from pinned tab does not order correctly Opening another tab from pinned tab does not order correctly #2453))
  • Fixed exiting full screen when closing a full screen tab. (#2404)
  • Fixed spell check happening in URL bar. (#2434)
  • Fixed webRTC fingerprinting blocking. (#2412)
  • Fixed find in page highlighting not clearing when find bar is closed. (#2476)
  • Upgrade to Electron 1.2.7. (#2470)

Session storage

  1. Temporarily move away your ~/Library/Application\ Support/Brave/session-store-1 and test that clean session storage works. (%appdata%\Brave in Windows, ./config/brave in Ubuntu)
  2. Make sure that data from the last version appears in the new version OK.
  3. Test that windows and tabs restore when closed, including active tab.
  4. Test that the previous version's cookies are preserved in the next version.
  5. Move away your entire ~/Library/Application\ Support/Brave folder (%appdata%\Brave in Windows, ./config/brave in Ubuntu)

Cookie and Cache

  1. Make a backup of your profile, turn on all clearing in preferences and shut down. Make sure when you bring the browser back up everything is gone that is specified.
  2. Go to http://samy.pl/evercookie/ and set an evercookie. Check that going to prefs, clearing site data and cache, and going back to the Evercookie site does not remember the old evercookie value.

Update tests

  • Test that updating using BRAVE_UPDATE_VERSION=0.8.3 env variable works correctly.
@luixxiul luixxiul added this to the 0.11.1dev milestone Jul 18, 2016
@luixxiul luixxiul self-assigned this Jul 18, 2016
@luixxiul luixxiul mentioned this issue Jul 18, 2016
Closed
@luixxiul
Copy link
Contributor Author

Streams at Twitch.tv are not loaded. Flash is not available on Ubuntu. #2568 should be fixed asap.

Except those all expected manual tests pass.

@luixxiul
Copy link
Contributor Author

Will you tell me how to do an update test on Ubuntu? @bbondy

@bbondy
Copy link
Member

bbondy commented Jul 19, 2016

just something like this I think is enough
BRAVE_UPDATE_VERSION=0.8.3 brave

@luixxiul
Copy link
Contributor Author

in ~/.bashrc?

@bbondy
Copy link
Member

bbondy commented Jul 19, 2016

just in a terminal, start Brave with that.

@luixxiul
Copy link
Contributor Author

luixxiul commented Jul 19, 2016 •
edited
Loading

BRAVE_UPDATE_VERSION=0.8.3 brave does not work. It runs Brave, but it says no update is found.

@luixxiul
Copy link
Contributor Author

luixxiul commented Jul 19, 2016 •
edited
Loading

Also streams on twitch.tv is not played.

@bbondy
Copy link
Member

bbondy commented Jul 19, 2016 •
edited
Loading

Actually sorry, there is no update support in Linux. So you can just skip that test here.

@bbondy
Copy link
Member

bbondy commented Jul 19, 2016

Ideally we will just tell the user there is a download and ask them to download manually. Someone will hopefully also setup a debian repo eventually.

@bbondy
Copy link
Member

bbondy commented Jul 19, 2016

twitch.tv is working for me on linux, I think maybe the problem is that you are checking on the main page who's video doesn't work, you have to click through to one of the subvideos.

@luixxiul
Copy link
Contributor Author

For reference: Update support in Linux is discussed #1470

Confirmed twitch.tv was working for me too.

All tests passed.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@luixxiul luixxiul

Labels
OS/unix-like/linux tests
Projects
None yet
Milestone
0.11.1dev
Development

No branches or pull requests
2 participants
@bbondy @luixxiul