Skip to content
This repository has been archived by the owner on Dec 11, 2019. It is now read-only.

Manual test for for macOS 0.11.2 Beta1 #2767

Closed
91 of 95 tasks
luixxiul opened this issue Jul 29, 2016 · 3 comments
Closed
91 of 95 tasks

Manual test for for macOS 0.11.2 Beta1 #2767

luixxiul opened this issue Jul 29, 2016 · 3 comments
Assignees
@alexwykoff
Labels
OS/macOS QA/checked tests
Milestone
0.11.2dev

Comments

@luixxiul
Copy link
Contributor

luixxiul commented Jul 29, 2016 •
edited by alexwykoff
Loading

Installer

  1. Check that installer is close to the size of last release.
  2. Check signature: If OS Run spctl --assess --verbose /Applications/Brave.app/ and make sure it returns accepted. If Windows right click on the installer exe and go to Properies, go to the Digital Signatures tab and double click on the signature. Make sure it says "The digital signature is OK" in the popup window.
  3. Check Brave, electron, and libchromiumcontent version in About and make sure it is EXACTLY as expected.

About pages

  1. Test that about:bookmarks loads bookmarks
  2. Test that about:downloads loads downloads
  3. Test that about:preferences changing a preference takes effect right away
  4. Test that about:preferences language change takes effect on re-start
  5. Test that about:passwords loads

Bookmarks

  1. Test that creating a bookmark on the bookmarks toolbar works
  2. Test that creating a bookmark folder on the bookmarks toolbar works
  3. Test that moving a bookmark into a folder by drag and drop on the bookmarks folder works
  4. Test that clicking a bookmark in the toolbar loads the bookmark.
  5. Test that clicking a bookmark in a bookmark toolbar folder loads the bookmark.

Context menus

  1. Make sure context menu items in the URL bar work
  2. Make sure context menu items on content work with no selected text.
  3. Make sure context menu items on content work with selected text.
  4. Make sure context menu items on content work inside an editable control (input, textarea, or contenteditable).

Find on page

  1. Ensure search box is shown with shortcut
  2. Test successful find
  3. Test forward and backward find navigation
  4. Test failed find shows 0 results
  5. Test match case find

Site hacks

  1. Test twitch.tv sub-page loads a video and you can play it

Downloads

  1. Test downloading a file works and that all actions on the download item works.

Fullscreen

  1. Test that entering full screen window works View -> Toggle Full Screen. And exit back (Not Esc).
  2. Test that entering HTML5 full screen works. And Esc to go back. (youtube.com)

Tabs and Pinning

  1. Test that tabs are pinnable
  2. Test that tabs are unpinnable
  3. Test that tabs are draggable to same tabset
  4. Test that tabs are draggable to alternate tabset

Zoom

  1. Test zoom in / out shortcut works
  2. Test hamburger menu zooms.
  3. Test zoom saved when you close the browser and restore on a single site.
  4. Test zoom saved when you navigate within a single origin site.
  5. Test that navigating to a different origin resets the zoom

Bravery settings

  1. Check that HTTPS Everywhere works by loading http://www.apple.com
  2. Turning HTTPS Everywhere off and shields off both disable the redirect to apple.com
  3. Check that ad replacement works on http://slashdot.org
  4. Check that toggling to blocking and allow ads works as expected.
  5. Test that clicking through a cert error in badssl.com works.
  6. Test that Safe Browsing works (excellentmovies.net)
  7. Turning Safe Browsing off and shields off both disable safe browsing for excellentmovies.net.
  8. Visit brianbondy.com and then turn on script blocking, nothing should load. Allow it from the script blocking UI in the URL bar and it should work.
  9. Test that about:preferences default Bravery settings take effect on pages with no site settings.
  10. Test that turning on fingerprinting protection in about:preferences shows 3 fingerprints blocked at https://jsfiddle.net/bkf50r8v/13/. Test that turning it off in the Bravery menu shows 0 fingerprints blocked.
  11. Test that 3rd party storage results are blank at https://jsfiddle.net/7ke9r14a/7/ when 3rd party cookies are blocked.
  12. Test that audio fingerprint is blocked at https://audiofingerprint.openwpm.com/ when fingerprinting protection is on.

Content tests

  1. Load twitter and click on a tweet so the popup div shows. Click to dismiss and repeat with another div. Make sure it shows.
  2. Go to brianbondy.com and click on the twitter icon on the top right. Test that context menus work in the new twitter tab.
  3. Go to http://www.bennish.net/web-notifications.html and test that clicking on 'Show' pops up a notification asking for permission. Make sure that clicking 'Deny' leads to no notifications being shown.
  4. Go to https://trac.torproject.org/projects/tor/login and make sure that the password can be saved. Make sure the saved password shows up in about:passwords.
  5. Open a github issue and type some misspellings, make sure they are underlined.
  6. Make sure that right clicking on a word with suggestions gives a suggestion and that clicking on the suggestion replaces the text.
  7. Make sure that Command + Click (Control + Click on Windows, Control + Click on Ubuntu) on a link opens a new tab but does NOT switch to it. Click on it and make sure it is already loaded.
  8. Make sure that clicking links from gmail or inbox.google.com works.
  9. Test that PDF is loaded at http://www.orimi.com/pdf-test.pdf

Flash tests

  1. Turn on Flash in about:preferences#security. Test that clicking on 'Install Flash' banner on myspace.com shows a notification to allow Flash and that the banner disappears when 'Allow' is clicked.
  2. Test that flash placeholder appears on http://www.y8.com/games/superfighters

Per release specialty tests

  • Added history on long click over back and forward buttons. (#1622)
  • Added a search box to the Bookmarks page (about:bookmarks) ([Add a search box on the about:bookmarks page #995](Add a search box on the about:bookmarks page Add a search box on the about:bookmarks page #995))
  • Added context menu for cloning a tab including back-forward history. (#2593)
  • Added support for forking navigation via CmdOrCtrl+Click on back, forward or reload buttons. (#2753)
  • Added optional Shift for zoom in shortcut. (#2685)
  • Added Run <noscript> tag when noscript is active. (#2671)
  • Added smoother animations. (#2765)
  • Added Bravery top level menu. (#2669)
  • Added restart dialog for prefs that require restart. (#2543)
  • Added search image on context menu if default engine is google. (#2606)
  • Added a way to view SSL certificates when there is an error. (#1057)
  • Security (Severity: High): Address Bar Spoofing security. (#2723) https://jsfiddle.net/vp0yqokd/
  • Changed tab-specific notifications to only be shown on the active tab. (#1928)
  • Changed bookmarks bar to auto opens on first bookmark if no bookmarks exist. (#1487)
  • Fixed auto logging out when clear cookies on shutdown option is on. (#2620)
  • Fixed basic auth not working on some pages. (#1997)
  • Fixed playing videos on drive.google.com. (#2533)
  • Fixed viewing s.codepen.io. (#2665)
  • Fixed running 2 instances of PDF.js at once. (#2619)
  • Fixed exiting fullscreen view when tab is closed. (#2618)
  • Fixed not hiding find bar for inter-page navigation. (#323)
  • Fixed delete button handling in URL bar. (#2647)
  • Fixed some PDF files not showing. (#2654)
  • Fixed Notification bar for crashes not dismissing. (#2617)
  • Fixed "Open Image In New Tab" respecting private / session info. (#2746)
  • Fixed pressing down on URL bar now shows autosuggest. (#2444)
  • Fixed showing scrollbars in tabs bar in Arch linux. ([Arch linux: Scroll bar appears over tabs when they fill the tab bar #2599](Arch linux: Scroll bar appears over tabs when they fill the tab bar Arch linux: Scroll bar appears over tabs when they fill the tab bar #2599))
  • Upgrade to libchromiumcontent 52.0.2743.82. (#1592)
  • Upgrade to Electron 1.3.0. (#2635)

Session storage

  1. Temporarily move away your ~/Library/Application\ Support/Brave/session-store-1 and test that clean session storage works. (%appdata%\Brave in Windows, ./config/brave in Ubuntu)
  2. Make sure that data from the last version appears in the new version OK.
  3. Test that windows and tabs restore when closed, including active tab.
  4. Test that the previous version's cookies are preserved in the next version.
  5. Move away your entire ~/Library/Application\ Support/Brave folder (%appdata%\Brave in Windows, ./config/brave in Ubuntu)

Cookie and Cache

  1. Make a backup of your profile, turn on all clearing in preferences and shut down. Make sure when you bring the browser back up everything is gone that is specified.
  2. Go to http://samy.pl/evercookie/ and set an evercookie. Check that going to prefs, clearing site data and cache, and going back to the Evercookie site does not remember the old evercookie value.

Update tests

  1. Test that updating using BRAVE_UPDATE_VERSION=0.8.3 env variable works correctly.
@luixxiul luixxiul added this to the 0.11.2dev milestone Jul 29, 2016
@luixxiul luixxiul mentioned this issue Jul 29, 2016
Closed
67 tasks
@alexwykoff
Copy link
Contributor

The following issues have been created to track cases which failed:
#2816
#2817
#2818
#2819

@bbondy
Copy link
Member

bbondy commented Jul 30, 2016

please mark things that are tested as checked even if they fail as long as there are notes below to distinguish from things that are not tested. Thanks!

@alexwykoff
Copy link
Contributor

Aside from the pdf tests blocked by 2819, we're good to go.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@alexwykoff alexwykoff

Labels
OS/macOS QA/checked tests
Projects
None yet
Milestone
0.11.2dev
Development

No branches or pull requests
3 participants
@bbondy @alexwykoff @luixxiul