Manual test run on macOS (Intel) for 1.21.x Release #2

[kjozwiak]

Installer

• Check signature: If OS Run spctl --assess --verbose /Applications/Brave-Browser-Beta.app/ and make sure it returns accepted. If Windows right click on the brave_installer-x64.exe and go to Properties, go to the Digital Signatures tab and double click on the signature. Make sure it says "The digital signature is OK" in the popup window
• Ensured that the following executables work as expected
  • Brave-Browser-universal.dmg (ensure that either arm64 or Intel are installed depending on architecture)
    • Check executable size, should be ~470mb
  • Brave-Browser-universal.pkg (ensure that either arm64 or Intel are installed depending on architecture)
    • Check executable size, should be ~470mb
  • Brave-Browser-x64.dmg (ensure that either Intel is being installed)
    • Check executable size, should be ~270mb
  • Brave-Browser-x64.pkg (ensure that either Intel is being installed)
    • Check executable size, should be ~270mb
• Visited brave://version and ensure the following:
  • x86_64 is being displayed when installing via x64 or universal binaries on Intel macOS
    - [ ] arm64 is being displayed when installing via universal binary on M1 macOS
    - [ ] x86_64 translated is being displayed when installing via x64 binary on M1 macOS using Rosetta

Widevine

• Verify Widevine Notification is shown when you visit Netflix for the first time
• Test that you can stream on Netflix on a fresh profile after installing Widevine
• Verify Widevine Notification is shown when you visit HBO Max for the first time
• Test that you can stream on HBO Max on a fresh profile after installing Widevine

Update tests

• Verify visiting brave://settings/help triggers update check
• Verify once update is downloaded, prompts to Relaunch to install update

Startup & Components

• Delete Adblock folder from browser profile and restart browser. Visit brave://components and verify Brave Ad Block Updater downloads and update the component. Repeat for all Brave components

Upgrade

• Make sure that data from the last version appears in the new version OK
• Ensure that brave://version lists the expected Brave & Chromium versions
• With data from the last version, verify that
  • Bookmarks on the bookmark toolbar and bookmark folders can be opened
  • Cookies are preserved
  • Installed extensions are retained and work correctly
  • Opened tabs can be reloaded
  • Stored passwords are preserved
  • Sync chain created in previous version is retained
  • Social media blocking buttons changes are retained
  • Rewards
    • Wallet balance is retained
    • Auto-contribute list is retained
    • Both Tips and Monthly Contributions are retained
    • Wallet panel transactions list is retained
    • Changes to rewards settings are retained
    • Ensure that Auto Contribute is not being enabled when upgrading to a new version if AC was disabled
  • Ads
    • Both Estimated pending rewards & Ad notifications received this month are retained
    • Changes to ads settings are retained
    • Ensure that ads are not being enabled when upgrading to a new version if they were disabled
    • Ensure that ads are not disabled when upgrading to a new version if they were enabled

[stephendonner]

Completed run w/update from:

Brave	1.21.73 Chromium: 89.0.4389.72 (Official Build) (x86_64)
Revision	3f345f156bfd157bd1bea06310e55f3fb2490359-refs/branch-heads/4389@{#1393}
OS	macOS Version 11.2.2 (Build 20D80)

to:

Brave	1.21.74 Chromium: 89.0.4389.72 (Official Build) (x86_64)
Revision	3f345f156bfd157bd1bea06310e55f3fb2490359-refs/branch-heads/4389@{#1393}
OS	macOS Version 11.2.2 (Build 20D80)