Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Manual test run on Android ARM for 1.34.x - Release #20238

Closed
48 of 50 tasks
LaurenWags opened this issue Dec 28, 2021 · 1 comment
Closed
48 of 50 tasks

Manual test run on Android ARM for 1.34.x - Release #20238

LaurenWags opened this issue Dec 28, 2021 · 1 comment
Assignees
Labels
ARM Android ARM related issues OS/Android Fixes related to Android browser functionality QA Pass - Android ARM QA/Yes release-notes/exclude tests

Comments

@LaurenWags
Copy link
Member

LaurenWags commented Dec 28, 2021

Installer

  • Check that installer is close to the size of the last release
  • Check the Brave version in About and make sure it is EXACTLY as expected

Startup

  • Verify that Brave is only contacting *.brave.com endpoints on first launch using either Charles Proxy, Fiddler or Wireshark (or a similar application)

Custom tabs

  • Make sure Brave handles links from Gmail, Slack
  • Make sure Brave works as custom tabs provide with Chrome browser
  • Ensure custom tabs work even with sync enabled/disabled

Settings and Bottom bar

  • Verify changing default settings are retained and don't cause the browser to crash
  • Verify bottom bar buttons (Home/Bookmark/Search/Tabs) work as expected

Rewards

  • Verify account balance shows correct BAT and USD value
  • Verify actions taken (claiming grant, tipping, auto-contribute) display in wallet panel
  • Verify when you click on the BR panel while on a site, the panel displays site specific information (site favicon, domain, attention %)
  • Verify you are able to make one-time tip and they display in tips panel
  • Verify you are able to make recurring tip and they display in tips panel
  • Verify you can tip a verified publisher
  • Verify you can tip a verified YouTube creator
  • Verify you are able to perform a contribution
  • Verify if you disable auto-contribute you are still able to tip regular sites and YouTube creators
  • Verify on BR panel that the Verify wallet button only enables when balance is >=15 BAT
  • Verify you can reset rewards from advance setting. Resetting should delete wallet and bring it back to the pre-optin state

Brave Shields

  • Run all six test configurations on https://dev-pages.brave.software/storage/ephemeral-storage.html and confirm results are as expected per each test listed.

Brave Ads

  • Verify ads is auto-enabled when rewards is enabled for the supported region
  • Verify ads are only shown when the app is being used
  • Verify ad notification are shown based on ads per hour setting
  • Verify ad notifications stack up in notification tray
  • Verify swipe left/right dismisses the ad notification when shown and is not stored in the notification tray
  • Verify clicking on an ad notification shows the landing page
  • Verify view,clicked and landed and dismiss states are logged based on the action

Upgrade

Pre-Requisite: Visit several websites so Top Tiles under New Tab Page get updated and add several sites via Add to Home screen (from 3 dots menu) using a previous build/installation before upgrading.

  • Make sure that data from the last version appears in the new version OK
  • Ensure that brave://version lists the expected Brave & Chromium versions
  • With data from the last version, verify that
    • Bookmarks are preserved (Folders/Sites)
    • Cookies are preserved
    • Per site shield settings are preserved
    • Opened tabs can be reloaded
    • Stored passwords are preserved
    • Sync chain created in previous version is retained
    • Setting changes are preserved (Default SE, Shield settings, Homepage etc..)
    • Top Tiles under New Tab Page are preserved
    • Home screen shortcuts are preserved
    • Rewards
      • Wallet balance is retained
      • Auto-contribute list is retained
      • Both Tips and Monthly Contributions are retained
      • Wallet panel transactions list is retained
      • Changes to rewards settings are retained
    • Ads
      • Both Estimated pending rewards & Ad notifications received this month are retained
      • Changes to ads settings are retained
      • Ensure that ads are not being enabled when upgrading to a new version if they were disabled
      • Ensure that ads are not disabled when upgrading to a new version if they were enabled
@LaurenWags LaurenWags added ARM Android ARM related issues OS/Android Fixes related to Android browser functionality QA/Yes release-notes/exclude tests labels Dec 28, 2021
@LaurenWags LaurenWags added this to the 1.33.x - Release #2 milestone Dec 28, 2021
@LaurenWags LaurenWags changed the title Manual test run on Android ARM for 1.33.x - Release #2 Manual test run on Android ARM for 1.34.x - Release Dec 28, 2021
@LaurenWags LaurenWags modified the milestones: 1.33.x - Release #2, 1.34.x - Beta Dec 28, 2021
@stephendonner stephendonner self-assigned this Dec 29, 2021
@stephendonner
Copy link

Verified PASSED using Brave 1.34.76, Chromium 97.0.4692.56 on a Google Pixel XL running Android 9.0

Notes:

  1. Reset Rewards on Android not working is a known issue: [Android] Reset rewards doesn't work #8776
  2. The Verify Wallet button is enabled even when higher than 15.00, due to [Android] Reduce minimum BAT requirement for Uphold verification to 2 BAT (Dec 2021) #19912

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ARM Android ARM related issues OS/Android Fixes related to Android browser functionality QA Pass - Android ARM QA/Yes release-notes/exclude tests
Projects
None yet
Development

No branches or pull requests

2 participants