Skip to content

Commit

Permalink
Merge pull request #10390 from department-of-veterans-affairs/rx-rese…
Browse files Browse the repository at this point in the history
…arch-pdf-upload

added intro to app store review page
  • Loading branch information
htcollier authored Dec 16, 2024
2 parents d32a5c7 + 4039a26 commit e4cd5bd
Showing 1 changed file with 19 additions and 9 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -5,19 +5,29 @@ sidebar_position: 2

# Monthly App Store Review Process

## Step 1: Download the reviews from the [feedback hub](https://feedback-hub-e659c24714b9.herokuapp.com/)
## Overview
Each month, the VA Mobile app team analyzes all of the app review comments that were left for the app in the [Google Play Store](https://play.google.com/store/apps/details?id=gov.va.mobileapp&hl=en_US) and [Apple's App Store](https://apps.apple.com/us/app/va-health-and-benefits/id1559609596) during the previous month.

We download the reviews from the [Feedback Hub](https://feedback-hub-e659c24714b9.herokuapp.com/app_store/sentiment). The Feedback Hub is a site run by the Mobile team that scrapes information from the app stores as well as the **/r/VeteransBenefits** and **/r/Veterans** subreddits and displays it in a way that is more usable. We label the comments with [tags](https://github.com/department-of-veterans-affairs/va.gov-team/blob/master/products/va-mobile-app/reporting/App-Stores-Reviews/Tag%20Definitions) relevant to their content, such as “accessibility,” “ease of use,” “homepage,” “login,” “performance,” or “requests,” then analyze trending sentiments by looking at which tags that used most frequently or more than usual and whether they are used with positive, neutral, negative ratings. Finally, we remove any PII and upload all of the information to Github.

You can find the full list of comments and corresponding data (OS, user’s app version, date and time of review, rating number, and review title) as well as an overview with the trending sentiment information for each month in the [VA Mobile app team’s App Stores Reviews folder in Github](https://github.com/department-of-veterans-affairs/va.gov-team/tree/master/products/va-mobile-app/reporting/App-Stores-Reviews).
You can review a step-by-step guide to the app store review process below.


## How-to
### Step 1: Download the reviews from the [feedback hub](https://feedback-hub-e659c24714b9.herokuapp.com/)

1. Select App Store or Play Store at the top.
2. Ensure “All” ratings are selected from the dropdown.
3. Input the date range for the month you are working on.
4. Tap “search”.
5. Click the “Download as .csv” button to export.

## Step 2: Import the data to Google Sheets
### Step 2: Import the data to Google Sheets
[In the spreadsheet](https://docs.google.com/spreadsheets/d/1Lj65hvWUkdTpmpvsObOOD2hjG8CHAiQ7z0mCeowabh0/edit?usp=sharing), create two new sheets for the month (one for overview and one for reviews) and import the reviews for the corresponding date into that month’s "reviews" sheet.
- _Note: You can duplicate a previous month and remove the data._

## Step 3: Clean up the import
### Step 3: Clean up the import

1. Verify that data pulled in correctly
2. Add wrapping to the grids
Expand All @@ -26,7 +36,7 @@ sidebar_position: 2
4. Define the range for the tags column (i.e. TagMarch24).
- This allows the spreadsheet to do the math and pull the totals into the overview sheet.

## Step 4: Analyze the data
### Step 4: Analyze the data

1. Update the overview with the correct dates and review totals for the month.
2. Read each review and add a corresponding tag.
Expand All @@ -39,20 +49,20 @@ sidebar_position: 2
5. Pull out a few of the reviews that you think are important and add them to the review sample column (try to limit the samples to 2-4).
- If the trending sentiment is “mixed”, try to pull both positive and negative samples into the overview.

## Step 5: Find or create a new folder on Github
### Step 5: Find or create a new folder on Github
In the [App Store Reviews folder on Github](https://github.com/department-of-veterans-affairs/va.gov-team/tree/master/products/va-mobile-app/reporting/App-Stores-Reviews), find or create the folder for the corresponding quarter.

If you are adding app store reviews for a month in an existing quarter’s folder, select the month that you are updating and edit the file.

### How to create a folder for a new quarter
#### How to create a folder for a new quarter

1. Create the new folder (add a file in Github and `/` at the end to create a new folder).
- Follow the naming convention of the previous quarters (four digit year followed by a hyphen and then the quarter).
2. Create placeholder files for all three months in the quarter.
- Follow the naming convention of the other files (i.e. 2024-04-Summary-VA-Mobile-App-Store-Reviews.md)
3. Add a readme.md file to the folder (content can be copied from the readme.md file in another folder, but be sure to update the dates in the file to the new quarter).

## Step 6: Add the overview to Github
### Step 6: Add the overview to Github

1. Back in your app store review sheet, select only your table in the overview and then [convert the overview table to markdown](https://tabletomarkdown.com/convert-spreadsheet-to-markdown/).
2. Paste the converted markdown table into your Github file.
Expand All @@ -62,7 +72,7 @@ If you are adding app store reviews for a month in an existing quarter’s folde
- Add bold styling to the date.
5. Preview your file and if everything looks good, commit the changes.

## Step 7: Add the full list of reviews to Github
### Step 7: Add the full list of reviews to Github
__Note:__ To protect PII (Personal Identifiable Information), when you are pulling in the full list of reviews into Github, delete the author column prior to copying the table. You can restore it after by undoing the action (edit > undo or ⌘+Z).

Replace any personally identifiable information in any of the reviews with [redacted].
Expand All @@ -72,7 +82,7 @@ Replace any personally identifiable information in any of the reviews with [reda
3. Preview your file and if everything looks good, commit the changes.
4. If you have not already done so, restore the author column in the Google sheet.

## Step 8: Notify the team on Slack
### Step 8: Notify the team on Slack
After the app store reviews have been added to Github, share the findings in the following Slack channel:
- [#va-mobile-app](https://dsva.slack.com/archives/C018V2JCWRJ) (in DSVA)
- Provide a short description and link back to that month's overview page on Github.

0 comments on commit e4cd5bd

Please sign in to comment.