User dashboard: let users see their recently validated labels

[jonfroehlich]

As described here, I would like to add a small gallery of recently validated labels to the user's dashboard. Sort of like this:

The goal here would be to help better educate users on things that they are getting "wrong" (at least as rated by the crowd).

Will likely use similar code to Sidewalk Gallery.

[gari01234]

Do you think it's a good idea to let users edit the labels marked incorrect by other users? This would increase their points in accuracy. And there would be better data on the map for everyone.

[jonfroehlich]

Great idea @gari01234. I think this would require a bit of effort/thought to get right. But we will definitely consider it!

[jonfroehlich]

Another idea here is to link to our labeling guide or a document on common mistakes (and we can link to common mistakes for each label type under the appropriate header)

[jonfroehlich]

This is increasingly important imo as in our service learning curriculum, some students really struggle to know what they're doing wrong (I think)...

[jonfroehlich]

Since the validation interface collects comments (not sure how often these are filled out), could also surface these comments to the user on why a label got marked "incorrect."

Folks are still struggling with this and they have very limited feedback on their performance to know how to improve.

[jonfroehlich]

This came up again in my conversation with Amsterdam. They suggested two things:

• first, that this feedback feature is essential and they want to include the open-ended description feedback back to users (as a way of communicating with their team about why something is right or wrong)

• second, when there is new validation information in someone's dashboard, they suggested having alike a little "unread messages" alert next to their dashboard so that people know to go there and look for information

From my email notes with Amsterdam:

For user education, one thing that would be helpful is for feedback to go back to the user. That is, as we are reviewing things in the validation tool and adding comments, the original labeler should receive that feedback. Claudia suggested making this into a notification for the user (e.g., an alert on their dashboard so they know to check it and see new info on their performance)

[jonfroehlich]

Another way to learn about which labels have been marked as "disagrees" as via this interactive map on your dashboard.

We could have a UI that allows you to filter (and/or color) labels that have been marked as "disagree".

There is just currently no way for users to learn about their mistakes and this comes up now in conversation with nearly every partner we have from Liga to Chicago.

[misaugstad]

Here's a quick look at what I'm working with! Obviously tons to do visually and functionally... But @jonfroehlich what are your thoughts on the general design? We can either do the 3 x 2, or a 2 x 3 if we want the images to be bigger! Each label type has a carousel of images there.

[misaugstad]

Here's a look of my screen with the 2 x 3!

[jonfroehlich]

Hmm, I might actually like this better.

For the header, how about "Your recent labeling mistakes" and then some text under it.

Your recent labeling mistakes

Below, we are showing labels that have been marked as incorrect by other Project Sidewalk users

[misaugstad]

Almost done! Should be able to finish tomorrow.

@jonfroehlich here's a quick look at how it's looking. I just threw a little something in there for when there are no negative validations for a label type. Lmk if you see anything that needs to be fixed visually!

[misaugstad]

Oh here's the rest for the full picture:

[jonfroehlich]

Looks great!

…

---- Sent from phone

[jonfroehlich]

Overall, I think this looks very promising. My only comment might be about whether we hide the label types with no errors rather than show that giant bullseye (or perhaps we find a different representation?).

I say push this to test so we can start using it, and I'm likely to have more significant feedback then (as usual, ha!).

Awesome work Mikey. Excited to use this!

[misaugstad]

In case the answer is obvious to you, here's what it looks like if I just exclude the ones with no data!

If there were no labels at all to show, I'd add a little something there to explain what's going on.

[jonfroehlich]

I think I prefer this to be honest; it feels simpler. I realize the downside is that the layout is dynamic (and things will be ordered differently).

Maybe we could have an auto-generated note of something like "Below, we are showing labels marked as incorrect by other Project Sidewalk users. We are not showing labels for X, Y, and Z because none were marked as incorrect" (Or something?).

[jonfroehlich]

Putting a mock for this here (for archiving)

RecentLabelingMistakes.pptx
.