Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Creating better instructions for how to label pedestrian signals #3240

Open
jonfroehlich opened this issue May 23, 2023 · 25 comments
Open

Creating better instructions for how to label pedestrian signals #3240

jonfroehlich opened this issue May 23, 2023 · 25 comments

Comments

@jonfroehlich
Copy link
Member

How many labels should I be applying here? It's not totally clear to me. Should I be labeling the "output posts" as well as the "input/button posts" in those cases when they are separate?

image

image

image

@jonfroehlich
Copy link
Member Author

Here's the slide deck.

PedestrianSignals.pptx

@misaugstad
Copy link
Member

Very good questions! We should continue to discuss with Yochai and Devon while working on the labeling guide!

@yeisenberg
Copy link
Collaborator

yeisenberg commented Jul 12, 2023

HI There, was looking for a good Ped signal and wanted to followup to add tags

  • has crossing button
  • button waist height
  • has countdown light box
  • has audible speaker (we need visuals of this)

As an update (Feb 21, 2024), we have long had:

  • has button
  • button waist height

image

@misaugstad
Copy link
Member

A possible set of tags to get at the information we want, while also making it clearer to users how to label:

  • 1 button
  • 2 buttons (can't pick both)
  • 1 walk light
  • 2 walk lights (can't pick both)

We should iterate on the language for counting the number of directions for which a single pole has walk signal lights.

I do think that counting the number of buttons/lights on each corner will make this more clear for users, and will get us the information we want most of the time.

@yeisenberg
Copy link
Collaborator

This seems like a good direction to go. Also, got some feedback from a colleague that one key element to focus on could be whether the rater visually sees an arrow on the button and that this can be a good indicator in nearly all cases that this is an APS. He shared this link - https://polara.com/ids-ins. In the Chicago area, we see a ton that do not have this and that i've noticed don't seem to have the full APS capabilities of audio signals.

@yeisenberg
Copy link
Collaborator

In a training on new prowag and the key does seem to be that arrow. Would be great if we can add a tag that would indicate the button has an audio signal by seeing if there is that arrow:
image

@jonfroehlich
Copy link
Member Author

Nice. Thanks Yochai!

@yeisenberg
Copy link
Collaborator

HI there, at our workshop, this was brought up as an important feature as we know. Thought I'd post again to restart this thrust to put the 'audio signal' tag as part of pedestrian signals that are key for people who are blind/low vision. thanks

@yeisenberg
Copy link
Collaborator

After some back and forth with Mikey on Slack am adding to this conversation. Based on that and this link related to new PROWAG - https://polara.com/guide/prowag-accessibility-requirements. Taking away from it
The discussion has to do with whether to have all 4 tags about the 1 or 2 buttons, or just the tactile button tagss? A key question is whether knowing about non-tactile-audio buttons is important?

  • 1 button
    
  • 2 buttons (can't pick both)
    
  • 1 tactile-Audio button
  • 2 tactile-Audio button (can't pick both)
  • 1 walk light
    
  • 2 walk lights (can't pick both)
    
  • hard to reach button
  • obstruction to pushing button

@jonfroehlich
Copy link
Member Author

jonfroehlich commented Feb 21, 2024

I think we should have:

  • APS (with a nice hover image to explain)
  • Walk light (again, nice hover image)
  • Hard to reach button (if someone clicks this, does "has button" get auto-selected? or maybe we just deal with this in post-hoc analysis)

I'm not confident that having people count is a good idea; it also introduces ambiguity about the other tags. For example, if I put "2 buttons" then what do the other tags correspond to (e.g., button hard to reach, APS).

For a situation like this:
image

Should we ask folks to use four labels: one label for each walk light (two labels total) and one label for each button (two labels total)

@misaugstad
Copy link
Member

@jonfroehlich and I talked a bit more after this. Here's what I think we settled on for the list of tags:

  • has button (unchanged)
  • button waist height (unchanged)
  • APS (unchanged, but I need to unhide it) -- @yeisenberg lmk if you have a different preferred name for this tag
  • hard to reach button (this is new, ideally have it auto-select "has button")

And then I need to add example images for all of them.

@yeisenberg
Copy link
Collaborator

Great discussion! Wondering though, since all the other labels have tags that would be considered 'negative' or 'missing' whether we should make all of these that way too.
Suggested approach:

  • missing tactile-audible button
  • button is too high
  • button is hard to reach (maybe makes sense to combine with button is too high?)
  • missing walk signal (haven't looked at Prowag but maybe we should to know if this required)

@misaugstad
Copy link
Member

button is hard to reach (maybe makes sense to combine with button is too high?)

I really like that!

missing tactile-audible button

I think it's worth having this one in the positive instead of negative because of the knowledge required to know when this is missing. If users don't know what this means and therefore don't label it, we'd assume that all the pedestrian signal are tactile-audible, which I don't think is what we want. For now, I think I'd rather have people who know what they're doing choose to add a tag!

missing walk signal (haven't looked at Prowag but maybe we should to know if this required)

I think that we don't need to worry about adding this yet. What would it even look like to have a pedestrian signal without the walk signal? Just a button that doesn't do anything or only has sound?

So in summary, we're going with the following for now:

  • has button (unchanged)
  • tactile-audible button (changed from "APS", need to unhide it)
  • hard to reach button (replacing "button waist height")

@yeisenberg
Copy link
Collaborator

Thanks for the updates Mikey!! For signals with two buttons, would we suggest that the auditor place two tags then?

@misaugstad
Copy link
Member

I think that as of now, we are punting on figuring out whether there are one or two buttons. And when we do clustering, the two labels would be clustered together into only one anyway, so I think that we just add label even if there are multiple buttons!

@jonfroehlich
Copy link
Member Author

It's funny, I was labeling the other day, and perhaps because this was top-of-mind, felt like it was relevant to have a "has two buttons" tag (but I still don't see how can operationalize that given that the other tags assume only one button like "missing tactile-audible button" and "button is too high"—those labels begin to break down when we have the "has two buttons" tag because it creates ambiguity). Hmm....

So that does just siggest having the auditor place two tags: one for each button.

@misaugstad
Copy link
Member

IMO it would be better to have the ambiguity of not knowing which buttons are being referred to with the tags than it would be to train users to label the same pole multiple times because there are multiple buttons.

I'm basing that off the assumption that on a single pole it would be almost always be the case that both the buttons would have the same design. Not sure if others have a sense of how accurate that is.

@jonfroehlich
Copy link
Member Author

True. I think you're right. (And, in practice, I've found that the same buttons are designed on the same pole...)

So, do we want to add "has two buttons" then?

@misaugstad
Copy link
Member

I'd recommend replacing "has button" with "one button" and then adding a "two buttons" tag. And selecting one would automatically deselect the other.

@jonfroehlich
Copy link
Member Author

Nice, yes! Thank you.

@misaugstad
Copy link
Member

Great, so the new plan (switching from singular to plural for the other tags):

  • one button
  • two buttons (can't have this and "one button" selected)
  • hard to reach buttons
  • tactile-audible buttons (Chicago only)

This work for you @yeisenberg ?

@yeisenberg
Copy link
Collaborator

Looks good to me! what is the thought with Chicago only? like a testing phase?

@jonfroehlich
Copy link
Member Author

jonfroehlich commented Feb 27, 2024 via email

@misaugstad
Copy link
Member

That's fair, now that I've added an example image! 😁

@jonfroehlich
Copy link
Member Author

Great, thanks Mikey!

@misaugstad misaugstad mentioned this issue Mar 5, 2024
@misaugstad misaugstad moved this to done / on test servers in Mikey Task Board May 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: done / on test servers
Development

No branches or pull requests

3 participants