-
Notifications
You must be signed in to change notification settings - Fork 27
/
Copy pathapril-2022-update.html
332 lines (248 loc) · 17.7 KB
/
april-2022-update.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8" />
<meta http-equiv="X-UA-Compatible" content="IE=edge" />
<title>TANF Data Portal Project Updates - April 2022</title>
<link rel="stylesheet" href="css/uswds.css" />
<link rel="icon" type="image/x-icon" href="img/favicons/favicon.ico" />
<meta name="viewport" content="width=device-width, initial-scale=1">
<script src="https://cdnjs.cloudflare.com/ajax/libs/jquery/3.6.2/jquery.min.js"></script>
<script src="js/uswds.min.js"></script>
</head>
<body>
<a class="usa-skipnav" href="#main-content">Skip to main content</a>
<section class="usa-banner" aria-label="This page is maintained by the Design team at Raft LLC for the purposes of the TANF Data Portal project.">
<div class="usa-accordion">
<header class="usa-banner__header">
<div class="usa-banner__inner">
<div class="grid-col-auto">
</div>
<div class="grid-col-fill tablet:grid-col-auto">
<p class="usa-banner__header-text">This page is maintained by the Design team at Raft LLC for the purposes of the TANF Data Portal project.</p>
</div>
</div>
</header>
</section>
</div>
</div>
</nav>
</header>
<main id="main-top">
<div class="usa-overlay"></div>
<header class="usa-header usa-header--basic">
<div class="usa-nav-container">
<div class="usa-navbar">
<div class="usa-logo" id="basic-logo">
<em class="usa-logo__text">
<a href="./index.html" title="TDP Project Updates">
TANF Data Portal Project Updates
</a>
</em>
</div>
<button class="usa-menu-btn">Menu</button>
</div>
<nav aria-label="Primary navigation" class="usa-nav">
<button class="usa-nav__close">
<img src="./img/close.svg" role="img" alt="Close" />
</button>
<ul class="usa-nav__primary usa-accordion">
<li class="usa-nav__primary-item">
<a href="./index.html" class="usa-nav__link">
<span>January 2023</span>
</a>
</li>
<li class="usa-nav__primary-item">
<a href="./August-2022-Update.html" class="usa-nav__link">
<span>August 2022</span>
</a>
</li>
<li class="usa-nav__primary-item">
<a href="april-2022-update.html" class="usa-current" aria-current="page">
<span>April 2022</span>
</a>
</li>
<li class="usa-nav__primary-item">
<a href="January-2022-Update.html" class="usa-nav__link">
<span>January 2022</span>
</a>
</li>
<li class="usa-nav__primary-item">
<a href="August-2021-Update.html" class="usa-nav__link">
<span>August 2021</span>
</a>
</li>
<li class="usa-nav__primary-item">
<a href="June-2021-Update.html" class="usa-nav__link">
<span>June 2021</span>
</a>
</li>
</ul>
</nav>
</div>
</header>
<div class="usa-section">
<div class="grid-container">
<div class="grid-row grid-gap">
<div class="usa-layout-docs__sidenav desktop:grid-col-3">
<nav aria-label="Secondary navigation">
<ul class="usa-sidenav">
<li class="usa-sidenav__item">
<a href="index.html">January 2023</a>
</li>
<li class="usa-sidenav__item">
<a href="August-2022-Update.html">August 2022</a>
</li>
<li class="usa-sidenav__item">
<a href="april-2022-update.html" class="usa-current" aria-current="page">April 2022</a>
</li>
<li class="usa-sidenav__item">
<a href="January-2022-Update.html">January 2022</a>
</li>
<li class="usa-sidenav__item">
<a href="August-2021-Update.html">August 2021</a>
</li>
<li class="usa-sidenav__item">
<a href="June-2021-Update.html">June 2021</a>
</li>
</ul>
</nav>
</div>
<main
class="usa-layout-docs__main desktop:grid-col-9 usa-prose usa-layout-docs"
id="main-content"
>
<h1>TDP Project Update - April 2022</h1>
<p class="usa-intro">
Since our last update focused on the results of our research around resubmission, we have been researching the navigation hierarchy of the new TANF Data Portal (TDP).
</p>
<p>As you maybe aware, TDP is a web-based platform that will—in its first release—allow users to securely upload and download quarterly TANF files. Future releases will introduce a host of other functionality that enhances the data transmission experience for our users (e.g. revamped transmission and questionable case reports in TDP).</p>
<p>The way pages are organized in a website—its Information Architecture (IA)—is an important aspect of the user experience of any application or website; it’s something that can make the difference between a frustrating or enjoyable experience. Our research on this front has been aimed at ensuring that our users will be able to easily navigate TDP and find information that they need on it right from its earliest versions—as well as to make sure that as TDP grows more advanced in its functionality it doesn’t become more confusing to use.</p>
<h2 id="how-the-test-was-set-up">How the test was set up</h2>
<p>There are two core methods used to test the IA of a website:</p>
<ul>
<li>Card sorting, where users group menu labels into headers that make sense to them.</li>
<li>Tree testing, where users are asked to find specific functions within a list of nested labels.</li>
</ul>
<p>
To understand the usability and legibility of labels associated with current and future pages of the TDP platform we opted for a type of tree-testing. Using Google Forms, we created a survey that replicated the questions and answers of a typical tree-test and administered the first round to our users in the Office of Family Assistance (OFA). The second round was facilitated with a variety of TANF grantees.
</p>
<p>Through this current study, we wanted to understand whether different pages of the new TDP website are easily identifiable and reachable. In other words, we want to know if the navigation patterns of the new website made sense to user and supported their ability to quickly find what they’re looking for on the portal.</p>
<hr style="border: 2px solid #0050d8; margin-top: 40px;">
<h2 id="how-the-form-worked">How the form worked</h2>
<p>
Through a carefully prepared Google Form, we asked questions about where users could find something on the website and asked them to choose from a list of options. Each of these options represented a page or tab within a page on the portal. Each question had two parts. The first introduced a set of menu labels one tier above the intended answer in the page hierarchy (e.g., Sign up, Log in). The second introduced the sections of a page where the user could actually find information they were seeking (e.g. Profile information, Request Access to Portal).
</p>
<h2 id="who-participated">Who participated</h2>
<p>Most participants correctly identified menu labels and successfully found relevant information by choosing options that led to destinations aligned with our existing plans for TDP’s Information Architecture.</p>
<p>One of the key metrics used to evaluate a tree-test is its success rate, which is the percentage of participants reaching the intended destination for a particular task. Devoid of any visual cues like search bars or hyperlinks, tree-tests by nature are stripped down to bare menu labels that users are asked to make sense of.</p>
<p>We derived the success rate by calculating the total number of participants who arrived at the correct answer to each question. Statistically, this meant calculating the number of correct answers for Part 2 of each question and dividing those by the total number of participants. Results were interpreted based on the importance and relevance of tasks based on essential TDP functionality for different types of users. For example, for an OFA user might need to navigate some of TDP’s administrative pages whereas an STT user will only need to navigate the more data-centric pages.</p>
<p>Below is a table that details the success rate for our study.</p>
<table class="usa-table usa-table--borderless">
<caption>
Success Rates
</caption>
<thead>
<tr>
<th scope="col">Categories (OFA & STT)</th>
<th scope="col">Correct Path</th>
<th scope="col">Success Rate (25 Participants; 15 OFA, 10 STT)</th>
<th scope="col">Number of participants who arrived at Question Part 2</th>
<th scope="col">Visualized Pathway Results</th>
</tr>
</thead>
<tbody>
<tr>
<th scope="row">TANF Information</th>
<td>Resources-> TANF Transmission File Layout </td>
<td>68%</td>
<td>21</td>
<td><a href="https://user-images.githubusercontent.com/28515874/162357897-85a4c40c-430e-40ed-b80e-3de69cd3d8d0.jpg"><img src="https://user-images.githubusercontent.com/28515874/162357897-85a4c40c-430e-40ed-b80e-3de69cd3d8d0.jpg" alt="Path chart of Resources to TANF Transmission File Layout showing success rate of 68% with 'Privacy Policy', 'Log In', and 'TANF Program Information' as incorrect branches."></a></td>
</tr>
<tr>
<th scope="row">Submission History</th>
<td>Log in->Data files->Submission History</td>
<td>76%</td>
<td>19</td>
<td><a href="https://user-images.githubusercontent.com/28515874/162357902-9395dd35-0b2e-41ac-8181-d8195e52877b.jpg"><img src="https://user-images.githubusercontent.com/28515874/162357902-9395dd35-0b2e-41ac-8181-d8195e52877b.jpg" alt="Path Chart of Data Files to Submission History showing success rate of 76% with 'Profile' and 'Reports' as incorrect branches."></a></td>
</tr>
<tr>
<th scope="row">Reports</th>
<td>Log in -> Reports -> Feedback Report</td>
<td>68%</td>
<td>20</td>
<td><a href="https://user-images.githubusercontent.com/28515874/162357898-1c6f606a-b3d5-476d-b141-1af5ec3dc9a1.jpg"><img src="https://user-images.githubusercontent.com/28515874/162357898-1c6f606a-b3d5-476d-b141-1af5ec3dc9a1.jpg" alt="Path Chart of Reports to Feedback Reports showing success rate of 68% with 'Admin', 'Data Files', 'Profile', 'WPR reports', and 'Transmission Reports' as incorrect branches."></a></td>
</tr>
<tr>
<th scope="row">Onboarding</th>
<td>Log in -> Help-> Tutorials</td>
<td>40%</td>
<td>13</td>
<td><a href="https://user-images.githubusercontent.com/28515874/162357904-abfa91aa-c92f-4f66-ac96-38358505a60c.jpg"><img src="https://user-images.githubusercontent.com/28515874/162357904-abfa91aa-c92f-4f66-ac96-38358505a60c.jpg" alt="Path Chart of Help to Tutorials showing success rate of 40% with 'Home', 'Data Files', 'Reports', 'Admin', and 'FAQs' as incorrect branches."></a></td>
</tr>
<tr>
<th scope="row">Data Dashboard</th>
<td>Log in -> Help-> Tutorials</td>
<td>76%</td>
<td>19</td>
<td><a href="https://user-images.githubusercontent.com/28515874/162357896-e3762c45-6c1b-430c-abf9-a9388f28506e.jpg"><img src="https://user-images.githubusercontent.com/28515874/162357896-e3762c45-6c1b-430c-abf9-a9388f28506e.jpg" alt="Path Chart of Analytics to Data Dashboard showing success rate of 76% with 'Reports', 'Data Files', and 'Profile' as incorrect branches."></a></td>
</tr>
<tr>
<th scope="row">OFA User Management</th>
<td>Log in->Admin Profile->Manage Users</td>
<td>87%</td>
<td>13</td>
<td><a href="https://user-images.githubusercontent.com/28515874/162357893-d89eaaf5-652c-4760-9da9-2eea9ae66179.jpg"><img src="https://user-images.githubusercontent.com/28515874/162357893-d89eaaf5-652c-4760-9da9-2eea9ae66179.jpg" alt="Path Chart of OFA User Management to Manage Users showing success rate of 86% with 'Help' and 'Home' as incorrect branches."></a></td>
</tr>
<tr>
<th scope="row">STT User Access</th>
<td>Log in->Home-> Request Access to Portal</td>
<td>20%</td>
<td>2</td>
<td><a href="https://user-images.githubusercontent.com/28515874/162357899-281539f8-f255-49b3-a555-567992975319.jpg"><img src="https://user-images.githubusercontent.com/28515874/162357899-281539f8-f255-49b3-a555-567992975319.jpg" alt="Path Chart of Homepage to Request Access showing success rate of 13% with 'Help', 'Admin', and 'Profile' as incorrect branches."></a></td>
</tr>
<tr>
<th scope="row">STT File Upload</th>
<td>Log In -> Data Files -> Upload File by Quarter</td>
<td>70%</td>
<td>8</td>
<td><a href="https://user-images.githubusercontent.com/28515874/162357905-d49801c0-da55-42c3-9264-ab3245612fd7.jpg"><img src="https://user-images.githubusercontent.com/28515874/162357905-d49801c0-da55-42c3-9264-ab3245612fd7.jpg" alt="Path Chart of Data Files to Upload Files showing success rate of 86% with 'Home', 'Reports', and 'Current Submission' as incorrect branches."></a></td>
</tr>
</tbody>
</table>
<p>The success rate is depicted in the table above along with other relevant choices for some questions. These choices are useful for further onboarding research and helping users familiarize with the platform.</p>
<h3 id="interpreting-results" style="margin-top: 100px;">Interpreting the results</h3>
<p>The proposed hierarchy of pages and nested labels for TDP were found to work for both OFA and STT users. Many our users were able to correctly find TANF information, Manage Users and Access Submission History, Feedback Reports and Analytics according to this survey.</p>
<p>However, finding onboarding material like in-app tutorials proved confusing for many users, with only 40% of participants arriving at the correct choices.</p>
<h3 id="project-impact" style="margin-top: 100px;">Project impact</h3>
<p>A significant insight from the first phase of tree-testing is that the proposed Information Architecture is usable and navigable. However, to create a friction-free navigation experience, it is critical to address and control for incorrect pathways and gaps in success rates.</p>
<p>We map project impact by analyzing the level of risk associated with a user not arriving at an intended destination. In other words, if a user cannot perform critical functions within the app because of confusing navigation patterns, it might require changes to the TDP Sitemap, or to other designs.</p>
<a href="https://user-images.githubusercontent.com/28515874/162357900-98e07af2-95f0-4c96-84c6-a1bcba108739.jpg">
<img src="https://user-images.githubusercontent.com/28515874/162357900-98e07af2-95f0-4c96-84c6-a1bcba108739.jpg" alt="Graph with axes 'Non critical' to 'Critical' and 'Minimal Risk' to 'High Risk'. High risk:Critical contains STT User Access and Onboarding. Minimal Risk:Critical contains Submission History, Reports, Data Dashboard, and File Upload. Minimal Risk:Non Critical contains TANF Resources.">
</a>
<p>Risk Categories:</p>
<ul>
<li><strong>High Risk</strong> - Critical function, low success rate (less than 50%)</li>
<li><strong>Moderate Risk</strong> - Non-critical function, low success rate (less than 50%)</li>
<li><strong>Low Risk</strong> - Critical & non-critical function, medium success rate (between 50-80%)</li>
<li><strong>Minimal Risk</strong> - Critical & non-critical function, high success rate (greater than 80%)</li>
</ul>
<h2 id="conclusions">Conclusions and future research</h2>
<p>Our findings broadly indicate that the new TANF Data Portal (TDP) will have a usable and navigable structure with two areas of potential improvement—User Access and Onboarding.</p>
<p><strong>User Access</strong></p>
<p>Given elements of how logging into TDP will need to happen for security reasons, User Access is one of the less alterable areas of functionality. To ensure that sign-up and sign-in to TDP is a smooth experience we’re pursuing a step by step guide on Getting Started in TDP as one of the first materials prospective new users will receive for OFA.</p>
<p><strong>Onboarding</strong></p>
<p>The ‘Help’ label leading to Tutorials and FAQs is one of the areas with a low success rate. Though it is an area that can be addressed by onboarding, as a future page, its position in the hierarchy can be further explored and is a likely area for future research. Future research could also explore whether a different name for the page would be more successful.</p>
<hr style="border: 2px solid #0050d8; margin-top: 40px;">
<h2 id="office-hours">Reminder: We have office hours!</h2>
<p>
In addition to many upcoming structured and planned rounds of research we'd love to offer up some unstructured time to hear from you.
If you have questions about the project, feedback about elements of the current system you'd like to see TDP address, or have
anything else in mind, we'll be offering a number of time slots to hear it each month. If the available times don't work with your
schedule or you'd simply like to get it touch via email, please feel free to continue reaching out via <a href = "mailto: mreiter@goraft.tech">mreiter@goraft.tech</a>.
</p>
<a href="https://doodle.com/bp/milesreiter/tanf-data-portal-tdp-research-office-hours" class="usa-button"><span style="color: white;">Book Office Hours</span></a>
</main>
</div>
</div>
</div>