Add Government-wide Metrics on the home page

[rebeccawilliams]

From @jlberryhill

Governmentwide summary stats (/dashboard/ level) for:

Data.gov views
public/non-public/restricted composition
% dataset growth from last quarter
% of agencies with DAP on /data/ page
% of bureaus represented
% of programs represented
% of public datasets downloadable (i.e., "published")
dataset link quality
% of datasets with file formats that match format listed in data.json
% datasets that are PDFs

[rebeccawilliams]

Here's an updated list of Metrics according to the current CAP Goal. The bold items were not listed above. Let's check them off as they are completed.

The manual items will need to be completed by OMB staff, but auto-generating trends based on OMB staff would be desirable. The manual items may be able to be automated by using the OMB Max API or asking Agencies to include this information on their Agency.gov/data page.

Fuel economic growth and innovation

• MANUAL/CRAWL IN FUTURE?: Agencies reporting Use & Impact answers, %, trends
• CRAWL Google Analytics API: Data.gov Web Analytics, Views per quarter, trends
• CRAWL Google Analytics API: Agency.gov/data DAP Participation, Participants per quarter, trends
• CRAWL?: Data.gov/Impact, Examples added per quarter, trends

Develop and maintain an EDI

• CRAWL data.json: Bureau & Program Participation over total Bureaus/Programs, %, trends
• TBD: % of SORNs, trends, % of PIAs, trends

Make data discoverable to the public

• CRAWL data.json: % of agencies with valid metadata, trends
• CRAWL data.json: % of datasets w a downloadable URL, trends
• CRAWL data.json: % of download URLs working, trends
• CRAWL data.json: % of datasets in which the file format matches the file format identified in the data.json metadata, trends
• CRAWL data.json: % of downloads in HTML format (machine-readability measure), trends
• CRAWL data.json: % of downloads in PDF format (machine-readability measure), trends

Prioritize and release valuable data through public engagement

• MANUAL: % of agencies with a transparent 2-way feedback mechanism for data prioritization, trends

Prevent inappropriate disclosure of sensitive information

• MANUAL: % of agencies with privacy reviews consistent with the Open Data Policy, trends

Assign roles & responsibilities to strengthen the culture of data management

• MANUAL/CRAWL IN FUTURE? Y/N—Is there a Chief Data Officer, Chief Technology Officer, or other senior staff position assigned responsibility for data management and release?
• MANUAL/CRAWL IN FUTURE? % of agencies who publicly assign points of contact for open data issues, trends

[rebeccawilliams]

Some gov wide metrics are here, but the display and data entry needs to be improved:

• http://labs.data.gov/dashboard/offices/2015-08-31/full and here:
• http://labs.data.gov/dashboard/offices/2015-08-31?show_totals=true

See also: #125, #129, #90, #120

[rebeccawilliams]

See this GAO report as well: http://www.gao.gov/assets/680/677368.pdf

[philipashlock]

Here's a great example of this for San Francisco - https://datasf.org/progress/