Mini-Project 1

Overview

In this mini-project, you will create at least two data visualizations of variables in the College Scorecard dataset and then write up your findings in a short blog post (400-500 words). You will study the data documentation, review the data dictionary to select variables for your analysis, and then finally produce your plots. In your blot post, you will detail how the data in this dataset was produced, along with what we learn by reviewing the plots.

Learning Goals

• Navigate different forms of data documentation
• Recognize differences in variable types and how they get assigned to R data objects
• Examine variation in and co-variation between data variables through exploratory plotting in R
• Communicate data findings in writing and effective data graphics
• Evaluate the ethical dimensions of data resources

Detailed Instructions

Set up your environment

1. In RStudio, File > New Project > Version Control > Git and then copy the URL to this repo. Open scorecard_analysis.Rmd and add your group member's names to the header (lines 5, 7, and 9).
2. Install the rscorecard package by entering the following in your console:

install.packages("rscorecard")

3. Navigate here to sign up for an API key through Data.gov. After you enter your name and email, the API key will be emailed to you. Copy this API key into line 33 of scorecard_analysis.Rmd. Run that code chunk.

Get to know the scorecard data

4. Download both the Scorecard Data Dictionary and the Institution-Level Technical Documentation here. Read pages 2-3 of the Technical Documentation to learn more about this dataset.
5. Open the Data Dictionary in Excel and select the tab for Institution_Data_Dictionary. There are thousands of variables in this dataset, falling into the broader categories of school, completion, admissions, cost, etc. Note how the file is organized, and specifically draw your attention to:

• Column 1 (NAME OF DATA ELEMENT): This is a long description of the variable and gives you clues as to what is represented in it.
• Column 2 (dev-category): This is the broad category the variable falls into.
• Column 6 (VARIABLE NAME): This is the column name for the variable. This is how you will reference the variable in R.
• Column 7 (VALUE): These are the possible values for that variable. Note that for many categorical variables, the values are numbers. We are going to have to associate the numbers with their corresponding labels.
• Column 8 (LABEL): These are the labels associated with the values recorded for the variable.
• Column 11 (NOTES): This provides notes about the variable, including whether it is currently in use and what missing values indicate.

6. In addition to unitid and instnm, select five more variables from the data dictionary that you'd like to work with in your analysis. We're only going to be looking at MA schools, so you can leave variables that record the state and region of the institution off of your list. Select at least one numeric variable, and at least one ordinal variable. Read up on these selected variables in the Technical Documentation (Command/Control + F to find the variable name in the PDF.)

Import and prepare data

7. On line 40 of scorecard_analysis.Rmd, add the list of variable names (from column 6 in the data dictionary) as additional arguments to the sc_select() function. Note that you should supply these names in lowercase. Run the code chunk.
8. Check out the data frame, and note columns with many missing values. If the values are missing in more than 25% of rows, return to the data dictionary and select new columns. Re-run the code.
9. Factor your ordinal variable in the code chunk starting at line 44, using the factor() function. The levels you should supply as an argument will be listed in the VALUES column in the data dictionary, and the associated labels you should supply as an argument will be listed in the LABELS column of the data dictionary. I provided an example in the comments. Be sure to reference the help pages for the factor() function if you have questions!

Design two data visualizations

10. Create two data visualizations showcasing the survey findings - one univariate plot and one plot adding an additional variable to your previous univariate plot. Be sure to label your plots and consider the plot aesthetics.

Write blog post

11. In 400-500 words, you should write a blog post reporting on your visualization:

• Paragraph 1: Introduce the dataset, how the data was produced, and what you specifically will be visualizing in your plots.
• Paragraph 2: Report on findings from your visualizations.
  • For each plot, you should summarize at least one quantitative fact that we can extrapolate, and interpret that finding. (e.g. on this plot, we can see that ... This indicates that ...)
  • You should also indicate how adding additional information to your univariate plot deepened your understanding of the relationship between these two variables.
• Paragraph 3: Summarize the key takeaway from your analysis and describe at least one ethical concern we should consider when analyzing this data. As a reminder of our ethics framework for this course:
  • What assumptions and commitments informed the design of this dataset?
  • Who has had a say in data collection and analysis regarding this dataset? Who has been excluded?
  • What are the benefits and harms of this dataset, and how are they distributed amongst diverse social groups?

Record standards and submit assignment

12. Open standards.Rmd, and under each heading, indicate how the work you completed for this project demonstrated fluency in that standard. Just 1-2 sentences per standard!
13. When you are done, you should save both .Rmd files, knit the documents, commit changes, and then push changes back to GitHub. That's it for submission. You don't need to submit anything on Moodle.

Evaluation

You will be evaluated on the extent to which your mini-project demonstrates fluency in the following course learning dimensions:

• Tracing Data Provenance:
  • Does your blog post detail how this dataset was produced?
  • Does your blog post detail the unit of observation in your dataset?
  • Does your blog post detail how the values in the variables you selected were measured?
• Data Fundamentals
  • Did you select at least one numeric and at least one ordinal variable?'
  • Were you able to successfully factor your selected ordinal variable?
  • Have you selected appropriate plots based on the variable types present in the dataset?
• Univariate Plotting
  • Have you produced at least one plot visualizing the values in a single variable in the dataset?
  • Have you detailed at least one quantitative finding, and at least one interpretation of that finding in the blog post?
• Visualization Aesthetics
  • Do you use visual cues effectively on the plot?
  • Are your axes set to an appropriate scale?
  • Are the values on your plot legible and clear?
• Visualization Context
  • Are there titles and labels for all variables on your plot?
  • Do your titles and labels accurately identify the unit of observation, variables, filters, geographic context, and temporal context?
• Multivariate Plotting
  • Have you produced at least one plot visualizing the values in two variables in the dataset?
  • Have you detailed at least one quantitative finding, and at least one interpretation of that finding in the blog post?
• Error Resolution and Problem-Solving
  • Do you describe at least one challenge that you faced in completing the computational portions of the assignmemt and how you solved it in standards.Rmd?