Merge pull request #735 from cmu-delphi/release/delphi-epidata-0.2.15

Release Delphi Epidata 0.2.15

Author: krivard

.bumpversion.cfg

@@ -1,5 +1,5 @@
 [bumpversion]
-current_version = 0.2.14
+current_version = 0.2.15
 commit = False
 tag = False
 

.github/workflows/missing_signals.yaml

@@ -0,0 +1,28 @@
+name: Missing Signal Detector
+
+on:
+  workflow_dispatch:
+
+jobs:
+  build:
+    runs-on: ubuntu-latest
+    steps:
+      - name: Check out code
+        uses: actions/checkout@v2
+        with:
+          ref: dev
+      - name: Set up Python 3.8
+        uses: actions/setup-python@v2
+        with:
+          python-version: 3.8
+      - name: Install Dependencies
+        run: pip install requests pandas
+      - name: Run Missing Signals Detector
+        run: python scripts/report_missing_covidcast_meta.py
+      - name: Upload Missing Artifact
+        if: failure()
+        uses: actions/upload-artifact@v2
+        with:
+          name: missing_db_signals.csv
+          path:  missing_db_signals.csv
+

.gitignore

@@ -7,3 +7,4 @@ __pycache__/
 /build
 /node_modules
 .mypy_cache
+/missing_db_signals.csv

docs/Gemfile.lock

@@ -204,15 +204,15 @@ GEM
       rb-fsevent (~> 0.10, >= 0.10.3)
       rb-inotify (~> 0.9, >= 0.9.10)
     mercenary (0.3.6)
-    mini_portile2 (2.5.1)
+    mini_portile2 (2.6.1)
     minima (2.5.1)
       jekyll (>= 3.5, < 5.0)
       jekyll-feed (~> 0.9)
       jekyll-seo-tag (~> 2.1)
     minitest (5.14.4)
     multipart-post (2.1.1)
-    nokogiri (1.11.5)
-      mini_portile2 (~> 2.5.0)
+    nokogiri (1.12.5)
+      mini_portile2 (~> 2.6.1)
       racc (~> 1.4)
     octokit (4.20.0)
       faraday (>= 0.9)

docs/api/covidcast-signals/fb-survey.md

@@ -85,8 +85,7 @@ survey, which go into more detail on symptoms, contacts, risk factors, and
 demographics. These are used for many of our behavior and testing indicators
 below. The full text of the survey (including all deployed versions) can be
 found on our [questions and coding page](../../symptom-survey/coding.md).
-Researchers can [request
-access](https://dataforgood.fb.com/docs/covid-19-symptom-survey-request-for-data-access/)
+Researchers can [request access](https://dataforgood.facebook.com/dfg/docs/covid-19-trends-and-impact-survey-request-for-data-access)
 to (fully de-identified) individual survey responses for research purposes.
 
 As of early March 2021, the average number of Facebook survey responses we

docs/symptom-survey/data-access.md

@@ -22,8 +22,7 @@ characteristics are available for download.
 De-identified individual survey responses can be made available to researchers
 associated with universities or non-profit organizations who sign a Data Use
 Agreement (DUA). To request access to the data please submit the information
-requested in [Facebook's page on obtaining data
-access](https://dataforgood.fb.com/docs/covid-19-symptom-survey-request-for-data-access/),
+requested in [Facebook's page on obtaining data access](https://dataforgood.facebook.com/dfg/docs/covid-19-trends-and-impact-survey-request-for-data-access),
 which sets out the basic conditions and provides a form to request access. An
 [international version of CTIS](https://covidmap.umd.edu/) is conducted by the
 University of Maryland (UMD) and access can be requested through the same

docs/symptom-survey/problems.md

@@ -61,6 +61,15 @@ June 26, 2021, 89.5% of the initial decrease in total response volume has been
 recovered. The response volume continued to recover as Android users updated to
 the fixed version of the Facebook app.
 
+## B13 Missing from Data Files (May-June 2021)
+
+Survey item B13 was added in Wave 11 beginning May 20, 2021. Due to a survey
+implementation bug, responses to B13 received between May 20 and June 16th were
+not included in the API or in microdata files. This problem was fixed on June
+16th; however, due to an oversight, certain microdata files were not corrected
+to contain B13 responses until September 27, 2021. All files should now contain
+responses to item B13 from the beginning of Wave 11.
+
 ## Incorrect Coding in Documentation
 
 We found a Qualtrics bug that affects the exported text of the survey (but not