Skip to content

Latest commit

 

History

History
54 lines (45 loc) · 4.48 KB

README.md

File metadata and controls

54 lines (45 loc) · 4.48 KB

Pulse Covid Feature: Questionnaire Two

Note: This entry includes the code for analyzing data from phases 2, 3, 3.1, 3.2, 3.3, 3.4, and 3.5 of the federal Household Pulse Survey. The Household Pulse Survey introduced questionnaire two with its second round of data collection between August 19 and October 26, 2020, and completed its third round of data collection between October 28, 2020, and March 29, 2021. A continuation of the third round (phase 3.1) began on April 14 and ended on July 5, 2021, a second continuation of the third round (phase 3.2) began on July 21 and ended on October 11, 2021, a third continuation of the third round (phase 3.3) began on December 1, 2021 and ended on February 7, 2022, a fourth continuation of the third round (phase 3.4) began on March 2, 2022 and ended on May 9, 2022, and a fifth continuation of the third round (phase 3.5) began on June 1, 2022. We stopped publishing new data on July 11, 2022. Both the second and third rounds collected biweekly data from US adults regarding the effects of the COVID-19 pandemic on themselves and their households, with phase 3.3 moving to a two-weeks-on, two-weeks-off data collection schedule that continues in phases 3.4 and 3.5. The first phase of the Household Pulse Survey ran from April 23 to July 21, 2020. The code for analyzing the phase 1 data can be found here.

This repository contains the code and data needed to calculate estimates of various COVID-19 impacts on US adults and their households by geography and race/ethnicity as well as the corresponding standard errors and significance of these estimates. The scripts read in data from the federal Household Pulse Survey public use files to estimate COVID-19 imppacts on few selected variables for the US, all 50 states and the District of Columbia, and the 15 largest metropolitan statistical areas (MSAs). The output data files of this repo power Urban's interactive Tracking COVID-19’s Effects by Race and Ethnicity: Questionnaire Two data feature visualizing impacts of COVID-19 on US adults and their households by geography and race/ethnicity. You can view the code for creating the web application at this Github repo.

The output data (and data dictionaries) can also be accessed and downloaded on the Urban Data Catalog.

These numbers are estimates and may not equal the actual totals in each geography. We highly recommend interpreting these results as relative impacts of COVID-19  which can be used to inform race-conscious solutions that account for the pandemic's disparate impacts by race and ethnicity.

For more information, see the technical appendix from our interactive data feature.

Required R Libraries:

  • tidyverse
  • readxl
  • testit
  • tigris
  • stringr
  • httr
  • here
  • srvyr==1.0.0
  • survey==4.0
  • fastDummies
  • aws.s3

Directory Structure:

  • scripts/ stores the relevant scripts
    • 01_generate_weekly_puf_data.R: Downloads Pulse Survey public use files, creates race/ethnicity variable and indicator variables, and appends replicate weights. The data produced from this file is stored on Urban's Data Portal.
    • 02_generate_group_vs_avg_standard_errors.R: Calculates means and standard errors for each indicator/geography/week/race combination and significance of difference between each population and subgroup mean. Outputs data file that powers the Tracking COVID-19’s Effects by Race and Ethnicity: Questionnaire Two feature.
    • 03_upload_to_s3.R: Uploads data and metadata to AWS S3 bucket.
    • 04_perform_qc_checks.R: Conducts quality control checks on the results output from scripts 02 and 03.
  • data/ stores the data
    • raw-data/: stores the raw Pulse Survey public use files including the data, replicate weights, and data dictionary.
    • intermediate-data/: stores the processed public use data and the intermediate outputs of the standard error calculations.
    • final-data/: stores the final data file produced by 02_generate_group_vs_avg_standard_errors.R that powers the data feature.

Contact

Contact Alena Stern at astern [at] urban.org