Skip to content

Latest commit

 

History

History
76 lines (57 loc) · 3.83 KB

README.en.md

File metadata and controls

76 lines (57 loc) · 3.83 KB
Raw

COVID-19/2019-nCoV Time Series Infection Data Warehouse

简体中文 | English

COVID-19/2019-nCoV time series infection data warehouse, the data source is Ding Xiang Yuan.

Researchers
Recently, many college teachers and students contacted me, hoping to use these data for scientific research. However, not everyone is familiar with the use of APIs and the format of JSON, so here is the data warehouse to publish the latest data in CSV format, which can be easily processed and loaded by most software.

The data is obtained by COVID-19 Infection Data Realtime Crawler. The data will be published hourly.

Due to the limitation of the server's bandwidth, starting from March 19, 2020, /nCoV/api/overall and /nCoV/api/area do not response time-series data. You can fetch time-series data in json folder. If you call the API with latest=0, please modify the request parameters, otherwise, you do not need to do any modification.

CSV File List

  1. Overall Data DXYOverall.csv
  2. Regional Data DXYArea.csv(Including city names in English)
  3. News DXYNews.csv
  4. Rumors DXYRumors.csv

Since 4db432f, DXYArea.csv contains province- and city-level data in China, and data of Hong Kong, Macao and Taiwan regions and overseas are also available in this file.

In addition, you can also refer to this issue to customize your own data set.

JSON File List

Due to the instability of API, this project will also push latest static JSONs into the json folder. Data from JSON files are exactly the same as the data responded from the API.

Data customization is not accepted. If you have more requirements for data, please handle it on your own.

Data Description

  1. As mentioned in Issue #21, Some data are duplicated. For example, in Henan Province, there is a city-level document recording Nanyang (Dengzhou inclusive) and Dengzhou. Therefore, the data of "Dengzhou" will be double-counted once during the summation.

Noise Data

At present, some time series data in Zhejiang and Hubei are found containing noises. The possible reason is the manually processed data were recorded by mistake.

The crawler just crawl what it sees, do not deal with any noise data. Therefore, if you use the data for scientific research, please preprocess and clean the data properly.

In the meantime, I opened an issue for you to report the potential noise data. I will check and remove them periodically.

Reference

Packages

  1. If you would like to analyze the data with R, you can refer to pzhaonet/ncovr. This project will help you to directly load data into R from either GitHub Data Warehouse or API.

Analysis

  1. jianxu305/nCov2019_analysis
    Features: See here.
  2. lyupin/Visualize-DXY-2019-nCov-Data
    Features: See here.
  3. Avens666/COVID-19-2019-nCoV-Infection-Data-cleaning-
    Features: See here

Wish you all the best.