Skip to content

Latest commit

 

History

History
25 lines (23 loc) · 728 Bytes

README.md

File metadata and controls

25 lines (23 loc) · 728 Bytes
Raw

1. Crawl

Configure src/config.js

dateFrom: // default is today
dateTo: // default is today

Start to crawl in above date range

yarn crawl

2. Import to mongo db

  • Use mongo Studio 3T to import output/json/* into mongodb.xoso.daily_result

You must choose the specific needed date, do not choose redundant date

Query the last date exist in db:

db.getCollection("daily_result_lo27").find({}).sort({date: -1})

3. Convert daily_result into daily_result_lo27

  • Use node src/tools/ConvertDailyToLo27.js to generate output/lo27
  • Use mongo Studio 3T to import output/lo27/* into mongodb.xoso.daily_result_lo27

You must choose the specific needed date, do not choose redundant date