Skip to content

The solution to the assignment question given to me.

Notifications You must be signed in to change notification settings

rahulk789/DevOps

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

37 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

The following repository caters to the following instructions:

  1. Scrap tabular data from given URL(https://mcxlive.org/)
  2. Store data in database of your choice(postgres/mongo dB)
  3. Generate API from stored data ( json Response)
  4. Run scheduler(cron job) for above scrapper(every 1 hour)
  5. Design CI/CD pipeline

The execution of cronjob is done by the following commands:
crontab -e 0 * * * * cron projects/DevOps/cron.sh
enter crontab -l to see the added cron job.\

Json output after scraping:

image

Output on django server after retrieving stored data in postgresql.

image

About

The solution to the assignment question given to me.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages