go-concurrent-urls-fetching

A go-based repository to demonstrate multiple techniques to concurrently fetch multiple url over http.

Outputs

• Below is the program execution output

~$ go run main.go

https://twitter.com : 200 OK
https://google.com : 200 OK
https://microsoft.com : 200 OK
https://cisco.com : 200 OK
https://amazon.com : 200 OK
https://facebook.com : 200 OK

https://google.com : 200 OK
https://twitter.com : 200 OK
https://microsoft.com : 200 OK
https://facebook.com : 200 OK
https://amazon.com : 200 OK
https://cisco.com : 200 OK

https://twitter.com : 200 OK
https://google.com : 200 OK
https://amazon.com : 200 OK
https://facebook.com : 200 OK
https://microsoft.com : 200 OK
https://cisco.com : 200 OK

worker 1 :: https://google.com : 200 OK
worker 0 :: https://microsoft.com : 200 OK
worker 3 :: https://facebook.com : 200 OK
worker 1 :: https://amazon.com : 200 OK
worker 0 :: https://twitter.com : 200 OK
worker 2 :: https://cisco.com : 200 OK

• Below is the tests execution output

:~$ go test -cover -failfast -v
=== RUN   TestFetch_Valid
--- PASS: TestFetch_Valid (0.01s)
=== RUN   TestFetch_Invalid
--- PASS: TestFetch_Invalid (0.00s)
=== RUN   TestFetch_Timeout
--- PASS: TestFetch_Timeout (6.02s)
=== RUN   TestFetch_Error
--- PASS: TestFetch_Error (0.00s)
=== RUN   TestFetch_EndToEnd
=== RUN   TestFetch_EndToEnd/testing_status_200
=== RUN   TestFetch_EndToEnd/testing_status_400
=== RUN   TestFetch_EndToEnd/testing_status_401
=== RUN   TestFetch_EndToEnd/testing_status_404
=== RUN   TestFetch_EndToEnd/testing_status_503
=== RUN   TestFetch_EndToEnd/testing_status_n/a
--- PASS: TestFetch_EndToEnd (2.53s)
    --- PASS: TestFetch_EndToEnd/testing_status_200 (0.70s)
    --- PASS: TestFetch_EndToEnd/testing_status_400 (0.38s)
    --- PASS: TestFetch_EndToEnd/testing_status_401 (0.34s)
    --- PASS: TestFetch_EndToEnd/testing_status_404 (0.32s)
    --- PASS: TestFetch_EndToEnd/testing_status_503 (0.31s)
    --- PASS: TestFetch_EndToEnd/testing_status_n/a (0.47s)
=== RUN   ExampleFirstWorker
--- PASS: ExampleFirstWorker (1.82s)
=== RUN   ExampleSecondWorker
--- PASS: ExampleSecondWorker (1.08s)
=== RUN   ExampleThirdWorker
--- PASS: ExampleThirdWorker (1.02s)
=== RUN   ExampleFourthWorker
--- PASS: ExampleFourthWorker (1.04s)
PASS
coverage: 85.5% of statements
ok      github.com/jeamon/gofetching  13.692s

License

Please check & read the license details

Contact

Feel free to reach out to me before any action.