Skip to content

Commit

Permalink
This is why the cat shouldnt sit on my keyboard.
Browse files Browse the repository at this point in the history
  • Loading branch information
deedeeh committed Oct 21, 2024
1 parent 2895d06 commit 30f08d9
Show file tree
Hide file tree
Showing 4 changed files with 127 additions and 44 deletions.
2 changes: 1 addition & 1 deletion fixtures/downloaded/downloaded
Original file line number Diff line number Diff line change
@@ -1 +1 @@
Mon, 23 Sep 2024 20:27:17 GMT
Mon, 21 Oct 2024 10:36:51 GMT
9 changes: 8 additions & 1 deletion fixtures/downloaded/matomo-org.json
Original file line number Diff line number Diff line change
Expand Up @@ -1027,5 +1027,12 @@
"Valve/Steam HTTP Client 1.0 (SteamChatURLLookup)",
"Oh Dear Sitemap check https://ohdear.app",
"Mozilla/5.0 (compatible; OhDear/1.1; +https://ohdear.app/checker; brokenLinks)",
"Mozilla/5.0 (compatible; OhDear/1.1; +https://ohdear.app/checker; mixedContent)"
"Mozilla/5.0 (compatible; OhDear/1.1; +https://ohdear.app/checker; mixedContent)",
"Mozilla/5.0 Keydrop",
"Mozilla/6.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.0.0 Safari/537.36 Inspici (www.inspici.com)",
"meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)",
"meta-externalagent/1.1",
"meta-externalfetcher/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)",
"meta-externalfetcher/1.1",
"peer39_crawler/1.0"
]
9 changes: 8 additions & 1 deletion fixtures/downloaded/monperrus.json
Original file line number Diff line number Diff line change
Expand Up @@ -1077,6 +1077,7 @@
"Mozilla/5.0 (compatible; OdklBot/1.0 like Linux; [email protected])",
"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.0; +https://openai.com/gptbot)",
"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot",
"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; OAI-SearchBot/1.0; +https://openai.com/searchbot",
"Mozilla/5.0 (compatible; YandexRenderResourcesBot/1.0; +http://yandex.com/bots) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0",
"LightspeedSystemsCrawler Mozilla/5.0 (Windows; U; MSIE 9.0; Windows NT 9.0; en-US",
"Mozilla/5.0 (compatible; ev-crawler/1.0; +https://headline.com/legal/crawler)",
Expand Down Expand Up @@ -1150,5 +1151,11 @@
"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; [email protected])",
"Mozilla/5.0 (compatible; Monsidobot/2.2; +http://monsido.com/bot.html; [email protected])",
"GroupMeBot/1.0",
"Vercelbot (+https://vercel.com)"
"Vercelbot (+https://vercel.com)",
"facebookcatalog/1.0",
"meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)",
"meta-externalagent/1.1",
"meta-externalfetcher/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)",
"meta-externalfetcher/1.1",
"Mozilla/5.0 (compatible; KeybaseBot; +https://keybase.io)"
]
Loading

0 comments on commit 30f08d9

Please sign in to comment.