Skip to content

Commit

Permalink
Disallow invalid URL that pattern Googlebot keeps trying to request (#…
Browse files Browse the repository at this point in the history 
…344)
  • Loading branch information
@spilth
spilth authored Aug 1, 2024
1 parent d1168f5 commit 02e7ad1
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions public/robots.txt
View file
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,7 @@ Disallow: /catalog.html?f
Disallow: /catalog.html?_
Disallow: /catalog.atom
Disallow: /catalog.rss
Disallow: /catalog/*/catalog/*
Disallow: /catalog/*/relations
Disallow: /catalog/facet/*
Disallow: /catalog/*/web_services
Expand Down

0 comments on commit 02e7ad1

Please sign in to comment.