Add robots.txt to the root site and also add Sitemap.xml to the robot…

…s.txt file
firebolt-db · Oct 25, 2023 · cbd1c1a · cbd1c1a
1 parent 503c881
commit cbd1c1a
Showing 1 changed file with 3 additions and 0 deletions.
diff --git a/docs/robots.txt b/docs/robots.txt
@@ -0,0 +1,3 @@
+User-agent: *
+
+Sitemap: https://docs.firebolt.io/godocs/sitemap.xml