OAI-SearchBot Whitelisting

[robwent]

Paste the full User-Agent String here

Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; OAI-SearchBot/1.0; +https://openai.com/searchbot)

Is this for Addition / Removal?

• Addition
• Removal
• Keep a watch on this one

Did the User-Agent request robots.txt first?

• Yes
• No

Post Log Excerpt to show User-Agent behavior (10-20 lines is enough)

Post log excerpt here (paste in between the ```     ``` markers)

Additional information

I would like to suggest whitelisting OpenAI's new SearchGPT crawler in a similar way to Google and Bing.
OAI-SearchBot is the new agent for their upcoming Google search challenger.
Full info on user-agents and what each one is used for:
https://platform.openai.com/docs/bots
Associated IP addresses:
https://openai.com/searchbot.json