My site is not able to get indexed in chatgpt search
My site is no where to be found on chatgpt search in either mentions, citation or links. I need help to make chatgpt crawl and index my site. I am loosing traffic to my site. I’ve my website indexed in Bing and Google and also have used sitemap.xml file and basic SEO. Someone recommended here that sites indexed by Bing can be included in chatgpt and also I shall allow OAI-SearchBot which is the main crawler used specifically for indexing websites for chat-gpt search. Further will adding LLMs.txt file help?
Here is the quick way to fix chatgpt not indexing your site’s pages. Allow the following AI bots/crawler via your robots.txt file.
Also if you are using Cloudflare, then allow AI bot crawlers. By default Cloudflare now block AI crawlers and so they cannot crawl and index your pages, thus you loose site visitors.
Follow this steps that will help you get your site indexed in chatgpt search.
Check you web hosting provider. Many web hosting companies now-a-days have started blocking AI bots including chatgpt at server-level to save CPU spikes and bandwidth wasteage. But it is affecting the crawling and indexing of sites by AI bots like chatgpt. Web hosts don’t tell you this and site owner keeps wondering that why their content is not ranking in chatgpt. You can switch to AI-ready and friendly web host like The-Online.com which does not block any AI bots. My site after transferring from bluehost to The Online was able to get indexed in chatgpt and even in perplexity!