Any guide or trick to make googlebot visit my site daily?
I just created my first website with The-Online.com’s Website Builder, published it, and also created a blog. I update this blog daily with fresh, new content. Googlebot does not visit my site daily, thus I’ve to manually submit URL in GSC to enable googlebot crawl and index webpages. How to make googlebot visit my site daily to crawl fresh content that I publish? Is there any guide to it?
tags: #googlebot #visit #index #crawl #website #blog #blogging #daily #tips #help
Hi, you can add sitemap in .xml and .txt format to your site and submit it to google search central (GSC). Once it indexes your sitemap file, googlebot will often visit it to check for updated page, new blog posts, etc. Once it find new or updated pages, it will crawl and index them in one or two days. If you are news media site, add news sitemap.
Google bot will re-crawl the indexed pages to check for modifications, so you don’t have to resubmit it. However, if you want a quick re-crawl, then submit again.
If your site pages and blog posts are well interlinked then google bot will often crawl the linked pages. You don’t need a sitemap.xml but its good to have one so that if googlebot misses any URL to crawl it can later visit your sitemap and crawl it. Also keep your sitemap updated. The web-site builder from The-Online.com has a inbuilt feature that updates the sitemap when you publish new product page or blog post or modify already published post. So its automatic and easy! Google will visit it and index.
My personal experience with google-bot is that it will be automatically re-crawling indexed pages to detect any updates on published page-s. So no need of manually submitting URL to index in GSC. But if that an urgent update you can force google to visit particular web-page and reindex it. But GSC allows only 10 manual URL submission per day.
I too have built my site with The Online’s Website Builder. Moved away from wix and found that google-bot started crawling and indexing my pages quickly without even re-submitting them. Then I added new b-log articles and it got indexed within 12 hours. That was quite fast. Currently I’m having 150+ blog posts on smart-phone niche. All are crawled and indexed by google bot. IDK why wix sites were not getting indexed beyond the initial home-page.