Wanted to know how Google and search engine would crawl
through your website and how it will fetch data? Usually we develop a website
or web developers do that for you and it looks good for human eyes, but will
this website be crawled by GoogleBot or BingBot or any other Search Spider
Robots is the question.
Once your website is crawled it will be indexed, but if you
see that your website or your posts are not indexed for few days then it’s high
time you perform this simple test just to know what is wrong. Note that as soon
as you write a new post and publish it and even if you submit it for indexing,
it will take some time for Google or Bing or any search engine to index your
page. So, it’s better to wait for 24 to 48 hours and then check again if your
post is indexed or not.
There is a way to do fetch as Google or Bing and then submit
it for indexing if you have any issues. You generally don’t have to do anything
as Google will automatically do that for you as soon as you publish a new post,
but if there is any crawl error that you see in Google Webmasters or if you
have changed your URL permanent link then it’s better to fix that and get your
post indexed again.
Follow the below steps to your post as Google:
Before you start you need to have a Google Webmaster account
created and your site registered in Webmaster.
Login to Google Webmaster Tools.
Go to Health and click on ‘Fetch as Google’.
If you have already registered then your domain name will
appear. Fill the entire URL and click on ‘fetch’.
Not Found – is when the url is not found anymore. I got this
message when I changed the permanent link of url.
