Five quick ways to get a website indexed by Google
Launching a brand new website is tough. When you first start out, your website is completely unknown, you have no inbound links, and you canâ€™t be found in the search engines. So what do you do?
I've launched a lot of new websites over the years and I've experimented with many different methods of getting websites indexed. Here are my top five indexing tips...
1) Submit your website URL to Google
This is a bit of a no-brainer but it really has to be first in this list. Google canâ€™t index your website if it doesnâ€™t know about it, so submitting your homepage URL is definitely the best place to start. This may not be the quickest indexing method but itâ€™s a safe and sure one to start you off.
, Of course, Google makes no guarantees that it will index every URL that is added but donâ€™t let this stop you. Just make sure you only add one URL per domain (normally your homepage) otherwise it could be considered spam. Googleâ€™s crawlers will find all the other pages in your website by following internal links.
- Google has removed their 'submit URL' page, instead, you need to register your website in Google Webmaster Tools and use their 'crawl as GoogleBot feature' and then click the 'Add to index' button. This change stops people from submitting pages to Google that they don't have control over.
- Microsoft Is removing their URL submission tool as well so you will need to verify your site in Bing Webmaster Tools to submit new links.
2) Add an XML sitemap
It can take quite some time for Googleâ€™s crawlers to index all the pages in a new website just by following links. The larger the website, the more time it can take. Pages at a high click depth from your homepage can take a lot longer to get indexed because the crawlers donâ€™t discover them until after several rounds of indexing and link following have occurred. I find that adding an XML sitemap really solves this problem because it tells Google about all your pages ahead of time. If you have a large website with many high click depth pages then an XML sitemap will help indexing enormously.
An XML sitemap is basically a text file (saved with an XML extension) that lists all the URLs in your website. The XML sitemap protocol is very simple so it can easily be created by hand or automatically with an XML sitemap generator tool. The XML sitemap standard is supported by Google, Yahoo! and Microsoft so the same sitemap can be used for all three search engines.
Once you have created your sitemap file you have to submit it to each search engine. To add a sitemap to Google you must first register your website with Google Webmaster Tools. This website is well worth the effort, itâ€™s completely free plus itâ€™s loaded with invaluable information about your website ranking and indexing in Google. Youâ€™ll also find many useful reports including keyword rankings and health checks. I highly recommend it.
Microsoft doesnâ€™t have a special way to submit a sitemap yet (they always seem to be so far behind the competition) so you have to use their regular Submit my site form instead.
3) Submit an article to Reddit
Another interesting thing Iâ€™ve noticed lately has to do with social news websites. If you submit an article to Reddit or one of the many other large social news websites, your URL tends to get picked up by Google very quickly. Typically a Reddit article will appear in Googleâ€™s index after only a day or two. This is great news if you want new pages on your website to be indexed very quickly.
The downside to social news submission (if you can call it a downside) is the URL only stays in Googleâ€™s index for a few days to a week before it drops out again. After this happens it seems to be crawled as per normal, eventually appearing in the index for good after a more natural timeframe. The only exception to this rule is when an article becomes extremely popular and rises to the front page of the news website - these tend to stay in the index and not drop out at all.
Social news websites are a great way to get new websites indexed. If your site has lots of interesting content you could even find yourself on the front page so itâ€™s well worth giving them a try.
4) Add a Google map
I discovered this little trick just the other day when building a website that used the Google Maps API. To make the map work I needed to first apply for a Google Maps API key. So I did this, then played with a few test pages on the live domain - to my surprise after a couple of days the website was ranking on the first page of Google, I hadn't even submitted the domain to Google yet!
Eventually I figured out what was happening. One of the Google Maps API conditions is the maps you create must be in the public domain (i.e. not behind a login screen). So as an extension of this, it seems that pages (or domains) that use the Google Maps API are crawled and made public. Very neat!
5) Source quality inbound links
Another very useful method of speeding up indexing is to get as many inbound links from quality websites as possible. If you know someone who runs a popular website or blog why not ask them for a link and a bit of a plug? It seems that the more popular a website is, the more indexing attention it gets from Google, so creating a good inbound linking strategy is essential. Spend time writing interesting and useful articles for your new website and these should start attracting more and more good quality links over time...
Good luck with your indexing everyone. I hope this article has been useful.
Updated: 11 May 2009
First published: 11 May 2009