-
The importance of robots.txt in Search Engine Optimization
Posted on March 20th, 2009 No commentsThe Robots.txt file guides search engine bots through the pages that should be indexed. The Robots Exclusion Protocol – the rules for controlling how web pages on your site are indexed can be defined in robots.txt file. The file should lie at: http://www.yourdomain.com/robots.txt
The robost.txt file plays a vital role in the SEO process. It is important due to:
If you want to exclude pages that should be accessed ONLY by regesitered users.
If you want to exclude the duplicate content pages.You may use the google webmaster tool to genearte and analyze the robots.txt file.
You can find out more information about robots.txt at http://www.robotstxt.org -
Tips to preclude old web site pages which are appearing in the natural search results
Posted on March 19th, 2009 No commentsIt is very important to have a pre planned mapping strategy before new website scheduled launching date. A mapping strategy is a plan that maps existing (old website) pages (urls) to the new pages. This is particularly critical when page names (urls) will change from old site to new site.
If the pages are still listed in the search engine indexes and they have inbound links pointing to them then it is very important to redirect them. By redirecting these links to pages on the new site, we transfer the link value from the old links(pages) to the new ones. We must do by such method that will cause the server to issue a header response of 301 (Permanent). This is the only response that is uniformly interpreted by major search engines as a request to index the new page and transfer the qualities of the old page to it. So before launching a new site, we must in place:
* A transition strategy to map old pages over to new ones
* Identification of existing pages that have valuable inbound links
* Redirecting links using method that issue a header response of 301 (Permanent)
 |
 |
 |
 |
Get Update
Via Email and RSS
Subscribe to this blog's RSS feed, or enter your email address below to get updates, news, and more!