Top VPS Hosting Provider

Welcome to the myhosting.com Forums.
+ Reply to Thread
Results 1 to 2 of 2
  1. 2011-07-01, 12:21 AM #1
    Randy5
    Randy5 is offline Master Member
    Join Date
    May 2010
    Posts
    571

    Default making your site web bot-friendly

    Any tips for making your website friendly to Internet bots? Is this different from SEO?
    Reply With Quote Reply With Quote
  2. 2012-02-01, 08:30 AM #2
    suwunk
    suwunk is offline Super Moderator
    Join Date
    Aug 2010
    Posts
    1,083

    Default

    Make use of the robots.txt file on your web server. This file tells crawlers which directories can or cannot be crawled. Make sure it's current for your site so that you don't accidentally block the Googlebot crawler. Visit Frequently asked questions - Controlling Crawling and Indexing - Google Code to learn how to instruct robots when they visit your site. You can test your robots.txt file to make sure you're using it correctly with the robots.txt analysis tool available in Google Webmaster Tools.
    Webmaster Guidelines - Webmaster Tools Help
    Reply With Quote Reply With Quote

 
« Previous Thread | Next Thread »

Similar Threads

  1. making a program user friendly
    By PotsNPans in forum Programming
    Replies: 0
    Last Post: 2011-06-30, 01:10 AM
  2. making money on a template
    By Randy5 in forum How-To
    Replies: 0
    Last Post: 2011-06-24, 07:19 AM
  3. user friendly
    By Stoddard in forum Beginners
    Replies: 1
    Last Post: 2011-05-04, 12:05 AM
  4. search engine-friendly blog
    By PotsNPans in forum How-To
    Replies: 2
    Last Post: 2011-02-17, 02:51 PM
  5. bot postings
    By Rusher in forum Virtual Server
    Replies: 1
    Last Post: 2010-10-26, 01:59 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts

Forum Rules

Version 4.1.7
Copyright ©2000 - 2013
All times are GMT -4. The time now is 09:19 PM.