ArticleTrader.com
  

 Main Menu

  Home
  Member Login
  Forum
  Submit Article
  RSS Feeds
  Contact Us
  About

 Services

  Article Distribution
  Link Building

 Tools

  ArticleMS
  Directory Tracker

 Categories

  Automotive
  Business
  Computers
  Entertainment
  Finance
  Food
  Health
  Home and Family
  Internet
  Legal
  Science
  Self Improvement
  Shopping
  Society
  Sports
  Technology
  Travel
  Writing





























 
Welcome! ( Login | Register )
» ArticleTrader Forums » ArticleMS » Support » ArticleMS 2 and GoogleBot
Members Search Help

Pages: << prev 1 next >>
ArticleMS 2 and GoogleBot
This member is currently offline Anne Kirrin
Pool


Avatar

Member Level

Group: Moderators
Posts: 1,356
Joined: Apr 11, 2006

Go to the bottom of the page Go to the top of the page

It appears that googlebot may have an issue with Ams2...I have had several of my new sites giving GoogleBot a 503 error and having these sites not indexed.

I was tipped off to this by way of Googles WebMaster Tools....these sites where not allowing GoogleBot to access any of the pages including the home page.

I have used this free tool to emulate how GoogleBot views Headers: http://www.urivalet.com/

Most of my AMS2 sites are fine, but some were not.

The sites affected are hosted in two separate hosting environments: bluehost.com and godaddy.com

After comparing sites it occurred to me that it may be due to the settings.php file as the only difference between sites was in there.

The sites that were having problems had the cache settings set to '0'.
PHP:

//--Cache Settings--
//use_cache = 0 to disable caching
//use_cache = 1 to enable caching for search engine bots only (cached pages will only be displayed for bots)
//use_cache = 2 to enable caching for all guests/bots, articles are not cached (article stats will still update)
//use_cache = 3 to enable caching for all guests/bots, including the article pages (article stats will not update)
$set['use_cache'] = 0;
$set['use_cache_feeds'] = 0;  //(recommended) use cache for rss feeds



The sites that were getting indexed and not having issues in WebMaster Tools had the cache settings differently, like:
PHP:

$set['use_cache'] = 2;
$set['use_cache_feeds'] = 1;  //(recommended) use cache for rss feeds



After changing the cache settings in the affected sites the problem seems to have disapeared.

Anyone else have a similar issue?

Dejavu, any idea why this may be happening?


I read somewhere that it may actually be a server issue with the hosting company filtering out bots with to many requests on the site. Could GoogleBot be putting undue strain on an un-cached site? If so, how can we fix this for a small site?

.........................
Anne Kirrin is in Nepal for the month of November

ArticleMSSkins.net <<:::: New
Directory of Niche Article Sites <::::: Add your article site for free!!

Posted Sep 5, 2009, 5:42 pm
This member is currently offline Anne Kirrin
Pool


Avatar

Member Level

Group: Moderators
Posts: 1,356
Joined: Apr 11, 2006

Go to the bottom of the page Go to the top of the page

4 days after the above changes, My sites are indexed by Google...
If you are having problems with getting indexed try editing your settings.php file.
.........................
Anne Kirrin is in Nepal for the month of November

ArticleMSSkins.net <<:::: New
Directory of Niche Article Sites <::::: Add your article site for free!!

Last edited Sep 9, 2009, 12:29 pm by Anne Kirrin
Posted Sep 9, 2009, 12:28 pm
This member is currently offline Rich Odell
Droplet


Avatar

Member Level

Group: Members
Posts: 100
Joined: Sep 7, 2008

Go to the bottom of the page Go to the top of the page

Mine seem OK (I am at Hostgator).

BY the way, I used the site over at urivalet http://www.urivalet.com/ thats a cool tool, thanks for the recommendation!

Not surprised that Godaddy (or should I say Nodaddy!) can screw up the script! (don't get me started with that bunch of crooks Grrrrrrrrrrrrrr  :mad:).

-Rich
.........................
www.yourquickguideto.com

Last edited Sep 10, 2009, 12:58 pm by Rich Odell
Posted Sep 10, 2009, 12:57 pm
Pages:<< prev 1 next >>

Nov 28, 2009, 9:30 am

  

0.0176s