ArticleTrader Forums - Viewing Topic: ArticleMS 2 and GoogleBot

Anne Kirrin Pool Group: Moderators Posts: 1,356 Joined: Apr 11, 2006	Email WWW PM Quote
	It appears that googlebot may have an issue with Ams2...I have had several of my new sites giving GoogleBot a 503 error and having these sites not indexed. I was tipped off to this by way of Googles WebMaster Tools....these sites where not allowing GoogleBot to access any of the pages including the home page. I have used this free tool to emulate how GoogleBot views Headers: http://www.urivalet.com/ Most of my AMS2 sites are fine, but some were not. The sites affected are hosted in two separate hosting environments: bluehost.com and godaddy.com After comparing sites it occurred to me that it may be due to the settings.php file as the only difference between sites was in there. The sites that were having problems had the cache settings set to '0'. PHP: //--Cache Settings-- //use_cache = 0 to disable caching //use_cache = 1 to enable caching for search engine bots only (cached pages will only be displayed for bots) //use_cache = 2 to enable caching for all guests/bots, articles are not cached (article stats will still update) //use_cache = 3 to enable caching for all guests/bots, including the article pages (article stats will not update) $set['use_cache'] = 0; $set['use_cache_feeds'] = 0; //(recommended) use cache for rss feeds The sites that were getting indexed and not having issues in WebMaster Tools had the cache settings differently, like: PHP: $set['use_cache'] = 2; $set['use_cache_feeds'] = 1; //(recommended) use cache for rss feeds After changing the cache settings in the affected sites the problem seems to have disapeared. Anyone else have a similar issue? Dejavu, any idea why this may be happening? I read somewhere that it may actually be a server issue with the hosting company filtering out bots with to many requests on the site. Could GoogleBot be putting undue strain on an un-cached site? If so, how can we fix this for a small site?
	......................... Anne Kirrin is in Nepal for the month of November ArticleMSSkins.net <<:::: New Directory of Niche Article Sites <::::: Add your article site for free!! Posted Sep 5, 2009, 5:42 pm

Anne Kirrin Pool Group: Moderators Posts: 1,356 Joined: Apr 11, 2006	Email WWW PM Quote
	4 days after the above changes, My sites are indexed by Google... If you are having problems with getting indexed try editing your settings.php file.
	......................... Anne Kirrin is in Nepal for the month of November ArticleMSSkins.net <<:::: New Directory of Niche Article Sites <::::: Add your article site for free!! Last edited Sep 9, 2009, 12:29 pm by Anne Kirrin Posted Sep 9, 2009, 12:28 pm

Rich Odell Droplet Group: Members Posts: 100 Joined: Sep 7, 2008	Email WWW PM Quote
	Mine seem OK (I am at Hostgator). BY the way, I used the site over at urivalet http://www.urivalet.com/ thats a cool tool, thanks for the recommendation! Not surprised that Godaddy (or should I say Nodaddy!) can screw up the script! (don't get me started with that bunch of crooks Grrrrrrrrrrrrrr ). -Rich
	......................... www.yourquickguideto.com Last edited Sep 10, 2009, 12:58 pm by Rich Odell Posted Sep 10, 2009, 12:57 pm