Re: Strange Googlebot activity
Re: Strange Googlebot activity
- Subject: Re: Strange Googlebot activity
- From: Chuck Hill <email@hidden>
- Date: Wed, 31 Oct 2012 19:57:50 -0700
Hi Paul,
On 2012-10-31, at 6:55 PM, Paul Hoadley wrote: Hello,
I noticed some strange requests in the log of a live application the other day:
66.249.74.173 - - [25/Oct/2012:10:19:42 +0000] "GET /SurvStar/1/ja/bTJaOg4yM8yusyH07q7Fsw/0.0.43.1 HTTP/1.1" 200 1997 66.249.74.173 - - [25/Oct/2012:10:21:48 +0000] "GET /SurvStar/1/ja/bPCp9YKaWJtYnBAbefb3rg/0.0.43.1 HTTP/1.1" 200 1997 66.249.74.173 - - [25/Oct/2012:10:24:53 +0000] "GET /SurvStar/1/ja/bPYhQJ0ZxsN6ps2AsILtBg/0.0.43.1 HTTP/1.1" 200 1996 66.249.74.173 - - [25/Oct/2012:10:27:42 +0000] "GET /SurvStar/1/ja/0zwYRxtDseruVePtbAddHw/0.0.43.1 HTTP/1.1" 200 1999
(And dozens more.) That IP address belongs to Google:
$ nslookup 66.249.74.173 Server: 192.231.203.132 Address: 192.231.203.132#53
Non-authoritative answer: 173.74.249.66.in-addr.arpa name = crawl-66-249-74-173.googlebot.com.
The 200 response it's getting is the session restoration error page, as those session IDs are bogus. Has anyone seen anything like this? Remind me—what's the "ja" request handler? Any thoughts on where it would be pulling these (presumably never existent) session IDs from?
Not sure about the /ja/, I think it is an older Ajax request handler. I don't recall ever seeing it in my applications. the /0. as the context ID means that this is an initial component request. If you look at the SurvStar homepage, you will see
<script type="text/_javascript_"> //<![CDATA[ (function(){ var xhr = window.XMLHttpRequest?new XMLHttpRequest():new ActiveXObject("Microsoft.XMLHTTP"), url = '', key = '_timezone', Google must be picking up on this or some other link and try to follow it. I have seen this before where it will record the URL of an error or other page. Just block robots from indexing through /ja/.
Chuck
-- Chuck Hill Senior Consultant / VP Development Practical WebObjects - for developers who want to increase their overall knowledge of WebObjects or who are trying to solve specific problems. http://www.global-village.net/gvc/practical_webobjectsGlobal Village Consulting ranks 13th in 2012 in BIV's Top 100 Fastest Growing Companies in B.C! Global Village Consulting ranks 76th in 24th annual PROFIT 200 ranking of Canada’s Fastest-Growing Companies by PROFIT Magazine! |
_______________________________________________
Do not post admin requests to the list. They will be ignored.
Webobjects-dev mailing list (email@hidden)
Help/Unsubscribe/Update your Subscription:
This email sent to email@hidden