Re: WORequest formValues return null for certain bot
Re: WORequest formValues return null for certain bot
- Subject: Re: WORequest formValues return null for certain bot
- From: Cedarstone <email@hidden>
- Date: Fri, 7 Jul 2006 19:07:08 +0100
Hi All
We have an application that has been running for a while with no
noticeable problems. However in recent days the
HenryTheMiragoRobot(217.154.245.244 & 217.154.245.249) has been
causing an internal server error when visiting our site. No other
requests from bots or browsers seem to trigger this.
The problem appears to be that when WORequest.formValues() is
called in part of our code it returns null rather than an empty
NSDictionary as it would normally. The null then trips us over.
Looking at the WORequest.formValues() method code it appears that
this can happen when _contentType() is not equal to either
"application/x-www-form-urlencoded" or "multipart/form-data".
Is contentType normally set for a simple GET request, I thought
this was only set as part of the response? Does this look like a
malformed bot or an error by us? Anybody had and recent problems
with HenryTheMiragoRobot?
Ideas?
I think I have seen things like this when the request was a HEAD
instead of a GET or POST. Check that. IIRC, i just fail those at
the Apache level.
Chuck
--
I have quickly grepped the logs and this is what shows...
217.154.245.249 - - [30/Jun/2006:16:08:50 +0100] "GET /robots.txt
HTTP/1.1" 200 68 "http://www.miragorobot.com/scripts/mrinfo.asp";
"HenryTheMiragoRobot (http://www.miragorobot.com/scripts/mrinfo.asp)"
26433:217.154.245.249 - - [30/Jun/2006:17:15:54 +0100] "GET / HTTP/
1.1" 500 38 "http://www.miragorobot.com/scripts/mrinfo.asp";
"HenryTheMiragoRobot (http://www.miragorobot.com/scripts/mrinfo.asp)"
26434:217.154.245.249 - - [30/Jun/2006:18:33:55 +0100] "GET / HTTP/
1.1" 500 38 "http://www.miragorobot.com/scripts/mrinfo.asp";
"HenryTheMiragoRobot (http://www.miragorobot.com/scripts/mrinfo.asp)"
26438:217.154.245.249 - - [30/Jun/2006:19:41:51 +0100] "GET / HTTP/
1.1" 500 38 "http://www.miragorobot.com/scripts/mrinfo.asp";
"HenryTheMiragoRobot (http://www.miragorobot.com/scripts/mrinfo.asp)"
26441:217.154.245.249 - - [30/Jun/2006:20:28:04 +0100] "GET / HTTP/
1.1" 500 38 "http://www.miragorobot.com/scripts/mrinfo.asp";
"HenryTheMiragoRobot (http://www.miragorobot.com/scripts/mrinfo.asp)"
It seems to get the robots.txt ok as that is served by apache but the
home page fails with a "505" from WO. Other robots seem to manage.....
72.30.177.20 - - [29/Jun/2006:23:37:13 +0100] "GET / HTTP/1.0" 200
5692 "-" "Mozilla/5.0 (compatible; Yahoo! Slurp; http://
help.yahoo.com/help/us/ysearch/slurp)"
Can't find any HEAD requests.
Regards
Giles
_______________________________________________
Do not post admin requests to the list. They will be ignored.
Webobjects-dev mailing list (email@hidden)
Help/Unsubscribe/Update your Subscription:
This email sent to email@hidden