issue with serch engines
issue with serch engines
- Subject: issue with serch engines
- From: Cretu Catalin <email@hidden>
- Date: Fri, 23 Jul 2004 10:36:50 -0700 (PDT)
Hi,
I have an issue with search engines (crawler). Because
when they start searching, they creates a lot of
sessions and it keels the server.
How can I resolve it (using robot.txt - to restrict
access for robots)? This is not the best idea, because
I like to let access for searching in some certain
pages.
Anyone has any idea?
Thanks,
Catalin
Tired of spam? Yahoo! Mail has the best spam protection around
http://mail.yahoo.com
_______________________________________________
webobjects-dev mailing list | email@hidden
Help/Unsubscribe/Archives: http://www.lists.apple.com/mailman/listinfo/webobjects-dev
Do not post admin requests to the list. They will be ignored.