ixl
07-24-2002, 12:23 PM
I noticed last week that my "bot reaper" was being triggered many times by what turned out not to be "bots" at all. Instead, they turned out to be forum users that are apparently perusing the forums regularly but with browser caching disabled. These users generate so much traffic that they appear to be bots to the reaper.
When caching is on, your browser keeps copies of all the little graphics used on the forum pages when you go from page to page. When caching is turned off, every single time you load a new page, the server gets hit with as many as two dozen or more requests to reload the same images again. Every new page, the same images are re-requested. It's extremely inefficient both for you and for other users.
(How inefficient? Some of these false positives on the "bot reaper" showed a single user generating over a quarter of the requests to the server in a short period of time. Generally, one sure with caching off can result in several hundred hits on the server in a few minutes. Two or three people doing this would really degrade the usability of the site.)
I have changed the "reaper" so it is less likely that this will happen again. But I am also asking everyone to please consider turning caching on when browsing here, if it all possible. (It will also improve performance on other sites.) The reaper now requires a very high number of requests to be triggered, and I haven't had any more forum "gotchas" recently. But I cannot guarantee that it won't lock someone out if they run without caching and consume far too many server resources.
Thanks for your help.
Charles
When caching is on, your browser keeps copies of all the little graphics used on the forum pages when you go from page to page. When caching is turned off, every single time you load a new page, the server gets hit with as many as two dozen or more requests to reload the same images again. Every new page, the same images are re-requested. It's extremely inefficient both for you and for other users.
(How inefficient? Some of these false positives on the "bot reaper" showed a single user generating over a quarter of the requests to the server in a short period of time. Generally, one sure with caching off can result in several hundred hits on the server in a few minutes. Two or three people doing this would really degrade the usability of the site.)
I have changed the "reaper" so it is less likely that this will happen again. But I am also asking everyone to please consider turning caching on when browsing here, if it all possible. (It will also improve performance on other sites.) The reaper now requires a very high number of requests to be triggered, and I haven't had any more forum "gotchas" recently. But I cannot guarantee that it won't lock someone out if they run without caching and consume far too many server resources.
Thanks for your help.
Charles