ixl
07-18-2002, 10:13 PM
Hi Folks,
Couple of quick things.
First, I have had the RAM in the pcguide.com server doubled to 512 MB. This seems to have eliminated the increased swapping that was occurring since vB was installed and the server seems to be running more smoothly now. Hopefully it's not just the summer lull. :)
Second, I have just written and installed a script that for once seems to be effectively handling the long-standing "bot" problem. As many of the regulars know, many times in the past the site has become unusable due to inconsiderate surfers using web "robots" or "bots" that whack the server with thousands of requests as they attempt to download the entire site or large portions of it.
For years I have been trying to find a solution to this problem with little success. After my most recent encounter -- a bot caused the search engine reindex to fail -- I thought of a way to automate a process I use manually to check for bot activity. The new script will now automatically shut down an abusive user after just a few minutes. This will probably not solve all problems with bots but should help a great deal.
c
Couple of quick things.
First, I have had the RAM in the pcguide.com server doubled to 512 MB. This seems to have eliminated the increased swapping that was occurring since vB was installed and the server seems to be running more smoothly now. Hopefully it's not just the summer lull. :)
Second, I have just written and installed a script that for once seems to be effectively handling the long-standing "bot" problem. As many of the regulars know, many times in the past the site has become unusable due to inconsiderate surfers using web "robots" or "bots" that whack the server with thousands of requests as they attempt to download the entire site or large portions of it.
For years I have been trying to find a solution to this problem with little success. After my most recent encounter -- a bot caused the search engine reindex to fail -- I thought of a way to automate a process I use manually to check for bot activity. The new script will now automatically shut down an abusive user after just a few minutes. This will probably not solve all problems with bots but should help a great deal.
c