Skip to main content

There is a web crawler bot that is not respecting our robots.txt setting currently hammering our webhost.

----------

I told him I'm going to hack it and take it down LOL

They're working on it and know about it

Original Post

Replies sorted oldest to newest

An update!

I blocked around 900 IPs related to the crawler. Hopefully things will speed up again.

-----

I asked him to block a range of IPs if possible.

It's definitely faster now

Last edited by Boris

It'd be nice if we could remove the defunct Packer Game Weather widget.  It causes browsers to spin while the widget attempts to load (and eventually times out).  This can also result in slower page loading times.

Edited to say - hey it's gone, thanks!

Last edited by Deadhead Archer

Add Reply

Post
×
×
×
×
Link copied to your clipboard.
×