Add ReplyNew TopicNew Poll

 New issue
#
Hey there,
I run two directories (Distant Fantasies and RPG Initiative). It came to my attention yesterday and again this morning that the auto-screenshot generation that I use for the site is being blocked. It's basically generating a "Forbidden" screenshot instead.

It's specific to Jcink listings and since most of the listings on the site are Jcink specific I was hoping to see if there was a way to fix this.

I'm assuming that the bot that pulls these is what is being blocked. The service that I use is Page Peeker:
http://pagepeeker.com/

Neither are large directories and in total the API is called (between the two of them) about 25,000 times a month and that includes cached images in which they are normally cached for about a week so I can't imagine that the bot visiting to create the image is a severe load on the server.

What I'm hoping for is that we can get this fixed so the Jcink sites listed in my directories aren't saddled with a white screenshot that says "forbidden" on them all.

If you need links to the directories feel free to ask.

Thank you,
Morrigan
#
One (or all) of PagePeeker's servers probably shares an IP range with a provider that I have firewalled. I've gone through my logs and I can't find any denied requests from pagepeeker at the moment to get their IP address. Does the site have a way to force a request so I can see what range they're using? I can whitelist it.

signature
email: admin@jcink.com :: blog: John C.
#
It looks like their API calls to the IP of 176.9.106.58

Thank you.
#
It was 144.76.175.75 -- figured it out by doing a test from their site. I fixed it and I was able to get a screenshot of our forums with it.

So what basically happened was this. Due to the spam situation we've been dealing with there have been a ton of requests coming from their server provider, Hetzner Online GmbH. One of the most abusive range against us has been 144.76.0.0/16 -- this was blocked. Pagepeeker uses them so they became innocently blocked in it.

Since I've whitelisted them now though this should not be an issue anymore.

As long as this bot isn't doing anything like visiting 25k boards all at the same time, it will be fine going forward. I do apologize for the inconvenience here.

signature
email: admin@jcink.com :: blog: John C.
#
Thank you John! It's definitely not. I actually looked at my stats before I came on here to request it. I super appreciate the quick fix.

Regards,
Morrigan
#
Hey John

Regarding this: http://forum.jcink.com/index.php?showtopic=27070

I got a few new JCink submissions and I'm still getting forbidden screenshots.

The cached images are still loading fine but all of the new ones or re-cached ones are loading a white page of "Forbidden".

For context:
https://rpginitiative.com/directory/ (You are free to remove this as needed)
#
Apparently pagepeeker has a second server with them, 144.76.235.107

I have whitelisted this but it will probably take some time for the images already cached to be removed.

http://free.pagepeeker.com/v2/thumbs.php?s...forum.jcink.com

is showing the correct thumb now

signature
email: admin@jcink.com :: blog: John C.
#
I force refreshed a few of them and it appears to be working now! Thank you very much John!
#
I will leave this open this time for a bit in case there are still issues.

I have merged both threads together.

signature
email: admin@jcink.com :: blog: John C.
#
I think this is officially fixed. I haven't seen any problems since with getting a new screenshot to load. I really appreciate your help John
#
No problem. I apologize for breaking it to begin with but with the recent guest spam wave, and some repeated mass-scans of forums (many of them old dead boards that these bots can't even post on), I blocked that range.

It is rare that I will block a /16 -- it's just, I''ve just "had it" with dedicated server and vps providers that don't clean up or monitor what's coming from their datacenters better.

http://stopforumspam.com/search/144.76.

signature
email: admin@jcink.com :: blog: John C.
#
Looks like this issue still persists on some images, but I don't get it since I'm unable to make it happen on the homepage. How long does pagepeeker keep cache? or have you not forced it to reload for some of the pages?

signature
email: admin@jcink.com :: blog: John C.
#
Sorry wasn't on my computer this weekend John

I've looked. Most are working, some are not. I completely understand a blanket ban. I've done similar things on my own server before. Sometimes it's a necessary evil no matter how difficult the decision is.

It appears some are working and some are not. I don't have a rhyme or reason to them unfortunately:
https://rpginitiative.com/directory/disposable-heroes-r976/

Tried it all three URLs and still get the forbidden but other sites since this site was added added just fine. I will likely talk to my staff and see if we can come up with another method while you work on it too.
#
TheMorrigan I am pretty sure I found the last IP couple owned by them. 144.76.235.110, 144.76.23.106

I have whitelisted them.

signature
email: admin@jcink.com :: blog: John C.
#
Thank you so much for working through this with me John I know my members really appreciate it and I really appreciate it! It seems to be working a lot better at the moment. I'll let you know if there are any problems.
1 User(s) are reading this topic (1 Guests and 0 Anonymous Users)
0 Members:
Share this topic:
« Next Oldest | Feedback and Discussion | Next Newest »

Options Add ReplyNew TopicNew Poll