Discussion Bots from manga aggregator sites

[Nachi]

This might not be most appropriate subforum, but I'd like it to reach as many scanlaitors who're dealing with more than just the typical scanlaitors job, aka dealing with home page administration.

It recently came to my attention that at least one online reading aggregator site is using bot to track our online reader (foolslide) and mirrors any new uploads immediately. Now i know that some things can be done by adjusting robots.txt, but not necessarily if the bots are "bad bots". I know nothing beyond that (not even know to successfully identify the undesired bot).
So I'm here to ask what are your experiences with this, did you do anything and were you successful, or you just don't care that much about this?

 

[Gradonil_Ral]

You can always add fake pages first then replace them with normal ones :P

 

[Nachi]

xD I was thinking of that in the past days to, though that's not really a solution :/

 

[Gradonil_Ral]

Even if you did manage to find out the bots' IP addressees and ban them, the aggregator sites can always get new ones, use proxy or vpn to get back.

You could always try adding some sort of captcha verification before viewing the chapters, but that's gonna require editing foolslide script a little, and... it's gonna annoy normal users.

And I was actually half serious about the fake pages - the bots probably monitor the reader itself, so if you added a "fake" release to it about and hour or so before releasing the actual chapter on your website/blog, they'd already have the fake pages uploaded before you replace them. And bots looking for "changes" are few or non-existent.
But, to be on the safe side, you'd need to use the same page naming template for the fake and real pages, e.g.: credits.jpg, recruiting.jpg, 01-24.png, 25-donation.jpg (or however else you're naming them). You'd need to know beforehand how many jpegs and pngs you'll have, because if you changed the names of the images, they'd be more likely to get detected by the bots.