-1

my site just got spoof.

I'm using RoR 3.2.11 and I installed the rack-rewrite gem.

I created the /middleware dir inside /app and I created a .rb file inside.

Now, how should I write the rule to only allow requests coming from my page?

Thanks!

content01
  • 3,115
  • 6
  • 41
  • 61

1 Answers1

3

If someone's making a copy of your site using HTTP scraping there's usually not much you can do other than make their life difficult and be annoying.

You'll need to consider that anything you do to make it more difficult for another site to clone yours will make it very difficult for ordinary readers. Force registration? You'll lose visitors. Encrypt page and require JavaScript? You'll lose readers.

I'd suggest blocking the IPs of the robots you don't like, filing a report with their ISP about copyright infringement, and if things are really bad, engage a lawyer.

tadman
  • 208,517
  • 23
  • 234
  • 262
  • @content01 - Tadman put it nicely here, There's not much you can do except making the life of scrapers a little difficult. The best option would be to identify what IP's these bots/scrapers are using and then block access to them. – Jasdeep Singh Feb 04 '13 at 18:43
  • You could also selectively mangle the output so it looks okay but is broken. – tadman Feb 04 '13 at 19:33