2008/11/21

Google Profile Scraper

I wrote a tiny and Perl-ish script in Ruby that scans through the publicly available Google Profiles (~150k) ans saves some relevant content to a database. As you may notice you will need some gems (hpricot is essential, while sequel is just for the fun part) and I stoopidly used JRuby for this task. I strongly recommend not to use JRuby here.

Update: I really hated the code I wrote for JRuby so I made some enhancements.

2 comments:

szabi said...

Why?

Janos Hardi said...

Why? For fun and for profit :) No, no profit indeed. I consider it as a stone in my in depth learning path for Ruby. I wanna learn Ruby from A to Z, without the magic - thats why I picked this little task as a practice, and of course I'll try to evolve the code from Perl-ish ro Ruby-ish, from a little script to a real oop experiment.