Same. I’m not a conspiracy theorist. However, most top Google results are those garbage sites that are definitely not written by humans. I wonder if search will die soon as bots begin to dominate SEO (more than they already do). The search paradigm will definitely have to change.

This is the way.

How do you know it isn’t now? (see: Dead-Internet Theory)

You’re not missing anything but ads. I cannot understand the Sync hype and attribute all posts about it to promotion.

I wouldn’t be trying to use or adapt it; it was more of an intellectual curiosity. I haven’t written scrapers or used Tcl, so, yeah, I would be interested to take a peek :-)

I’d like to write something similar, but I’d probably use Lisp or Python.

Are you willing to share the source for said bot?