Tech behind Tech

Raw information. No finesse :)

Posts Tagged ‘crawler

clj-web-crawler – Web Crawling tool in clojure

leave a comment »

I was looking for a simple web crawler in clojure and came across clj-web-crawler ( . It took me less than 2 minutes to get started. (thanks to Leiningen)

1) In project.clj add these two lines for :dependencies

                 [com.jmeeks/clj-web-crawler "0.1.0-SNAPSHOT"]
                 [org.clojars.kjw/commons-httpclient "3.1"]	

2) Run lein deps and you ready to play with clj-web-crawler.

Checkout for more information

Written by Siva Jagadeesan

July 7, 2010 at 7:22 am

Posted in Clojure

Tagged with , ,


Get every new post delivered to your Inbox.

Join 147 other followers

%d bloggers like this: