Posts Tagged ‘crawler’
I was looking for a simple web crawler in clojure and came across clj-web-crawler (http://github.com/heyZeus/clj-web-crawler) . It took me less than 2 minutes to get started. (thanks to Leiningen)
1) In project.clj add these two lines for :dependencies
[com.jmeeks/clj-web-crawler "0.1.0-SNAPSHOT"] [org.clojars.kjw/commons-httpclient "3.1"]
2) Run lein deps and you ready to play with clj-web-crawler.
Checkout http://github.com/heyZeus/clj-web-crawler for more information