shpider: Web automation library in Haskell.
Shpider is a web automation library for Haskell. It allows you to quickly write crawlers, and for simple cases ( like following links ) even without reading the page source.
It has useful features such as turning relative links from a page into absolute links, options to authorize transactions only on a given domain, and the option to only download html documents.
It also provides a nice syntax for filling out forms.
An example:
runShpider $ do download "http://apage.com" theForm : _ <- getFormsByAction "http://anotherpage.com" sendForm $ fillOutForm theForm $ pairs $ do "occupation" =: "unemployed Haskell programmer" "location" =: "mother's house"
Modules
[Index]
Downloads
- shpider-0.2.1.1.tar.gz [browse] (Cabal source package)
- Package description (as included in the package)
Maintainer's Corner
For package maintainers and hackage trustees
Candidates
- No Candidates
Versions [RSS] | 0.0.1, 0.0.2, 0.0.3, 0.0.4, 0.0.5, 0.0.6, 0.0.7, 0.1.0, 0.1.1, 0.2, 0.2.1.1 |
---|---|
Dependencies | base (<5), bytestring, containers, curl, mtl, regex-posix, tagsoup, tagsoup-parsec (>=0.0.8), time, url (>=2), web-encodings [details] |
License | BSD-3-Clause |
Author | Johnny Morrice <spoon@killersmurf.com>, Ozgun Ataman |
Maintainer | Ozgun Ataman <ozataman@gmail.com> |
Category | Web |
Home page | http://github.com/ozataman/shpider |
Uploaded | by OzgunAtaman at 2011-11-29T18:26:57Z |
Distributions | |
Reverse Dependencies | 1 direct, 0 indirect [details] |
Downloads | 8095 total (24 in the last 30 days) |
Rating | (no votes yet) [estimated by Bayesian average] |
Your Rating | |
Status | Docs uploaded by user Build status unknown [no reports yet] |