Home > Archive > Java Help > October 2005 > Open source web crawler
You are viewing an archived Text-only version of the thread.
To view this thread in it's original format and/or if you want to reply to
this thread please [click here]
| Author |
Open source web crawler
|
|
| Paul Morrison 2005-10-26, 7:01 pm |
| Hi,
I have been searching the web for an open source web crawler that takes in a
keyword and crawls sites, relaying articles with that keyword. I have seen
the one on the Sun website,
http://java.sun.com/developer/techn...ty/WebCrawler/, but
that does not work correctly, it gives no results. I have also tried a lot
of crawlers from SourceForge, but to no avail.
I was wondering if anyone had used or knows of a web crawler that would be
suitable for my needs.
Cheers,
Paul Morrison
| |
|
|
"Paul Morrison" <crap@nospam.co.uk> wrote in message
news:djnvpt$r35$1@oheron.kent.ac.uk...
> Hi,
>
> I have been searching the web for an open source web crawler that takes in
a
> keyword and crawls sites, relaying articles with that keyword. I have seen
> the one on the Sun website,
> http://java.sun.com/developer/techn...ty/WebCrawler/,
but
> that does not work correctly, it gives no results. I have also tried a lot
> of crawlers from SourceForge, but to no avail.
>
> I was wondering if anyone had used or knows of a web crawler that would be
> suitable for my needs.
>
Google?
(I mean could you use Google to crawl for the information you want; I'm not
suggesting that you do a Google search to find web crawlers.)
Rhino
|
|
|
|
|