Trawling

[gothwalk]

So, one of my colleagues is starting out on a large new project here. One thing he has to do is collate information about the client's website, which contains something between 200 and 1600 pages. Is there any piece of software out that that will spider through a site, and at the end, provide a listing - ideally, a CSV or something - containing all the page URLs and titles?

He's not overly technical, so nothing TOO involved, if it can be helped.

Comments

[puppytown.livejournal.com]

I use Xenu Link Sleuth - it's a link checker, but also lists all the urls on a site. Free, and anti-Scientologist!