This is an example of a Web-enabled interface to a MySQL database based on www-sql. The links below are some samples of how you can extract information about broken links, redirections, document titles, last modified dates, content types, link relationships and much much more from a MySQL log database generated by the webbot.
When active, the information is extracted directly from the MySQL database as you go along - the samples below are not hooked up to a database, so instead you will see the raw www-sql documents:
I use an active MySQL database to check links etc. on the W3C website - it takes about 50 minutes to check 32,000 links.