| Crawling The crawler started on a random page (http://www.sciencedaily.com/releases/2006/05/060504070523.htm). The crawler was set to: Follow all links on each page until 198 has been followed. The crawler was set to visit pages more than once. display visited URLs |
| Data Collected Link Counts: all http https mailto ftp javascript display collected link counts HTML Attributes: alink bgcolor color link text vlink border cellpadding cellspacing charoff colspan frameborder height hspace marginheight marginwidth rows rowspan size span start tabindex vspace width display collected attributes HTTP Headers: Client-Date Date Last-Modified Expires Retry-After Age Content-Length Content-Range Accept-Ranges display collected headers HTTP Status Codes display collected status codes |