- About | People | Projects
- Presentations | Publications
- Exhibits | Printable Materials
- Goals & Reports | News | Giving
- UF Digital Collections (UFDC)
- Digital Library of the Caribbean (dLOC)
- Caribbean Newspaper Digital Library (CNDL)
- Florida Digital Newspaper Library
- Institutional Repository @UF
- Related Libraries
Digital Library Center
Smathers Libraries
University of Florida
P.O Box 117003
Gainesville, FL 32611 USA
P: 352.273.2900
F: 352.846.3702
DLC@uflib.ufl.edu
Automatic Static Page Creation for Search Engine Indexing
Many digital libraries and collections are forced to prevent search engines from crawling their sites because search engine robots so often behave erratically even when given properly defined instructions in robots.txt.
To solve the problems of dynamic URLs and limits on the number of items on sitemaps, the University of Florida Digital Collections' system automatically creates static HTML pages for all items in UFDC. The static pages contain all of the citation information and the full text for the item. UFDC creates the static pages for each and every item when the new item loads. The static pages can be accessed and properly indexed by search engines.
