- About | People | Projects
- Presentations | Publications
- Exhibits | Printable Materials
- Goals & Reports | News | Giving
- UF Digital Collections (UFDC)
- Digital Library of the Caribbean (dLOC)
- Caribbean Newspaper Digital Library (CNDL)
- Florida Digital Newspaper Library
- Institutional Repository @UF
- Related Libraries
Digital Library Center
Smathers Libraries
University of Florida
P.O Box 117003
Gainesville, FL 32611 USA
P: 352.273.2900
F: 352.846.3702
DLC@uflib.ufl.edu
Digital Library Center: Achievement on Department Goals for 2009-2010
See the Digital Library Center goals for 2009-2010 here.
Categories for Goals & Achievements:
- Administrative and Operational
- Technology Project Goals: UFDC & DLC Toolkit ;
Tracking and Importer; Servers - Digitization Production
Administrative and Operational:
- 10/09: With servers stabilized for coming months, develop 2 year project plan, with requirements, milestones, potential impacts, etc, for tech and production
- Maintain three active digitization production queues
(main, newspapers, IR)
- 7/09: Established and in refinement; see production related goals at the bottom of this page
Hire and train new staff for the different queues and cross train (8/09: new staff hired)Automating processes: internal archiving with CNS' NSAM/Tivoli solution- Once Tivoli archiving is fully integrated into production, resources on archiving will shift to metadata corrections and/or to support materials, production queue, metadata for self-submittals; processing for ETDs from the Grad Editorial Office; processing for IA materials from Preservation
- Continue to automate, streamline, and integrate operations:
- Evaluate recent streamlining efforts (reduced TOC for select projects, etc) for further refinement
- Integrate ingest of IA materials shipped and received by Preservation into ingest and archiving workflows as needed
- 8/2009: Workflows under review for main queue; newspapers; quality control; and all eventually; waiting to review workflows for several areas post-implementation of new workflows (IR metadata, loading, archiving; ingest)
- Continue full service approach for digital collections and materials:
- For collections: support for web content and design development; creation and maintence of help pages and documentation for general use and grant reports; design support for collateral materials, postcards, bookmarks, etc (all displays here)
- For materials: copyright research and clearance; metadata creation
- Apply for an LSTA grant for Florida newspapers (due March 2010)
- Apply for an LSTA grant for SASC support needs (due March 2010)
- Initiate discussions with the University Press of Florida for possible collaboration
- 8/09: collaborative project for Open Access books in relation to Orange Grove underway
- Collaborate with the Documents Department on digitization projects:
- Serving all of the Selectives that UF supports as a Regional in FDLP, including materials that also support dLOC. Sample digital collection code, structure, banner, and sample text ready here.
- Covering GPO materials for the Panama Canal Zone with UF accepting the lead for these materials within ARL in August 2009, collection
- Continue support, training, outreach, presentations, and tours:
- Support partners with transfer and ingest of partner files from Harn; Herbarium; HSC Archives; UF faculty with self-submittal tool; and all UF-internal and external partners
- dLOC training
- Sept. 2009: Belize National Library Service & Information System (Will)
- July 2009: US Embassy in Haiti (Mark and Matt L)
- June 2009: Trainng for Brian, graduate student and intern from Ohio, in the DLC and ongoing support while he was in Haiti
- May 2009: Dutch Caribbean Libraries in Aruba (Lourdes)
- Feb 2009: Bahamas (Mark)
- Metadata training for UF Libraries staff and partners
- Oct. 2009: Training for University Archives staff (Matt)
- Outreach/Promotion
- Aug. 7, 2009: shared four public domain books with Rose Hill Manor Park and Museums for use in their tours and History Camp programs where they teach children about
school days for children in the past.
- Sept. 2, 2009: UFDC table for the Library Showcase, Library West (Lourdes)
- Sept. 8, 2009: IR@UF self-submittal tool presentation in DLC
- Sept. 21: Panama Canal Museum, showing materials in room 1A
- Oct. 19-23, 2009: IR@UF participation in Open Access week; Oct 21 is focused on the IR (Dina)
- Aug. 7, 2009: shared four public domain books with Rose Hill Manor Park and Museums for use in their tours and History Camp programs where they teach children about
- Maintaining and updating registries and harvesters:
- Liaison with the UF Digital Learning Commons to integrate UFDC resources (goal for 2009-10)
- FDLP Registry ; SouthComb ; LC Sanborn listing ; NSDL (submitted EDLOH on 8/28/09); OpenDOAR (pushes to IESR; Scientific Commons); etc.
- Adding Open Access journals in the IR@UF to the Directory of Open Access Journals
- Loading requested UF public domain images to Flickr account for UFDC
- UF public domain videos to the UF Libraries on YouTube
- Creating LibGuides for UFDC collections, including the IR LibGuide
- Conduct one usability study on UFDC each year
- Sept. 2009: Survey for the Working Group on Caribbean Literature and History
July 2009: Usability study underway, to be completed in September 2009 (in UFDC)
UFDC & DLC Toolkit (Included are goals for 2009-2010 and beyond)
See the UFDC Development page for details on priorities.
- Self-submittal tool
for IR and partners
- Trainings and programming changes to be established as needed, based on initial feedback
Oct. 19-23: IR@UF self-submittal tool will be promoted and explained throughout Open Access WeekOct.: Laurie and Dina will schedule training to ensure all is in place prior to Open Access week)Sept. 15: Official internal release dateAug. 31: brief presentation to University Libraries CommitteeAug. 15 - Sept. 14: Presentations and discussions on mockup to help refine overall designLogin for authenticated users using Shibboleth (Request to campus for shibboleth on 8/4/09)Simple web form, designed and ready 8/14/09Email response to submitter and DLC staff for processingSelf-submitted items will use IR and IRT BIBIDs
- myUFDC/On-line metadata editing capabilities
(work begun with self-submittal form; fall 2009)
User login system- Users should be able to logon, view existing book bag, and add items to book bag (future expansion: add items to folders), from their book bag, they should be able to email and print; email link to send permanent link to an item to self/friend; users should be able to make their book-bag or a folder therein public, for others to see
- Image Server / Implement new zooming image technology
- Create a new zoomable image server based on Kakadu decoder
- Include ability to read an ALTO file and highlight the corresponding text regions (requires new OCR software)
- Text highlighting (requires Kakadu image server)
- Show search terms in context in search results
- In search results on the item page, showing the @15 words before and after the search term(s)
- Using .PRO files to highlight text on the page / Converting .PRO to ALTO
- EAC/Authorities
- Implement EAC support, once EAC standard finalized to power underlying infrastructure needed for real authorities/identities for archives, authors, and users; i.e., faculty through self-submittal system (reference: METS: developing integrative practices)
- Nov. 2009: mini grant for prototype project awarded; mini grant completion by 11/2010
- Mar. 2010: LSTA grant due
- Refinement of existing tools, Maintenance & Ongoing Support
- UFDC and DLC toolkit and dLOC Toolkit support (
compact SQL Express, completed) - Adding usage statistics by holding institution
- Finessing of MARCXML record feed into Endeca from UFDC
- Enhancements to Lucene indexing for UFDC collections; updates based on usability testing
- GoUFDC updates to absorb FDA prep tool by having UFDC METS reference METS and DAITSS schemas on UF's site (to have it work even if FCLA site is down and avoid need to embed DAITSS information or to fail if FCLA's site with the schema is down while FDA is accepting files)
- Add ability to customize searches at hierarchical levels. (i.e., newspaper title level for FDNL)
- Show search terms in context in search results: Using .PRO files to highlight text on the page; converting .PRO to ALTO; in search results on the item page, showing the @15 words before and after the search term(s)
- Searching by address using Google Maps API for Aerials grant
- Faceted searching in UFDC
- Zoning for newspapers: integrating the newspaper zoning tool into QC for copyright blur processing; after manual zoning for copyright information, refine to create auto-zoning tool within preQC that "guesses" newspaper zones for QC to use; ongoing refinements
- Born digital ingest split PDFs; auto-create PDFs on UFDC (possibly iText; BHL explanation, example)
- UFDC display of finding aids / EAD (some of the preferred display options are here with the facets on the right by structure--folder, box, collection--and the tag display)
- UFDC Slideshow displays (Treister and others)
- UFDC auto-translations for all of UFDC once primary terms are translated
- Auto-correction /cross-searching for letters with diacritics if users search with or without diacritics marks
- UFDC and DLC toolkit and dLOC Toolkit support (
- Possible/Testing
- Z39.50/ZING SRU
- COinS support
- Eventual Workflow Goals: on PreQC, all files load to UFDC and can be seen using the "&dlc=yes" on the URL; online QC; once QC is approved, item is live; OCR happens to files online after QC approval. This is a multi-year project with many phased steps, and it may change dramatically before any aspects could be implemented.
- Flash flipbook view (Open Library explanation; example; full source; LOC)
- Possible interface modifications: simpler subtabs; results page numbers; prev and next in addition to all volumes tab, but only for ead-connected items;
- Implementation for names and authorities (LOC authorities/vocabularies ; http://www.ubio.org/ ; Geonames ; EPC maps, example from NYPL , example two , example three)
Completed: Mark released a radically new version of the Importer on 7/15/09Completed: Mark compiles statistics quarterly or more often, all completed through 7/09Completed: Mark enhanced OAI-PMH, adding text as an OAI-PMH format for single item view 8/09; see more hereCompleted: Mark released a new version of lister because of need for portable drives with SAN issues
Tracking & Importer Related
(were for 2009-2010 Goals only; workarounds developed per resource limits )
(5) Automated ingest; Ticket #31377: For: IA (BHL example, with sample code); UF Grad School (ETDs); GovDocs/FDLP; vendors; will see if self-submittal tool can act as a workaround; will re-evaluate in 2010-2011
(2) Lister; Ticket #31647; Mark Sullivan completed on 6/22/2009
(1) Reports: completed for now because better data not possible with Tracking DB problems
- Report: Items Archived and not on UFDC: 11/16 corrected list (11/23/09: 4,637 items includes DARK; 6/1/09: 5,737 items)
- Weekly Production Activity Reports: 10/1-10/7/2009; 9/3/-9/9/2009
(6) Tracking DB enhancements:No longer anticipated per avail. resources and future Tracking integration with UFDC which is not expected to even begin until 2010-2011 or later(7 or as optimal) Related Operational: For possible inclusion in the 2010-2011 goals; not priorities and do not have resources for the near future.
Servers (Included are goals for 2009-2010 only)
- Shared server config documentation
- Emergency planning and testing for UFDC restore from tape
Tivoli for internal archive, done 10/13/2009Rebuilding old Greenstone servers as a JPEG2000 server, done 10/13/2009FTP server with alias ftp.uflib.ufl.edu and accounts (done 8/21/2009)Space alerts (done 8/21/2009)Install and config of new UFDC SAN (done 8/21/2009)Partioning of DLC San for optimized speed/reduction of Replistor-related issues (done 8/17/2009)IR simplified URL (done 8/21/2009)
Work on core ongoing projects in the three production queues (Newspapers, IR & institutionally related, and Main).
- Main Queue; Projects and Goals:
- Africana Collections (Center for African Studies funding, $5,000)
- Rare books, journals, maps, etc.
- CM: Peter Malanchuk and Dan Reboussin
- Caribbean Newspaper Digital Library / CNDL (10/2009 - 9/2013):
- Meet all grant expectations on schedule
- Acquire permissions to digitize more Caribbean newspaper titles (32 were granted when grant was submitted)
- Modify existing toolkit for newspaper-specific needs
- zoning: manual and automatic for several test newspapers
- IPTC G2 compliant metadata for each article
- released as Open Source for other projects to use
- record feed to partner catalogs
- Select several titles for article level indexing and text
- Create partner pages and interfaces for all new partners
- Digitize Caribbean Newspapers
- Integrate CNIP indexing data into CNDL
- Acquire born digital files from newspaper publishers
- At least 55,000 images per year from all partners
- Move from Main into the Newspaper Queue
- Develop copyright/permission request manual and training guides.
- Newspaper biographies for 32 titles
- Usability testing and increased usage
- Outreach
- Create curriculum guides for newspapers in Caribbean languages
- Two teacher training workshops
- Caribbean Speaker Series, video broadcast
- Conference presentations
- Lesson plan competition
- Print materials: mailings, bookmarks, postcards, posters, calendars, etc
- Cost share: DLC: .15 FTE (Laurie .05 FTE and Mark .10 FTE)
Earn grant award
- dLOC (9/2004 - 9/2009):
- 9/30/09: Grant ended, but continue to support ongoing collaborative project needs
2009: Completed training video for flatbed scanning, loaded to dLOC and YouTube
- Panama Canal materials: GovDocs that can't be processed by IA
- Everglades (1/2009 - 12/2011; digitization 4/2009 - 10/2011, or 30 months):
- Digitization
& Technical
- Remain on schedule and on budget
- 99,690 pages in 30 months
- Requires an average of 3,323 pages per month; actual production per month will vary for the letterbooks and photos, which are more time-consuming
- OPS Funding is $67,500 ($22,500 per year for 3 years: 2009; 1/2010 - 12/31/2010; 1/2011 - 11/2011)
- 1/1/2009: 9 months, 29,907 pages required by now
- 12/1/2009: 8 months, 26,584 pages required by now
11/18/09: 7.5 months, 27,273 pages10/29/09: 7 months and 26,557 pages online, 23,261 required by now10/22/09: 7 months and 26,304 pages online, 23,261 required now9/30/09: 6 months and 22,776 pages online9/16/09: 19,759 pages online8/28/09: Submitted EDLOH to NSDL for federated searching8/14/09: 4.5 months and 14,329 pages (16,080 req. end of Aug. per page time differences)8/09: Migrated FIU EDL materials into EDL supported on the UFDCsystem other than FEOL7/09: 3.25 months and 11,791 pages onlineFirst report due 7/31: completed on time
- Additional Technical
- Enable cross-searching with the Everglades Digital Library with FIU; collaborative decision to join move EDL to SobekCM infrastructure for optimal ease of use and growth
2009: Established EDLG collection group with EDL interface8/09: Loaded FIU EDL Founders collection, creating subcollection page9/09: Created subcollection page for EDL Oral Histories; loaded Tale of Two Women EDL oral history collection; processing metadata updates for SPOHP EDL Oral Histories- 10/09: Loading Marshall, Hole-in-the-Donut, Dineen, and Educational collections
- 11/09: Migrating FIU and UF EDL-FEOL materials
- Contextual materials (in process, ongoing for the project; all notes online here)
- Sharing all documentation, including workflow and technical specifications
- Sharing all documentation, including workflow and technical specifications
- Journal and newsletter articles with information about methodology and outcomes
- Conference presentations with information about methodology and outcomes
- Web page req:
- Historical timeline
- Lesson plans
- Graphics
- Guide to primary sources and other secondary reading materials
- Historical timeline
- Publicity materials req:
- Press releases
- Public presentations
- Brochures and other promotional giveaways
- Press releases
- Core Project Team:
- .30 FTE DLC (Lourdes: .10 FTE; Jane: .10 FTE; Matt: .05 FTE; Laurie: .05FTE)
- OPS: 1.25 FTE [2 Scan Techs: each .375FTE, total .75 FTE; and 2 QC Techs: each .25FTE, total .5 FTE]
- .30 FTE DLC (Lourdes: .10 FTE; Jane: .10 FTE; Matt: .05 FTE; Laurie: .05FTE)
- Digitization
& Technical
- Florida Aerials (grant period 10/2009 -
5/2010 for digitization; - 9/2010 for interface)
- Digitize/load/archive 21,417 aerials by 5/2010
- Link 21,417 aerial photos to georectified images
- Digitize 13,418 historical aerial photographs and 120 paper indexes
- Incorporate 7,473 aerial photographs from FDOT
- Install new servers, configure, and make operational
- Updates
- 10/23/09: 3,198 aerials scanned, need programming updates before loading
- Process:
- Jennifer will select, prepare, and track the aerials
- Joe will hire and supervise GIS technicians to georectify the photos and create geospatial metadata
- DLC will hire and train staff to digitize project components above
- DLC/IT/Mark: will develop a user-friendly map interface using the Google Maps API
- IT will install and configure server space
- Core Project Team: .
- .23 FTE DLC (Randall: .05 FTE; Mark: .15FTE; Jane: .03 FTE)
- OPS: $10,424
for 1,390 hours
(7.49/hr average)
- (5 Scan Techs for 15 hrs/wk for 15wks@ 7.25/hr) 1,125 hours and $8,156
- (1 QC Tech for 225 hours @ 8.30/hr): 225 hours and $1,868
- (1 Digital Camera Operator for 40hrs@ $10/hr): 40 hours and $400
- Reports due April 1, 2010 and November 1, 2010 and report format online.
Make JPEG2000 aerial images available as downloadsFinish conversion of 5,000 remaining images from prior grants to bring total to 84,000Earn grant award
- Newspapers; Goals:
- Florida Digital Newspaper Library
- Catch up to only one year behind in digitization production for Florida Newspapers
- Move 30 newspapers born digital
- 10/09: 37 born digital; 8/27/09, FTP operational; 8/09, 15 newspapers born digital and other publishers committed once FTP accounts work; 7/09, 12 born digital; requests sent 10/08; 7/2/09; 8/2/09
- Meet all goals for Digital Military Newspaper Library mini grant
- Caribbean Newspaper Digital Library
- As possible, prepare to integrate Caribbean Newspapers into queue
- IR & Institutionally Related; Goals:
- Meet all goals for the UF Institutional History Project mini grant
- Maintain workflow for born digital serials and UF Publications chosen by selectors
Goal is to move UF related materials from the Main queue here (done 8/2009) - Maintain list of serials and UF Publications by College (updated as part of the workflow for materials)
- Support Open Access by digitizing UF materials as chosen by selectors, including:
- Florida Anthropologist; Florida/Caribbean Architect
- University Press of Florida
materials
- Request process for permissions may be slow given the publishing date time span; we will work to ensure positive workflows for support
- Wordmarks for Orange Grove and UPF on all items
- Two ISBNs (print and POD) for all items
- Custom interface will need marketing review
- Feed to Orange Grove will need testing and review
- Support Open Access with self-submitted materials:
- Requires training and refinement for selectors, faculty; presentations on the processing flow; integration with other workflows and needs in the libraries and at UF
- Support Open Access by assisting to plan Open Access week, and presenting for IR day during Open Access week (already planned and in process)
- ETDs:
- Increase to three departments that submit PILO to submit electronically.
Departments contributing PILOs are listed here - Work with Graduate Editorial office to send all open ETDs to UFDC. Pursue once the “projects in lieu of a thesis” and self-submitted materials for the IR are stable/processing smoothly (expected late 2009 or early 2010).
- Increase to three departments that submit PILO to submit electronically.
- WID: Report on work done to date (Laurie), due 11/10/09
Create promotional and support materials for IR: new banner for collection, postcard, have materials use the shorter IR url: www.uflib.ufl.edu/ir (which should be active 8/18/09)- Museum & Special Projects Goals:
- Online and physical exhibits:
- Cuban posters mini-grant
- Everglades exhibit
dLOC Exhibit for Hispanic Heritage Month (Sept 15 - Oct. 15)
- Training and Support
- Partner training listed under admin section
- Support for UF's museum partners and affiliates to use the self-submittal tool for their digital materials and collections; investigation of the self-submittal tool and citation-only view as options for integration of museums, archives, and library catalogs (for removing the SILOs of the LAMs)
- Promotion and development for existing and new projects:
- Compilation of all UFDC items "seen/heard" in recent publications, events, and news (biscuit in Florida magazine, ILL requests for items for scholarly publications; etc); UFDC requests for items for others' events and exhibits
- Attendance at one museums/archives/libraries event (AAM conference; MCN conference; etc) if possible per funding and workflow
- Adding relevant projects to MCN Project Registry
- Other Projects
- Continue supporting new projects for the Libraries' collection development goals, including proposed grant projects and smaller projects:
- Flagler Architectural Drawings, grant proposal submitted, would run 10/1/2009-9/30/2011
- Notification expected 2009-2010
- Cost share:
- Renner .10 FTE (full grant period) and Mariner .08 FTE (year 2 only)
- 654 hours for student OPS (grant funds would cover 75%)
- Baldwin Phase IV, grant proposal to be submitted 7/15/2009
- Notification expected 4/2010
- DLC FTE requirement from grant:
- Historic St. Augustine
Aerial mini-grant, completed 10/09- "Intellectual Underpinnings of the American Civil War," collaborative ASERL Project
- Digging into Data, non-library proposal to mine Baldwin collection, 1/2010-9/2011 (notification 12/09)
- Applying Data Structure Techniques and Machine Learning-Natural Language Processing to Humanities Collections (Jaqi linguistics), non-library proposal that would utilize and inform UFDC (notification 12/09)
- Flagler Architectural Drawings, grant proposal submitted, would run 10/1/2009-9/30/2011
- Continue to support smaller projects, especially for exhibits and to share experience/cross-train
- Continue to complete and migrate older projects as identified for priority by collection managers. Projects needing completion include these and many others:
- Baldwin Phase I and II materials, needs 1,706 volumes as of 7/2009 to meet total of 7,339 from grant reports
- 9/16/09 Update: now 5,796 volumes online (1,543 remaining to process and load)
- Herbarium Specimens
- Migration of PALMM materials to UFDC (FEOL and FHP are all that remain as of 7/2009; includes FLAG, FAST, and many other materials)
- Samuel Proctor Oral Histories: all that were DARK and burned to DVD need to be pulled, copyright status changed to permissions granted per SPOHP, and loaded (all that were on the SAN have been fully processed)
- NDNP (need to develop method for editing JP2 headers for Batch1a and 2)
- Yulee: correct metadata for all 2,400 items
- Continue to work through digitized microfilm backlog
- Baldwin Phase I and II materials, needs 1,706 volumes as of 7/2009 to meet total of 7,339 from grant reports
- Continue progress on AGRSSR priorities
- University Archives photographs (meeting 10/09; to begin small sets of photos on a regular basis 11/09 through time now available with Tivoli archiving instead of DVD archiving)
Committees, Service, Cross-Training & Research
- Committees
- Jane Pen, Convocation committee (2009-2011)
- Traveler Wendell, Emerging Technologies Group (2009- )
- Joe Kaleita, Employee Recognition Committee (2009-2011)
- Randall Renner, Grants Management Committee (2009- )
- Dina Benson, ETD Group (2008-ongoing); Open Access Week Planning Group (2009)
- Laurie Taylor, Open Access Group (2009-2010); AGRSSR (2009); DISC (2008-2010) with report on digitization projects
- Cross-Training
- 10/2009, Ask-a-librarian training: Dina, Jane, Nelda, Carrie, Traveler, Laurie
- 7-6/2009: documenting and presenting on workflows
- Research
- 10/2009 Mini grants written and submitted:
- EAC, Dina Benson (awarded 11/2009)
- Military Newspapers, Will Canova (awarded 11/2009)
Completed Digitization Projects in 2009
- University Record
- Aerials mini grant
- PPD files (DARK); FSU files for FHP grant; UNF files for FHP grant; FAMU FHP files
- University Archives' Gannon videos (from Carl, DARK archive for now)
- Sea Grant aerials; Journal of Tropical Plant Pathology (49 volumes)
- Florida House Journal
- Latin American film posters
- Ephemeral Cities newspapers
- Loading retro FLMNH Bulletins that were archived
- CRL newspapers, drive 1 (drive 2 still in process 11/09)
- Coastal Engineering Reports (346 reports; 37,753 pages)
- Florida Architecture journals
(many complete, some still in process)
- Florida/Caribbean Architect (27 volumes)
- Florida Architect (241 volumes, still need to load 1978-1980 for 315 total)
- FAA bulletin (45 volumes; complete)
- Bulletin of the Florida Association of Architects (4 volumes loaded; 6 required but two were not previously scanned)
- WID materials for digitization, developing plan for in copyright/permissions not granted (ETA 11/09)
