Web and Born Digital Collections Policy and Procedures

Mission Statement

The University of Wisconsin-Madison University Archives preserves university records and materials of permanent and historical value. Designated an official state repository for records, the University Archives is charged by both the State of Wisconsin and the Board of Regents of the University of Wisconsin System to preserve records that have permanent administrative, legal, fiscal, or historical value. The University Archives is the only University agency that provides systematic assistance in managing non-current records. The University Archives will preserve the records appraised to have permanent or archival value created by the University of Wisconsin-Madison, University of Wisconsin System Administration, University of Wisconsin Extension, and University of Wisconsin Colleges. In accordance with this mission, the University Archives collects and preserves born-digital records pertaining to our collection areas.

Our web archiving efforts began in 2007 to further support this mission by capturing websites and born digital records developed and maintained by UW-Madison departments and organizations.

Selection

The University Archives actively collects digital records that document University of Wisconsin-Madison faculty and staff, administrators, organizations, departments and student life. The University Archives does not discriminate against format or time period.  We also capture websites maintained by UW-System Administration, UW-Extension, and UW-Colleges. Digital material at risk of degradation or websites at risk of disappearing are a priority in our selection.

Please consult our Information for Campus Webmasters and Potential Donors page if you feel your website or born-digital material meets our criteria.

 The University Archives focuses its active collecting on the following selection areas:

Administrators

The University Archives seeks out the digital materials of administrators that hold influential positions at the University of Wisconsin-Madison; for example,

  • Chancellor, Provost, Vice Chancellor
  • College and school deans
  • Faculty and academic staff leadership
  • UW System Administration, Extension, and Colleges Administrators
  • Leadership within Governance, housing, campus recreation, campus police, health facilities, and other key entities

Faculty & Staff

The University Archives seeks out the digital materials of faculty and staff most likely to retire or leave the university in the near future, and/or those who have made a significant contribution to the University. The University Archives is interested in personal collections of faculty and staff as well as research associated with their time at the University of Wisconsin-Madison. The following is an example of kinds of digital materials the University Archives will collect:

  • Personal websites that relate to their UW research/work
  • Blogs that relate to their UW research/work
  • Presentations and publications
  • Photographs
  • Audio and video recordings

Units

The University Archives seeks to collect a summary of units, including but not limited to, colleges and schools at the University of Wisconsin-Madison. The following are examples of digital records the University Archives will collect from units:

  • Annual reports
  • Faculty hires and retirements
  • Research milestones
  • Space and facilities
  • Newsletters
  • Publications
  • Celebrations/key events

Organizations

The University Archives is interested in collecting digital records from organizations that are short lived, associated with the University, or have a high membership turn over or a long history at the University of Wisconsin-Madison. The following are examples of those organizations:

  • Associated Students of Madison (ASM)
  • Wisconsin Alumni Association (WAA)
  • Center for Leadership and Involvement (CFLI)
  • Wisconsin Union Directorate (WUD)
  • Student Leadership Center (SLC)
  • Software Training for Students (STS)

Student Life

The University Archives will collect both formal and informal digital records that document the leadership and extracurricular activities of students at the University of Wisconsin-Madison. Topics on diversity, recreational sports, religion, violence, and crime in relation to the student body are also of interest for the University Archives.

  • Key events
  • Social trends on campus
  • Students’ health
  • Fashion
  • Student employment
  • Student lifestyles
  • Traditions
  • Changing demographic
  • Diversity
Born Digital Acquisition

The University Archives actively collects born digital materials from campus organizations and departments, including university publications and reports, photos, and videos. The Archives also accept donations of born digital materials in many formats, including DVD/CDs, external hard drives, hard drives, flash drive/memory sticks, SD card, floppy disks, and shared webspace (Dropbox, Box, Google Drive). See our Information for Campus Webmasters and Potential Donors page if you are interested in making a donation.

The University Archives’ Oral History Program is a large source of born-digital material. All interviews conducted by the OHP are digitally recorded and processed. The audio exists both in mp3 and wav formats. Indexes and transcripts are created and stored digitally with hardcopies existing in both our internal files and the public files.

As technology and stable preservation formats evolve, the University Archives will actively monitor trends and convert our current collection to more stable formats for future accessibility.

Web Acquisition

Acquisition Method

Our web collections are harvested, stored, and accessed through Archive-It, a subscription service from the Internet Archive. The University Archives selects websites to be crawled through Heritrix, a web archiving tool developed by the Internet Archive.  The crawler captures web domains or individual web pages, taking a snapshot of the page and storing a copy in the Internet Archive, which can be accessed through Archive-It and the WayBack Machine.

Frequency of Crawls

The frequency of a capture depends on the frequency of updates to a particular website and current relevance. Websites that change frequently—like news sites—are crawled more often.  The University Archives has a plan that includes yearly, quarterly, semiannually, weekly crawls, or one-time. For example, we crawl https://commencement.wisc.edu/ twice a year: in December and May.

Scope and Limitations of Crawl

The University Archives collects solely web content relating to the University of Wisconsin-Madison, the University of Wisconsin-System Administration, University of Wisconsin-Extension, and University of Wisconsin-Colleges. File formats and types captured are HTML, JavaScript, PDFs, images, and videos. Content that is not crawled includes database-driven or form-driven pages, forums, calendars, streaming media, password-protected sites, and sites protected by robots.txt files.

Access and Use

Archive-It also provides access the content it collects. The content is searchable by keyword and facets, such as subjects, creator, date, type, etc. The sites are viewable through the WayBack Machine, the Internet Archive’s access tool.

The Internet Archive strives to replicate the look and feel of websites whenever possible by also collecting CSS files and displaying the websites as they existed.

While the University Archives and the Internet Archive strive to preserve the authentic experience of a website, it is not always possible. The limited scope of our web collections may include external links from UW pages are not captured, resulting in a “Not Found in Archive” message.

Copyright & Permissions

The University Archives does not claim copyright for any materials in the collection. In many of the records in the collection, the rights holder is listed (when it was available). Because this is a university collection, the most common rights holder for this collection is the Board of Regents of the University of Wisconsin System.

If a rights holder or creator wishes for their content to no longer be crawled by the University Archives, place a robots.txt file on your web server that is set to disallow User-Agent: ia_archiver.

PDF of Web Archiving Policy