As of 2017-12-06

...

...

Formats/Collections Analysis

Time-frame: November 1 thru March 31, 2016

The DRA in collaboration with IS will develop reports of number of files by type by collections. This analysis will identify the quantifiable scope of the project and be used to assist in identifying migration priorities.

...

Establishment of metadata requirements for MOs to be migrated

Time-frame: November 1, 2015 thru April 30, 2016

The Metadata Objects Work Group (MDOWG) has been working towards establishing minimum metadata guidelines for placing objects in the MOR. The current draft guidelines are for images and will need to be extended to include other format types and complex objects.

...

Identification of Master Objects (MO) to be migrated

...

Of the nearly 2,000,000 items in the Dark Archives (and digital objects stored on external media and potentially the J-Drive) not all are Master Objects that should be migrated to the MOR. Curators and Archivists will conduct this endeavor and will rely upon the outcomes of the "De-duplication of Dark Archive" efforts, the application of the definitions for "Master Objects" and the Format/Collection Analysis efforts to determine which objects will be migrated.

 

Migration

Prioritization

Time-frame: February 1 thru June 30, 2016

Prioritization of collection to be migrated will be dependent An initial analysis for prioritization of collections to be migrated was developed based upon:

• completion of the de-duplication process
• the file formats that the MOR can ingest
• the format homogeneity of the collection
• metadata and rights readiness of the collection
• User access demands

Prioritization decisions will were to be made by collection curators and archivists in consultation with Strategic Digital Initiatives Work Group (SDIWG - which includes the Heads of Digital Initiatives, Digital Content Services, Preservation and Reformatting and Application Development & Support), Head Special Collections Access & Description and the Digital Resources Archivist.

That system did not work. As of August of 2017, the newly minted Digital Preservation Librarian was charged with developing a new prioritization metric that accounted for:

• born digital vs. reformatted content

Rights analysis

...

• File type
• Object complexity:
  
  • single
  • complex <10
  • complex >10
  • ordered complex
• Metadata readiness
• KB master
• Security/restriction constraints
• Special considerations

Rights analysis

To ensure proper citation and public availability, content rights statements MUSTaccompany all content. Rights statements should include information regarding the rights holder, access permissions, and special processing instructions (e.g., watermarked or not). This is a collaborative effort with the curatorial staff, Special Collections Access & Description and the Copyright Resource Center (CRC).

Metadata identification and/or creation

...

NO ITEMS WILL BE MIGRATED WITHOUT METADATA. Based upon the minimum metadata guidelines established by the MDOWG, as well as desired elements for particular collections metadata will be created (or appropriate existing sources will be identified) for all objects to be migrated.  This is a collaborative effort with the MDOWG, SCA&D and curatorial staff, in consultation with AD&S.

Migration Testing

...

Individual and batch migration workflows will be was tested with migration-ready content prior to taking the process live in 2016 -Q1. Test collections will be culled from those whose de-duplication efforts, rights analysis and metadata creation is complete. Decisions will be made by the Head of Digital Initiatives,  Head of Preservation and Reformatting, Head Special Collections Access & Description, Digital Resources Archivist and appropriate curatorial staffand 2017. While processes were refined issues arose with complex objects that had more than 10 components. Call through Active Fedora bogged the system down, eventually prompting a 503 timeout error. Therefor that content is not only inaccessible to our patrons, but to curators. We did successfully test batch ingest, ingest of simple complex objects including those with various file types, and we successfully tested ingesting complex object that include public and suppressed files.

Migration of MOs

Time-frame: TBD

• Non-mediated content: images, documents, audio/visual objects that can be individually and batch loaded to MOR with little-to-no mediation from curator and/or SCA&D. This is a collaborative effort with SCA&D Digital Preservation (DP) and curatorial staff , in consultation with Digital Initiatives (DI), Special Collections Access & Description (SCA&D) and Application Development & Support (AD&S).
• Mediated content: images, documents, audio/visual objects that can be individually and batch loaded to MOR that require significant mediation from curator and SCA&D. This is a collaborative effort with SCA&D Digital Preservation (DP) and curatorial staff , in consultation with Digital Initiatives (DI), Special Collections Access & Description (SCA&D) and Application Development & Support (AD&S).
• Disposition determinations of remaining content. Decisions will be made by HDI, HPR, HSCA&D, DRA Digital Preservation Librarian, Head of Digital Initiatives, Head of Preservation and Reformatting, Head of Publications and Repository Services and appropriate curatorial staff.

Post DarkArchive Migration Clean-up

Time-frame: TBD

• Disposal of derivatives
• Disposal of excess copies found in J-Drive and External Media
• Determination of disposition for other non-Master Objects

...