Preservation working group 2013
- 1 Working Group Charge
- 2 Working Group Members
- 3 Working Group Meetings
- 4 Materials: links, suggestions, feedback
Working Group Charge
To develop a state-of-the-art preservation plan for Dryad, with an emphasis on recommendations that are immediately useful and feasible to implement.
Working Group Members
- Elena Feinstein, Dryad curator, SILS/UNC-CH & MRC
- Jane Greenberg, professor, SILS/UNC-CH, director, MRC
- Alex Ball, Research Officer, UKOLN, University of Bath
- Robin Dale, Director of Digital and Preservation Services, LYRASIS
- Michael Day, Digital Curation Centre, UKOLN, University of Bath
- Ruth Duerr, Principal Investigator/Project Manager, Data Management and Cyberinfrastructure Manager, Data Stewardship, National Snow & Ice Data Center
- Cal Lee, Associate Professor, SILS/UNC-CH
- Robin Rice, Data Librarian, EDINA and Data Library, University of Edinburgh
- Ayoung Yoon, SILS doctoral student
Working Group Meetings
Kickoff meeting, 26 Feb 2013, 11:00am EST/16:00GMT
- Connection information sent via email
- Introductions (brief)
- Overview of working group goals
- Creation of Dryad policy statement on preservation (strategic, long term)
- Plan for implementation (priorities, immediate actions and long term goals)
- Quick, preservation-related facts about Dryad
- size of collection: more than 7000 files and growing every day, see Dryad homepage for current stats
- daily ingest of new content
- heterogeneous files types, some non-preferred for preservation (e.g., proprietary formats), see this text file for a snapshot of formats in Dryad on Feb 5 2013
- backups and checksums (Ryan will describe)
- currently no real preservation activities beyond the basics
- in process of joining CLOCKSS
- Questions from the group
- Communication preferences: wiki? email list?
- Action item for group members
- Send us one to three examples of model preservation policy documents from other organizations, that are relevant to Dryad
- Send us one to three other resources, such as templates, best practices documents, or preferred format documentation
- Send us your impression of our most immediate preservation need: what should we start doing right now?
- Data in Dryad are associated with published articles, usually in scientific & medical publications.
- Data is heterogeneous.
- Dryad has some best practices and applications but they are minimal, and haven’t had any preservation plan yet.
- Need to come up with preservation policy statement, e.g., what are some immediate actions that we can do, and what are the long-term goals.
- Dryad focuses on small and individual data, and deals with heterogeneous file types. Some are not good for preservation.
- We do some quality control, but generally not doing many. We do back-up and checksum.
- Having production server is in NCSU, and they do regular maintenance. Had mirror sever at Duke, update every 5 min. The secondary system has own back-up practices. Using DSpace, which automatically record and do checksum.
- Replication of content: content is in process of replication.
- Having too many copies of content, but not preserve well.
- How much effort for documenting?
- Very little, model for curation effort is really light. Because of heterogeneous files, we can’t have all different types of files.
- Not doing as much as quality control as desirable.
- Hope to educate scientific community about what to do.
- Public display of preservation readiness can be one idea: use 1-5 scale of star system, regarding how understandable data is.
- Some Dryad data are well described, but others are not clear.
- File format is the other issue, not all will survive.
- Not get to the problem of file format yet. For now, trying to scientific community get to the practice of depositing, and need to balance as scientists hesitate data archiving.
- Attitude will change quickly.
- Prioritizing file format might be needed, e.g., which one has more greater risk.
- If knows file format should be changed for preservation at some point, can change file format shortly after ingest.
- If not do it early on, you may not have enough information.
- We don’t want many people are reluctant (to deposit) but need to make sure data will be understandable.
- Interested in examples of other data repositories. How they convey this with diverse data sets.
- An example of ICPSR
- We encourage submitting definition of datasets.
- License issue
- Documentation: can eyeball datasets and see if documentation is usable and reasonable.
- We try to examine data as it comes.
- We serve very broad audiences; different communities need data in different formats. We reformat data for those communities.
- How much reusable data is Dryad getting?
- Difficult to track
- We do have some data reused for publication
- Know download rate, but it doesn’t necessarily mean that it’s used. We also don’t know if they directly contact to authors.
- Any ambition to get Trusted Digital Repository?
- Not current plan to do external audit, but want to get close to in the future.
- Data Seal of Approval as the other example.
- Send one to three examples of model preservation policy documents from other organizations, that are relevant to Dryad
- Send one to three other resources, such as templates, best practices documents, or preferred format documentation
- Send your impression of our most immediate preservation need: what should we start doing right now?
- Board (membership) meeting at May
- In late spring, draft policy documentation will be ready for your feedback.
Model preservation policies
- NSIDC's Data Management Policies document - which is quite old (all the technical information in it is outdated but for the rest it is still accurate)
- The Data Acceptance Plan for the NSIDC DAAC - our NASA funded project
- The draft collection policy for the Data Conservancy - since this time, the DC has gone to an instance by instance basis; but the base policy is still sound
- She says: While I am not sure that I would call anything from anybody a "model" document, I do think all of these were appropriate to their goals and audiences and faithful to the idea of data curation.
Other resources (templates, best practices documentation, etc.)
- Ruth: The NSIDC Levels of Service document - defining the various levels of service we provide. She says: While I am not sure that I would call anything from anybody a "model" document, I do think all of these were appropriate to their goals and audiences and faithful to the idea of data curation.
Suggestions of our most immediate preservation need (What should we start doing right now?)
- Ruth: metadata - coming up with ways to characterize what you've got, improve it, and check what is being deposited - all the things we discussed in the meeting.