Roadmap: The Dataverse Project

dataverse project logo

The Strategic Goals of the Dataverse Project are our highest-level guide.  These goals are to:

  • increase adoption (users, Dataverse repositories, Dataverse collections, datasets, journals)
  • develop capability to handle sensitive, large scale, and streaming data
  • expand data and metadata features for existing and new disciplines
  • expand archival and preservation features
  • increase interoperability through implementation of standards
  • increase contributions from the open-source development community
  • improve UX and UI
  • continue to increase the quality of the software

Throughout the year, we'll identify big steps that we can take to focus on one or more of these goals. These big steps are detailed on our Roadmap, below.

The big things the development team and the community are working on right now are shown in the Implementation section. In the Planning/Design section, you can see those strategic items that we've prioritized and are designing and testing with the community. In the Future section, you'll see the things that we'd like to work on but haven't yet prioritized. A list of Recent Releases is available at the bottom of the page. 

This roadmap is only focused on the big initiatives. We're always working on smaller bug fixes and enhancements. If you'd like to see everything that the Dataverse Project Team and Community are working on right now, check out the Project Board on Github.

Implementation

Q2 2021 Continued Dataset and File Redesign

  • A new experience around downloading and accessing data will be provided as part of the continued redesign of the dataset and file pages. This follows the adding of previewers, filtering and sorting, and tree views on the dataset and file pages. 
  • Github Issue #6684

Q2 2021 Homepage Visualization

  • The Harvard Dataverse Repository team is working with the Harvard Library to create a homepage visualization that shows the growth of a Dataverse repository and the activity and connections between the datasets. This will be made open source for the community to use and edit.
  • Github Issues #5603#6750

Q2 2021 Open Differential Privacy Integration

  • Dataverse repositories will be able to integrate with tools from the OpenDP Project to allow for the deposition, download, and exploration of differentially private versions of datasets.
  • Github Issues #7203#7158#7400

Planning/Design

Q2 2021 Simplified Add Data, Linking, and Dataverse Collection Creation Workflows

  • By making it easier to create Dataverse collections and link datasets, researchers can more easily create and curate custom collections of data.
  • Github Issue #5874#5890#5615

Q3 2021 Trusted Remote Storage Agent (TRSA) Integration for Sensitive and Large Data

  • TRSAs allow data providers to create metadata records in a Dataverse repository for research data that is too large or sensitive to deposit into a Dataverse repository. Researchers can discover the metadata in a Dataverse repository and be directed to the appropriate steps or automated workflows to access the data itself. Additional Information is available from cyberimpact.us.
  • Github Issue #5213
  • Check out the Code in Progress

Q3 2021 Capsulation and Packaging for Replication Objects

  • As part of a grant from the Sloan Foundation, the Dataverse Project will integrate with Code Ocean and other replication tools to allow capsules to be deposited and accessed for a dataset. This will allow authors, replication analysts, and other researchers to quickly verify that a dataset's findings can be computationally reproduced.
  • Github Issue #6085

Future

2021 Citations for Dataverse Collections

  • Researchers will be able to cite Dataverse collections as well as Datasets and Files.
  • Github Issue #6112 

2021 Embargo

  • Authors will be able to create dataset metadata in a Dataverse collection and set up a timed-release process for the data itself.
  • Github Issue #4052

2021 Code Deposit and Expanded Software Metadata, Sync from Github

  • Code can currently be deposited into a Dataverse repository, but we'll provide some code-specific metadata, an updated workflow, and a way to automatically sync Github repositories into a Dataverse repository as researchers make changes.
  • Github Issue #2739#5372

2021 Green, Blue, Yellow DataTags Support

  • Through an integration with Datatags, researchers will be able to deposit and share datasets that contain sensitive information up to the Yellow level.  
  • Github Issue #871 

2021 Orange DataTags Support

  • Through an integration with Datatags, researchers will be able to deposit and share datasets that contain sensitive information up to the Orange level.
  • Github Issue #871

 

    Recent Releases

    • 5.4 Key Technology Upgrades, New File Access API, Deactivate Users API, 4/5/2021
    • 5.3 Auxilary Files to Support Differentially Private Metadata Deposit, Updated Banner Options 12/10/2020 
    • 5.2 Continued Dataset and File Redesign, Google Cloud Archiver Integration 11/9/2020
    • 5.1 and 5.1.1 >5 GB Upload to AWS S3, Additional Store Options for Administrators, Performance Enhancements 10/8/2020
    • 5.0 Continued Dataset and File Redesign, Payara Upgrade, Download Dataset 8/18/2020
    • 4.20 Multiple S3 Stores, Direct S3 Upload 4/1/2020
    • 4.19 OIDC Connect, Python Installer 1/22/2020
    • 4.18 File Preview, Microsoft Login 11/14/2019
    • 4.17 Dataset Level Explore Tools, Performance Enhancements 10/3/2019
    • 4.16 Metrics Redesign and Make Data Count Support, HTML Codebook Exports, Harvesting Improvements 8/28/2019 
    • 4.15.1  Performance Enhancements, Variable Metadata Edit APIs 7/10/2019
    • 4.15 Sorting and Filtering Files in a Dataset, Better Recognition and Categorization of Files 6/14/2019
    • 4.14 OpenAIRE-compliant exports, expanded analytics options 5/10/2019
    • 4.13 File Hierarchy Support, File Metadata Edit APIs 4/22/2019 

    Last updated 4/8/2021