Storage of diffraction data: Difference between revisions

From CCP4 wiki
Jump to navigation Jump to search
No edit summary
 
(One intermediate revision by the same user not shown)
Line 1: Line 1:
Synchrotrons are very good at archiving all collected data. In contrast, there's no requirement for including diffraction data when submitting a structure to the PDB. Consequently, the connection between structure and the underlying data is lost for all practical purposes. Some think this is a problem, but there aren't any good solutions yet.
Synchrotrons are very good at archiving all collected data. In contrast, there's no requirement for including diffraction data when submitting a structure to the PDB. Consequently, the connection between structure and the underlying data is lost for all practical purposes.  


== Diffraction data storage solution ==
== Diffraction data storage solutions (2018) ==


As the PDB isn't developing data storage and retrieval solution, community efforts are needed. Here are a few examples:
* zenodo.org (including https://zenodo.org/communities/mx/?page=1&size=20 but maybe other "communities"); this is managed by CERN
* SBGrid https://data.sbgrid.org/ - see https://www.nature.com/articles/ncomms10882
* proteindiffraction.org (this has e.g. almost? all the JCSG data!)
* Australian synchrotron.store - see https://store.synchrotron.org.au and http://scripts.iucr.org/cgi-bin/paper?S1399004714016174
* the ESRF makes all collected data available after 3 years; see http://www.esrf.eu/datapolicy


* myTardis - developed at the Australian synchrotron and [https://github.com/mytardis/mytardis downloadable as open source].
There are many more local repositories, e.g. for universities.
* [[CDR]] - an effort headed by the Irish Centre for High End Computing of turning [http://www.irods.org iRods] into a modular storage solution that can be deployed at the lab or institute level.
 
Recent publications: http://journals.iucr.org/m/issues/2017/01/00/ti5008/index.html
http://journals.iucr.org/m/issues/2017/01/00/hi0156/index.html

Latest revision as of 22:42, 17 January 2018

Synchrotrons are very good at archiving all collected data. In contrast, there's no requirement for including diffraction data when submitting a structure to the PDB. Consequently, the connection between structure and the underlying data is lost for all practical purposes.

Diffraction data storage solutions (2018)[edit | edit source]

There are many more local repositories, e.g. for universities.

Recent publications: http://journals.iucr.org/m/issues/2017/01/00/ti5008/index.html http://journals.iucr.org/m/issues/2017/01/00/hi0156/index.html