Inaccessible Visits (Archived)

Unfortunately archiving of visits is standard procedure within Diamonds data management policy - XChem visits last longer than the 40 days allocated to data collection visits, but due to primary storage space limitations they are only available for a year from the end of the visit.

You can restore visit data from the archive (DataGateway), following the instructions below. However, restored visits and data are only accessible for two weeks as standard, so you will need to copy back vital files once the restoration goes through. If you are looking for a specific pdb file or similar, you should be able to find it with the search fucntion, restore it singularly and the process won't take as long.

Instructions for restoring ->

1. Login to icat.diamond.ac.uk and search by visit

2. Click the down arrow to the right of "create time" column which switches sort to dataset (ie. folder archived) order. 

You can select multiple datasets using a wildcard filter to find suitable subsets. Wildcard * is added by default.

3. Look for a suitable folder level to filter the list and track progress by. The number of folder depths vary between visits.

Usually, filtering at levels  "processing", "processing/analysis" have too many datasets so number of files went above restore limits. Try processing/analysis/model_building, but you may have to select on a crystal by crystal basis.

4. Tick the datasets required and submit job. Repeat 3 for the next batch of datasets.

For most visits, you can use a fourth level wildcard stem: lbXXXXX-#/processing/analysis/model_building/DATASET-x0<unique>

The number of restore jobs depends the folder structure and the size of the files in the children of the stem.

You will need to restore everything from processing downwards, so it will take several jobs and several days.