PICO & Holo Small Data Storage

This storage system provides more than 100 TB data for experiments done with the PICO and the Holo microscope. The main target is to provide a short term (weeks, not years) data buffer. This means, that the general policy should be that each user reduces the data size by compression, pre-processing and evaluation as much and as soon as possible via the attached workstations and then deletes the large data set.

The storage capacity is limited and not designed for long-term backups.

Structure

Structure of the small data storage system at the PICO and Holo microscopes
Structure of the small data storage system at the PICO and Holo microscopes

The storage system allows to deposit experimental data from the fast detector systems. Large amounts of data should be moved from the detector servers towards the storage only. The connections between storage and detector servers are single 10 GBit/s ethernet lines.

Workstations are connected to the storage to be used by multiple users in parallel for accessing, pre-processing and final saving of the data. A Microsoft Windows workstation is already installed and a Linux workstation is planned to be installed later. The workstations are connected via 10 GBit/s ethernet lines to the data storage.

Access to the workstations and with this to the data storage is possible from the IFF subnet of the Junet via at maximum 1 GBit/s lines. All users of the domain IFFW2K have user access rights.

Access

Data can be written from the PICO and Holo camera servers via 10 Gbit/s lines of a separate local area network using shared folder access with a samba protocol. Storage capacity is separated for the PICO and the Holo. On the PICO Gatan OneView Server a drive with letter "S" links to the PICO part of the data storage. On the Holo Gatan K2 server a drive with letter "(to be announced)" links to the Holo part of the data storage

Direct access to the data is also provided from the following workstations accessible from the Junet:

  • IFF914 Microsoft Windows workstation: The two separate parts of the data storage should be mapped as drive "H" for the Holo data and as drive "P" for the PICO data. If you don't "see" these drives, please execute the script "net use.cmd" from your desktop. This will map the two network drives, which should be available from now on each time you log on to the workstation.
  • IFF588: Möllenstedt Linux server: The two separate parts of the data storage should be mapped as /storage/holo and /storage/pico for the Holo and PICO data respectively. If the folders and data are not accessible, please contact administrators.

Administration

The system is administrated by Juri Barthel, Vadim Migunov, Alexander Clausen, Markus Consoir, and Josef Heinen.

Loading...