Page History

Scheraga's group must confirm decision on

...

partitions AND

...

their capabilities and use.

Why?

ChemIT requires this information to set up the new Matrix. Soon, a lack of a decision from the group will bring this project to a full-stop until the information is provided.

• Initial email sent 7/29/2014 5:30:05 PM to Czarek and Gia. No written confirmation, as of 8/25/14 (Monday).
• Even after confirming ChemIT's initial suggestions, iterations and subsequent clarifications may also be required. For those, we also need the group's continued engagement to ensure ChemIT is doing things to best meet the group's needs.

...

• /home (3TB total; on Synology)
  
  • Can be seen by compute nodes. Data stored on compute nodes until work is done, then moved to /home.
  • Data on /home removed when not actively needed for their cluster work. Can move the data to /storage, for safe-keeping and convenient access.
  • Data is backed up via EZ-Backup.
  • A new user gets 50GB, by default.
  • The process to request more space is through group designate.
• /storage (8TB total)
  
  • Can NOT be seen by compute nodes.
  • This is to store data related only to Scheraga research. No personal files.
  • Data is backed up via EZ-Backup.
  • The process to request more space is through group designate.
• TBD (1TB total)
  • To be used for either expanding /home or /storage at a later date (when we know which needs more space sooner than the other).

On internal to headnode 4TB regular hard drive:

• /notbackedup (4TB total)
  
  • Can be seen by compute nodes.
  • For when a researcher needs more temporary space than an individual compute node can provide.
  • Researcher must move data off as soon as they are done with it.
  • This data is NOT BACKED UP. Use only temporarily, and only when a researcher needs "surge" space.
  • No quotas. Thus, potential for researchers to "step on each other".
• Q: Make more robust by adding hard-ware RAID and a 2nd identical drive?
  • Cost of RAID card:
  • Cost of 2nd identical hard drive:

On internal to headnode 256GB SSD hard drive:

Drive is backed up via EZ-Backup, and contains these partitions:

• OS (16-17 GB)
  
  • YUM-installed applications
  • And other select other cluster-specific applications
• swap (32 GB)
• /data (200+GB; the rest!)
  
  • Applications for researchers (/software -> /data/software)
  • Software source files.

...

• Create empty /home directories for each user. Leave empty.
• ChemIT copies all a user's data in old Matrix to the new Matrix's "/storage " partition. Each researcher selectively moves what is required to their new Matrix home directory.
• OUTCOMES
  • Clean /home directories, making restores and debugging much easier over time.
  • Pawel supports this approach. He estimates perhaps 1/2 - 1 hour work for each researcher.
• To do: Figure out dates and other timing, including complete downtime.

...