Daily Bulletin

GLADE Reconfigurations: p, Collections, and Cheyenne Scratch Retirement Process and Deadlines

January 29, 2024

Particular subsystems of GLADE serving /glade/p, glade/collections, and /glade/scratch (Cheyenne’s scratch file system) will be retired on February 28, 2024. This transition has been underway for several months and is required as these components have reached end-of-life. There are several remaining steps in this process that will aid users in identifying any data sets still in need of relocation into either Derecho Scratch or Campaign Storage.  

For /glade/scratch:

For ALL USERS (Cheyenne’s scratch file system):
Consistent with use as temporary storage, CISL has no plans to migrate scratch data between Cheyenne and Derecho, however users can self-migrate data as described here. The following access deadlines apply to /glade/scratch for all users:
  1. Wednesday, February 21st:
    • Write permissions removed from /glade/scratch/<USERNAME> spaces.
    • This will cause any workflows still writing to Cheyenne’s scratch file system to fail, especially helpful to identify “forgotten” use.
  2. Wednesday, February 28th:
    • Cheyenne’s scratch file system is permanently retired. Any remaining data on /glade/scratch will be lost.
    • Unmount /glade/scratch from all user-facing systems.

For /glade/p and /glade/collections: 

For NCAR Labs:
  1. Wednesday, February 7th:
    • Write permissions removed from file spaces.
    • This will cause any workflows still writing to /glade/p/<NCAR_LAB> to fail, especially helpful to identify “forgotten” use.
  2. Wednesday, February 14th
    • Read permissions removed from file spaces.
    • This will cause any workflows still reading from deprecated project space to fail, especially helpful to identify “forgotten” use.
    • This period allows us about two weeks to triage forgotten read access workflows. 
  3. Wednesday, February 28th to  Friday, March 1st:
    • Unmount current /glade/p and /glade/collections from all user-facing systems.
      • During this time-window, any workflows still accessing data under these paths will fail!
    • Perform decommissioning steps that require a “quiet” files system.
    • Replace certain /glade/p, /glade/collections paths with symbolic links into relocated Campaign Storage destinations.

For Active University Projects:
CISL Staff are automatically relocating data from /glade/p/univ/ and /glade/p/uwyo/ into Campaign Storage File spaces as described here
  1. Wednesday, February 28th to  Friday, March 1st:
    • Unmount current /glade/p and /glade/collections from all user-facing systems
      • During this time window any workflows still accessing data under these paths will temporarily  fail!
    • Perform decommissioning steps that require a “quiet” files system.
    • Replace /glade/p/univ, /glade/p/uwyo paths with symbolic links into relocated Campaign Storage destinations, re-enabling access through these path names.