Filesystems

There are several locations you can store data:

/home/your_user_name: NFS mount. Best for store your codes, configure files, papers etc.al.

/lustre/your_group/your_user_name: Lustre, 4TB. It has fast I/O, for scratch and long term storage. Non-backup filesystem.

/store/bl2/scratch/your_user_name: Glusterfs, 4TB volatile. This is where to store the data generated by computing jobs. Files not used in this storage will be deleted automatically after 30 days.

/store/bl2/your_group/your_user_name: Glusterfs, 1TB. Suitable for long term storage of your data.

As of September 2022, we recommend do not use /store/bl2, since its hardware is aging.

Backup

/home/your_user_name is backed up regularly. The backup job skips common temporary directories, and well-known large but unessential files & directories. Following are excluded from backup (September 2022):

.cache/
.Cache/
.trash/
.Trash/
tmp/
Tmp/
temp/
Temp/
delme/
do.not.backup/
.ccache
.gvfs
.xsession-errors
.npm/
node_modules/
anaconda/
anaconda3/
miniconda/
miniconda3/
.conda/
.local/lib/
.cargo/
.rustup/
.julia/
.vscode-server/

Quota Policy

INPAC cluster filesystems has two types of quotas:

• Space: limits on total disk space occupied by your files

• inodes: limits on total number of directories and files

Hard and Soft Quota Limits

User can occasionally exceed soft limits. After a grace period of 14 days, the soft limit will become hard limit.

Hard limit prevent further allocation of disk resources. User must remove existing files before create new files and directories.

/home	soft	hard
Space	20 GB	22 GB
inode	500,000	550,000

/lustre	soft	hard
Space	4 TB	5 TB
inode	300,000	320,000

To check your quota on cluster, run df-inpac:

testuser@bl-0:~$ df-inpac
                      Used       Quota       Use%
-------------------------------------------------
  Home  space:      571.0M         20G         3%
  Home inodes:        3460      500000         1%
Lustre  space:       53.7G          4T         1%
Lustre inodes:       71359      300000        24%

CernVM-FS

Available cvmfs:

/cvmfs/atlas-condb.cern.ch
/cvmfs/atlas-nightlies.cern.ch
/cvmfs/atlas.cern.ch
/cvmfs/cepc.ihep.ac.cn
/cvmfs/cernvm-prod.cern.ch
/cvmfs/config-osg.opensciencegrid.org
/cvmfs/fermilab.opensciencegrid.org
/cvmfs/geant4.cern.ch
/cvmfs/gm2.opensciencegrid.org
/cvmfs/grid.cern.ch
/cvmfs/sft-nightlies.cern.ch
/cvmfs/sft.cern.ch
/cvmfs/unpacked.cern.ch