Introduction of a limit on the number of files and directories on SQUID

The currently operating SQUID supercomputer is equipped with a file system of over 21 PB in total, and sufficient storage capacity remains available. However, we have recently confirmed that the number of files and directories is approaching a critical level. Although the system was designed to accommodate over 10 billion data objects, we have been operating it without imposing a limit, and its usage is now nearing the system-wide maximum.
 

To ensure stable system operation, we have therefore introduced a new upper limit on the number of files and directories.
 

Measures Implemented

Effective date: From noon on December 8
Details: The maximum number of files and directories per group on /sqfs/work has been set to 189,730,652.
Impact: Once the limit is exceeded, creating new files and running programs will no longer be possible.
 
Groups that have already exceeded the limit have been contacted individually in advance.
Groups approaching the limit will be notified individually in due course.
 

How to Check the Current Number of Files and Directories

Run the following command on a frontend node, specifying your group name.
You can check your group name with the "groups" command (the group name appears after "ocean" or "hpci").

In this example, the value 1230000 shown in the "files" column indicates the total number of files and directories currently used by the group. If this number approaches 189,730,652, reduction is required.
If you need to know the file count for individual users, please contact from this form.
 

How to Reduce the Number of Files and Directories

Please delete any unnecessary files whenever possible. You can also reduce file counts by archiving multiple files using tar, zip, etc., and then deleting the original files. If you have difficulty addressing this issue, please feel free to consult us from this form.




Posted : December 08,2025