[Lilab] [URGENT] Please Clean HPCC Storage

[Shiwei Fu]

Hi Professor Li,

This is my current storage situation after removing some of the unnecessary
files in the /bigdata directory:

1.0K .ipynb_checkpoints
8.1G software
19G reference
89G TSS_prj
168G .conda
544G ST_Domain_prj
826G total

Most of the usage comes from the ST_Domain project and the conda
environment. The reason for the large /ST_Domain_prj is because I have run
the GAM function with different k numbers. And the large /.conda is because
for each benchmarking method I created an environment and eash
environment can be ~20GB.

On Wed, Dec 17, 2025 at 11:54 AM Wei Vivian Li via LiLab <
lilab at lists.ucr.edu> wrote:

> We have 10T in the bigdata, where ~3.5T have been used to store shared
> data, which leaves ~6.5T to host files of all accounts. Given the current
> size of our group, it would be safe to try to limit the file size in
> individual accounts to ~1T.
> Of course, this is also project-dependent, and some projects just require
> more storage space. If you are unsure about which files can be removed,
> please talk to me.
>
> *Please address these issues today or let me know if you need more time.*
> Thanks!
>
>
>
>
>
> On Wed, Dec 17, 2025 at 10:56 AM Wei Vivian Li <weivivian.li1 at ucr.edu>
> wrote:
>
>> Dear All,
>>
>> It appears that our shared bigdata directory on HPCC is approaching its
>> storage limit, which is making access, read, and write operations extremely
>> slow for everyone.
>>
>> Please take the following steps immediately:
>>
>>    - Check your storage usage in your bigdata directory by running:
>>
>> du -sch .[!.]* * | sort -h
>>
>>    - Review large subdirectories and files to determine whether they are
>>    still needed.
>>
>>
>>    - Delete intermediate or temporary files that are no longer necessary.
>>
>>
>>    - If you wish to keep older files, move them to your personal device
>>    or another appropriate storage location.
>>
>>
>>    - Do not delete original/raw data or key results, even if the project
>>    has been completed.
>>
>>
>> Thank you for taking care of this promptly. Please let me know if you
>> encounter any difficulty with the storage management.
>>
>> *Once you are done, please reply to this email with your overall file
>> sizes before and after cleaning.*
>>
>> Best,
>> Vivian
>>
>> _______________________________________________
> LiLab mailing list
> LiLab at lists.ucr.edu
> https://lists.ucr.edu/mailman/listinfo/lilab
>


-- 
Shiwei Fu
PhD Student
Department of Statistics
University of California, Riverside
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.ucr.edu/pipermail/lilab/attachments/20251217/276305cf/attachment.htm>