Retirement of /work1

On August 23 2024, at 18:00 the /work1 scratch directory will be retired. After the service window, on August 26, the directory will not be accessible any longer from any computational node.

A new directory under /work3 with the structure /work3/username has been created for all users who had a directory under /work1. If you have data under /work1, you should select which data you want to save, and move them to your new /work3 folder.

Please do this before August 23.

Data migration: recommended procedure

The scratch directory are supposed to be used for temporary data, and not as a long term archive. Anyway, the amount of data and the number of files to be trasferred can be quite high, and the process could take several hours, and incur in interruptions or network issues. We therefore recommend the following procedure:

  1. Please go through the data you have in your /work1 directory, and remove the data you do not want to save to the new /work3 directory. Be careful: deleted data are NOT recoverable.
  2. Login to transfer.gbar.dtu.dk.
    This node has a dedicated fast connection to all the cluster storages.
  3. Use the rsync utility to copy the data. rsync only transfers the data that have not been already transfered, and can be interrupted and restarted. Do not use mv or anything that is supposed to automatically delete the original file after copying it, those could create issues if the session fails.
    If your /work1 directory name  is the standard /work1/username, where username is your DTU user name, you can use the command:
    rsync -a /work1/$USER/ /work3/$USER/from_work1/
    Otherwise please adapt the command to the actual name of your /work1 directory.
    This command will copy all the directories and files under your /work1/$USER/ directory in a subdirectory of your new /work3 directory named from_work1, preserving all the files properties and modification dates.
    NOTE: this command will not return anything, and keep the terminal busy until it finishes. It could take hours, depending on the amount and kind of data. In case of errors, rerun it until all the data are copied.
  4. Check that all the data you wanted to transfer are in the destination directory /work3/$USER/from_work1/
  5. When all data have been transfered, please remove the original data from the original directory.

Be careful: deleted data are NOT recoverable.

After August 26

After August 26, the /work1 directory will be mounted in readonly mode exclusively on transfer.gbar.dtu.dk, and it remain available until December 1at 2024. Until that date it will still be possible to transfer the data, but the data transfer will be slower and less efficient.
After December 1at 2024 all the remaining data will be deleted.

In case of doubt

Do not hesitate to write us at support@hpc.dtu.dk