2025-02-14 - Important: Data Migration and Storage Transition Updates

Created by Bent Petersen, Modified on Tue, 18 Feb at 8:14 PM by Bent Petersen

Dear all,


Most of you (only 30 users remaining) have now received an email regarding your new designated storage location.


If you are part of multiple projects, please consider where your data should reside, especially if you collaborate with another PI.


We are now moving into the second phase of our reorganization.


Over the past 1.5 months, you’ve had the opportunity to reduce your storage, and I can see that storage reduction efforts have now plateaued. (See attached image.) 


Currently, our total annual storage cost is 2,365,000 DKK across all projects.



Next Steps (Effective Immediately):


1. All new data should be generated in your new project folder(s).


    Data generation in /projects/mjolnir1 must stop from today onwards, except for the 30 users who have not yet received a new project directory. If you are currently running jobs, they can also run to the end, no need to kill anything that is currently running.


2. Move existing data from /projects/mjolnir1 to your new project folders.


    If you have unneeded data, delete it before moving your files.


    This avoids unnecessary backup costs, as we pay for a 14-day backup cycle, and moving unnecessary data means paying twice for storage.




3. Check and migrate data from /projects/mjolnir1/data.


    I will contact each person individually with a deadline for data migration.


    If data is not moved by the deadline, I will relocate it to your new project folder and delete it from its current location.




4. Users who do not take action may temporarily lose access to the Mjolnir gatenode.


    If you don’t initiate the migration, I will need to move your data manually, which requires temporary access removal to avoid disruptions.


    Due to the complexity of this transition (169 users and 2.5 PB of data), I will provide only a few days’ notice if access needs to be restricted.


    To avoid this inconvenience, please start moving your data proactively.



5. Need help moving your data?


    If you’re unsure of the best way to transfer your files, please reach out to me.



6. Want me to move your data for you?


    Contact me so I can schedule it accordingly.



7. Confirm once all your data has been moved.


    Once migration is complete, let me know so I can remove your access to /projects/mjolnir1, as it will no longer be needed.



8. Software Migration:


    Many software modules still reside in /projects/mjolnir1, and I am in the process of reinstalling and updating them.


    If your pipelines/scripts/workflows rely on software from /projects/mjolnir1/apps/modules, submit a ticket specifying which software should be prioritized for migration.



    How to check where a module is stored:


    Run: module display bwa/0.7.15


    If the output shows: /datasets/globe_software/modules/bwa/0.7.15: (/datasets/globe_software), you’re fine.


    If it shows: /projects/mjolnir1/apps/modules/biopython/1.68 (/projects/mjolnir1), submit a ticket.



If anything in this email is unclear, please contact me.



Best regards,


Bent

Was this article helpful?

That’s Great!

Thank you for your feedback

Sorry! We couldn't be helpful

Thank you for your feedback

Let us know how can we improve this article!

Select at least one of the reasons
CAPTCHA verification is required.

Feedback sent

We appreciate your effort and will try to fix the article