• Update sizes.. data should be in RAM not on USB stick


    dopeytree
    • Annoyance

    Can we have a way to update USB sticks without having to use the stick for the temp download storage?

     

    Something's changed about the update process. Currently on 6.12.6 & attempting to go to 6.12.8

     

    There's a .git folder on the usb stick that is 1.25GB.

     

    Unraid runs in ram I have 128GB... why is the update being saving to my USB stick? Then processed.

     

     

     

    My stick is an industrial 2GB stick..

     

    Also it says 512MB usb stick is on in the documentation...

     

    1614965047_Screenshot2024-02-17at14_09_59.thumb.png.1f9537ed17f3573e95851f25300026b6.png

     

    https://docs.unraid.net/legacy/FAQ/usb-flash-drive-preparation/#usb-flash-drives

     

    628259953_Screenshot2024-02-17at14_13_39.thumb.png.02cdb2b8cdd7fe08cd542e2360f267d9.png




    User Feedback

    Recommended Comments

    yeah but its been enabled since 6.11

     

    Is that what the .git folder is for? the usb cloud backup function?

    or is it where a manual click flash backup is generated?

     

    Is it safe to delete?

     

    It appears to have lots of small files inside folders. Biggest I can see is 1mb.

     

    1903594102_Screenshot2024-02-17at14_26_16.thumb.png.266d0eb2353c69c299475b9e2c2e2850.png

     

     

     

    Here's my usb drive. Everything except the .git folder = about 400MB. 

    The .git folder is 1.25GB

     

    1611309521_Screenshot2024-02-17at14_31_45.thumb.png.a88afc6f792c30beb957789d9f6de5c2.png

     

    534383268_Screenshot2024-02-17at14_27_52.thumb.png.c67031d9297c1fe776ac625971ee1276.png276072097_Screenshot2024-02-17at14_27_54.thumb.png.a8ff5811096535bc8366b6eb5c75f8fd.png

    Edited by dopeytree
    Link to comment

    Ok I used the search function for the term 'USB'.

     

    Perhaps we could make legacy docs a different colour? i.e blue. Not sure how to implement this in docusaurus.

     

    In either case my usb drive is 2GB which is defined in the up to date documents..

     

    Anyway the bug is that connect cloud backup is not cleaning up after it's work. 

     

    I know it has to process some files (to remove any identifiable items) so it was probably the easiest thing to do but after a successful upload it should be removing the files.

     

    1.25GB is quite alot of wastage.

     

    This work could probably be done in ram or simpler an option to use one's appdata folder as the default shares are creates for all user.

     

    i.e the .git folder.

    Edited by dopeytree
    Link to comment
    1 hour ago, dopeytree said:

    appdata folder as the default shares are creates for all user.

    Default shares are not created until Docker and/or VM Manager are enabled. And those paths are actually determined by the Docker and VM Manager settings made.

     

    So not everyone will have appdata.

     

    Flash drive is the only persistent storage guaranteed to exist.

    Link to comment

    Valid but equally could just add an option to select a location to store the files. So default is usb but allow a manual setting too.

     

    A script to delete the old files in the .git could be something like:

     

    import os
    import datetime
    
    def clean_folder(folder_path, days_to_keep):
        # Get the current date
        current_date = datetime.datetime.now()
    
        # Calculate the date threshold
        threshold_date = current_date - datetime.timedelta(days=days_to_keep)
    
        # Iterate over files in the folder
        for file_name in os.listdir(folder_path):
            file_path = os.path.join(folder_path, file_name)
            
            # Check if the file is older than the threshold date
            if os.path.isfile(file_path):
                file_creation_time = datetime.datetime.fromtimestamp(os.path.getctime(file_path))
                if file_creation_time < threshold_date:
                    # If the file is older than the threshold date, delete it
                    os.remove(file_path)
                    print(f"Deleted {file_path}")
    
    # Specify the folder path to clean and the number of days to keep files
    folder_path = "path/to/your/folder"
    days_to_keep = 7  # Change this to the number of days you want to keep files
    
    # Call the function to clean the folder
    clean_folder(folder_path, days_to_keep)

     

    In the future perhaps unraid connect should have a companion app (docker container) and this could be what does the encryption processing in the future for more secure backups. This would then use appdata share to process data.

     

    Also avoids excess read/writes to the usb stick.

    Edited by dopeytree
    Link to comment

    Is this being tracked?

    The connect plugin just needs to occasionally clean up the .git folder on the usb stick.

    Link to comment


    Join the conversation

    You can post now and register later. If you have an account, sign in now to post with your account.
    Note: Your post will require moderator approval before it will be visible.

    Guest
    Add a comment...

    ×   Pasted as rich text.   Restore formatting

      Only 75 emoji are allowed.

    ×   Your link has been automatically embedded.   Display as a link instead

    ×   Your previous content has been restored.   Clear editor

    ×   You cannot paste images directly. Upload or insert images from URL.


  • Status Definitions

     

    Open = Under consideration.

     

    Solved = The issue has been resolved.

     

    Solved version = The issue has been resolved in the indicated release version.

     

    Closed = Feedback or opinion better posted on our forum for discussion. Also for reports we cannot reproduce or need more information. In this case just add a comment and we will review it again.

     

    Retest = Please retest in latest release.


    Priority Definitions

     

    Minor = Something not working correctly.

     

    Urgent = Server crash, data loss, or other showstopper.

     

    Annoyance = Doesn't affect functionality but should be fixed.

     

    Other = Announcement or other non-issue.