[Plugin] rclone


Waseh

906 posts in this topic Last Reply

Recommended Posts

Sooooo....not quite sure what happened but realized today my rclone using google drive wasn't working - it wasn't mounted.  Turns out it complaining that here are files in the mount directory - i have been running sync jobs constantly - but i'm not sure why this is happening that its writing to the mount directory.  Anyways, any tips for clearing the folder so i can once again mount, as i'm not finding an easy way to delete the files that are there

EDIT:  I can see the files and folders if in terminal i ls them - they don't exist at all if i try to mount to smb or any container

Edited by mcrommert
Link to post
  • Replies 905
  • Created
  • Last Reply

Top Posters In This Topic

Top Posters In This Topic

Popular Posts

rclone Plugin   Hey everyone   This is a simple plugin which installs rclone on your unraid system. The plugins have now been merged so both the stable and beta branch are

Hey guys Sorry for the lack of updates in a (long) while ? Real life has been taking up a lot of time and my own install of rclone has been sufficient for my needs. However both the stable branch

Someone beat me to it. And probably explained it in a nicer way than i would have Reinstalling the plugin will also result in the newest version being pulled Take a look at the change log

Posted Images

Okay here's where it sits  - in terminal at /mnt/disks/Google everything is mounted correctly and can be seen - when i go to share the folder to a container in edit it shows all the subfolders just like you would expect

In any of the containers or smb share - it sees nothing and has nothing contained in it

I have force unmounted the folders and deleted them before remounting using rclone mount - same issue and it doesn't resolve anything

 

EDIT: My sync script for rclone also continues to run with no issues

Edited by mcrommert
Link to post
1 hour ago, mcrommert said:

Okay here's where it sits  - in terminal at /mnt/disks/Google everything is mounted correctly and can be seen - when i go to share the folder to a container in edit it shows all the subfolders just like you would expect

In any of the containers or smb share - it sees nothing and has nothing contained in it

I have force unmounted the folders and deleted them before remounting using rclone mount - same issue and it doesn't resolve anything

 

EDIT: My sync script for rclone also continues to run with no issues

I have this exact same issue. It started happening yesterday when I switched my unraid install to some new hardware. Everything had been working fine up until this point. I haven't found out much more information than you but we are definitely affected by the same issue

Link to post
On 7/19/2020 at 12:17 PM, spiderben25 said:

Hi,

I'm having the exact same problem. Did you find a solution? Thanks!

 

 

EDIT : seems like it's a permission issue. When I SSH as root I can see all the files mounted but they are owned by root:root. I'll try to edit the mount script accordingly.

 

Hey, sorry I'm seeing this so late - were you able to resolve this?

Link to post

So I have done the full install, and unraid mounts the gdrive, but I can't see anything in it via plex, or anywhere in unraid. UNLESS I use a terminal in which case I can see the files listed there from the unraid instance.  But any docker container cannot see it.  Any help would be greatly appreciated. --Allow-other is in the script (provided from the github), and any areas where my naming scheme is required are there. Let me know if any logs would be helpful.
TIA!

Link to post
On 7/27/2020 at 11:02 AM, rzeeman711 said:

Thanks for sharing this here. Rclone is working for me again. For anyone else that comes here looking for a solution, you just need to reboot unraid and the rclone plugin will be updated with the fix.

it won't show without the reboot?

Link to post
On 7/27/2020 at 11:02 AM, rzeeman711 said:

Thanks for sharing this here. Rclone is working for me again. For anyone else that comes here looking for a solution, you just need to reboot unraid and the rclone plugin will be updated with the fix.

how did you update your plugin? mine still shows 

2019.11.01 for the latest version of the beta plugin.

Link to post
33 minutes ago, Millerboy3 said:

how did you update your plugin? mine still shows 

2019.11.01 for the latest version of the beta plugin.

There is no new version, there was a fix applied to that version. Restarting unraid pulls the fix. If you restarted you should be good.

Link to post
8 minutes ago, rzeeman711 said:

There is no new version, there was a fix applied to that version. Restarting unraid pulls the fix. If you restarted you should be good.

mine still didn't fix anything. plex still can't see anything inside the folder. But I can go into terminal and see everything. despite having --allow-other setup.  also which version of the plugin are you using? as the Waseh version of it isn't fixed for me?

Link to post
12 minutes ago, rzeeman711 said:

There is no new version, there was a fix applied to that version. Restarting unraid pulls the fix. If you restarted you should be good.

 

3 minutes ago, Millerboy3 said:

mine still didn't fix anything. plex still can't see anything inside the folder. But I can go into terminal and see everything. despite having --allow-other setup.  also which version of the plugin are you using? as the Waseh version of it isn't fixed for me?


nvm. I watched the install this time and it looks like its updated. however.... now I'm getting a critical error in my mount script. -_-  attempting to reboot now to see if that takes care of it.

Link to post
1 minute ago, Millerboy3 said:

mine still didn't fix anything. plex still can't see anything inside the folder. But I can go into terminal and see everything. despite having --allow-other setup.  also which version of the plugin are you using? as the Waseh version of it isn't fixed for me?

I am using the same version. 2019.11.01 by waseh. I had the same problem as you and it was fixed upon restart after mcrommert's comment. I'm not sure why your setup is different but keep working at it.

Link to post
1 hour ago, rzeeman711 said:

I am using the same version. 2019.11.01 by waseh. I had the same problem as you and it was fixed upon restart after mcrommert's comment. I'm not sure why your setup is different but keep working at it.

yea I'm still pushing it.  I'll hopefully figure it out soon. this will make my life a heck of a lot easier.

got it working. thanks for the fix. that was a hassle.  I should have left my initial scripts apparently. they worked without a hitch. odd.

Edited by Millerboy3
Link to post
18 hours ago, Millerboy3 said:

mine still didn't fix anything. plex still can't see anything inside the folder. But I can go into terminal and see everything. despite having --allow-other setup.  also which version of the plugin are you using? as the Waseh version of it isn't fixed for me?

I'm having the same issue. I just rebooted and despite seeing my folders in the terminal, can't view them anywhere else (SMB, Krusader, etc.).

 

This is frustrating.

Link to post
  • 2 weeks later...

So I thought I had this running. Turns out it wasn't. So I'm back to square one again, and I have moved and cleared all data in the mount locations and tried to do it again, keep getting "failed drive not empty" etc etc.  So I changed the info, and it worked but didn't mount my gdrive share at all. Sort of lost at this point. Followed the github link to a T as far as I know and just can't figure out what I'm doing wrong here.  Should I just attach my config files (sans the creds portion) and see if someone can look over them? 

Config Files

For whatever reason, this also causes my unraid server to hang on unmounting.

I rebooted the server for the last time to remove some dir's and clear it and try again and it finally worked. No changes made. Mind boggling. -_-

 

Edited by Millerboy3
space
Link to post
So I thought I had this running. Turns out it wasn't. So I'm back to square one again, and I have moved and cleared all data in the mount locations and tried to do it again, keep getting "failed drive not empty" etc etc.  So I changed the info, and it worked but didn't mount my gdrive share at all. Sort of lost at this point. Followed the github link to a T as far as I know and just can't figure out what I'm doing wrong here.  Should I just attach my config files (sans the creds portion) and see if someone can look over them? 

Config Files

For whatever reason, this also causes my unraid server to hang on unmounting.

I rebooted the server for the last time to remove some dir's and clear it and try again and it finally worked. No changes made. Mind boggling.
 
Standard IT...."Did you turn it off and on again?"
Haha
Link to post

I went through following the process the best I can. I'm able to access the file structure. See file names. But I cant open any of them or copy from the GDrive.  Any idea where I went wrong?

Edited by Dexm57
Link to post
1 hour ago, Dexm57 said:

I went through following the process the best I can. I'm able to access the file structure. See file names. But I cant open any of them or copy from the GDrive.  Any idea where I went wrong?

Ya gotta give more info than that for anyone to help you.

 

  1. What process?
  2. How exactly are you trying to copy from Gdrive? What command?

 

Link to post
  • 2 weeks later...

Hi, I recently set up rclone with Google Drive as a backup destination using SpaceInvaderOne's guide. While archiving some files, I noticed that my files were being uploaded at around 20MBps despite having a gigabit FiOS connection. Based on some Googling, I'm thinking increasing my chunk size might improve speeds.

 

But how do I go about increasing the chunk size? I've attached my rclone mount script if that's of any help.

Also, how does this affect the items I have already uploaded (if it affects them at all)?

Link to post
32 minutes ago, rragu said:

Hi, I recently set up rclone with Google Drive as a backup destination using SpaceInvaderOne's guide. While archiving some files, I noticed that my files were being uploaded at around 20MBps despite having a gigabit FiOS connection. Based on some Googling, I'm thinking increasing my chunk size might improve speeds.

 

But how do I go about increasing the chunk size? I've attached my rclone mount script if that's of any help.

Also, how does this affect the items I have already uploaded (if it affects them at all)?

https://rclone.org/commands/rclone_mount/

https://rclone.org/flags/
CTRL+F "chunk"

And FWIW, It is not the best idea to Write to an rclone Google Drive mount. Its just a widely known tip....those rclone mounts are more geared towards reads. The If you want to write something to a Google Drive remote, doing it manually using "rclone copy" command and the flags link I provided has a flag to designate chunk size.

Also, even though you have Gig FIOS connection.....you still may not saturate your connection using rclone/google. That might just be the speed you get with Google. It's different for everyone.

Link to post
10 minutes ago, Stupifier said:

https://rclone.org/commands/rclone_mount/

https://rclone.org/flags/
CTRL+F "chunk"

And FWIW, It is not the best idea to Write to an rclone Google Drive mount. Its just a widely known tip....those rclone mounts are more geared towards reads. The If you want to write something to a Google Drive remote, doing it manually using "rclone copy" command and the flags link I provided has a flag to designate chunk size.

Also, even though you have Gig FIOS connection.....you still may not saturate your connection using rclone/google. That might just be the speed you get with Google. It's different for everyone.

Thanks! I'll look into the resources you posted.

 

As for not writing to the rclone Google Drive mount, (1) it's a slightly more widely known tip now 😅, (2) while I'll switch to using "rclone copy", is there any particular negative effect to transferring data to Google Drive in the way I've been doing (e.g. data loss/corruption) or is it just lower performance?

Link to post

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.