Skip to content
View in the app

A better way to browse. Learn more.

Unraid

A full-screen app on your home screen with push notifications, badges and more.

To install this app on iOS and iPadOS
  1. Tap the Share icon in Safari
  2. Scroll the menu and tap Add to Home Screen.
  3. Tap Add in the top-right corner.
To install this app on Android
  1. Tap the 3-dot menu (⋮) in the top-right corner of the browser.
  2. Tap Add to Home screen or Install app.
  3. Confirm by tapping Install.

Scraping Subreddit via Unraid: Has Anyone Figured Out A Solution?

Featured Replies

About a year ago, I asked a similar question. I ended up figuring out how to grab images only and couldn't get bs4, python dependencies, etc. to load on a reboot. To make a long story short, I did edit the unraid config files with all the steps I took manually to get it up and running; it wouldn't take.

 

Anyways, I have since forgot what I tried to use and even still, it wasn't as thorough as I had hoped for.

 

I would absolutely LOVE if I could scrape:

- Subreddit top 25 HOT posts for the day
- Download Images
- Title of Post
- Link to imgur/album/photo
- Link to reddit post

 

I have minimal programming experience; I've been very slowly but surely learning and then forgetting Autohotkey syntax as I develop a script for my job.

 

I'm expecting "Cron Job" is going to be a popular response, but I really have no idea where to start.

 

Any help is greatly appreciated!

 

TLDR: Running latest ver. of Unraid, what would be the easiest way of automating a web scrape of my favorite subreddits?

 

It will be interesting if you get any help here.  Those of us who use unRaid for outside the box tasks (not movie downloading and playing) are unable to get much help.

 

You might try creating a VM inside unRaid that is more closely set up for this type of task.  Of course if you can find a docker that would be awesome.  But some tools are already built.

 

https://www.reddit.com/r/DataHoarder/comments/6fcin1/scraping_subreddit_text/

 

Archived

This topic is now archived and is closed to further replies.

Account

Navigation

Search

Search

Configure browser push notifications

Chrome (Android)
  1. Tap the lock icon next to the address bar.
  2. Tap Permissions → Notifications.
  3. Adjust your preference.
Chrome (Desktop)
  1. Click the padlock icon in the address bar.
  2. Select Site settings.
  3. Find Notifications and adjust your preference.