[Support] Machinaris - Chia cryptocurrency farming + Plotman plotting + Unraid WebUI

[guy.davis]

On 8/25/2023 at 8:33 AM, jhewit485 said:

Can you advise why c3 compressed plots would not be appearing in the count of plots? Generated them using plotman, with bladebit ramplot. Thanks in advance. They are on the hard drive but have c3 in the plots title but seem to be ignored by scraper and also the plot checker.

 

Reading CNI release notes from their betas, it seems they recommend generate a brand-new config.yaml to add all their new settings.  So try this procedure to reset your Chia config.

[jhewit485]

2 hours ago, guy.davis said:

 

Reading CNI release notes from their betas, it seems they recommend generate a brand-new config.yaml to add all their new settings.  So try this procedure to reset your Chia config.

Found the fix to this as doing the above gave an error about parallel_decompressor_count being set to zero. To fix this went to Setting > Farming > Go to Harvester Section and modifying parallel_decompressor_count to 1 or higher. As it tells Chia how many CPU’s to use so it must be set to at least 1. In systems with more than one CPU can be set higher than 1 if the user wants to dedicate more CPU’s to decompression. But for GPU decompression this should always be set to 1

[guy.davis]

Machinaris v2.1.0 now available: https://github.com/guydavis/machinaris/releases/tag/2.1.0

• Bladebit to v3.1.0 - Supporting hybrid GPU/disk plotting with either 128 GB or 16 GB RAM.

• Chia to v2.1.0 - misc improvements, see their release notes.

[mishmash-]

Hello all, I've searched the docs and the config files but cannot find it - how can we remove old forks from the machinaris list? I have an old btcgreen fork in my list I'd like to remove...

 

[guy.davis]

7 minutes ago, mishmash- said:

Hello all, I've searched the docs and the config files but cannot find it - how can we remove old forks from the machinaris list? I have an old btcgreen fork in my list I'd like to remove...

 

 

Good question.  I have now documented the removal of old/stale/unwanted workers.

[mishmash-]

3 hours ago, guy.davis said:

 

Good question.  I have now documented the removal of old/stale/unwanted workers.

Amazing, thanks!

[Shotkar]

Hi,

I'm having trouble with pooling I seem to have two pools in pools and am self pooling in settings|pools and get an error when changing. I have reinstalled Machinaris and also Uninstalled Machinaris and then manually deleted all files I could find. Also have used the command console "chia plotnft leave". But these pools seem to keep showing up with each new install. Is there some file that i am missing to fully reset?

Thanks

[666sniperererer]

Hello, I am a bit hopeless now and really need to ask for help...

 

I got Tesla P4 in my Unraid tower, all settings to Machinaris container seem to be OK (I am able to see the card via "nvidia-smi" inside the container), but it is not being used at all - Machinaris tries to decompress (C7) using only CPU.

 

I run the same absolutely same settings as on my previous server (with the same Tesla P4):

 

harvester:
  chia_ssl_ca:
    crt: config/ssl/ca/chia_ca.crt
    key: config/ssl/ca/chia_ca.key
  decompressor_thread_count: 1
  decompressor_timeout: 20
  disable_cpu_affinity: false
  enforce_gpu_index: false
  farmer_peer:
    host: 127.0.0.1
    port: 8447
  gpu_index: 0
  logging: *id001
  max_compression_level_allowed: 7
  network_overrides: *id002
  num_threads: 30
  parallel_decompressor_count: 1
  parallel_read: true
  plot_directories:
  - /plots1
  - /plots2
  plots_refresh_parameter:
    batch_size: 300
    batch_sleep_milliseconds: 1
    interval_seconds: 120
    retry_invalid_seconds: 1200
  port: 8448
  private_ssl_ca:
    crt: config/ssl/ca/private_ca.crt
    key: config/ssl/ca/private_ca.key
  recursive_plot_scan: false
  rpc_port: 8560
  selected_network: mainnet
  ssl:
    private_crt: config/ssl/harvester/private_harvester.crt
    private_key: config/ssl/harvester/private_harvester.key
  start_rpc_server: true
  use_gpu_harvesting: true
inbound_rate_limit_percent: 100

 

And in log this repeats:

2023-10-28T18:34:37.200 harvester chia.harvester.harvester: WARNING No decompressor available. Cancelling qualities retrieving for /plots2/plot-k32-c07-2023-10-14-00-57-ef88c41d8f61deda9d44059d58a4085a764392813d497cc24dd4f65f797470f5.plot

 

EDIT: just tried another container to use GPU - no issue there, Plex was able to use the GPU,

 

I will be very grateful for advice, thanks in advance!

Edited October 30, 2023 by 666sniperererer

[guy.davis]

On 10/20/2023 at 8:06 PM, Shotkar said:

Hi,

I'm having trouble with pooling I seem to have two pools in pools and am self pooling in settings|pools and get an error when changing. I have reinstalled Machinaris and also Uninstalled Machinaris and then manually deleted all files I could find. Also have used the command console "chia plotnft leave". But these pools seem to keep showing up with each new install. Is there some file that i am missing to fully reset?

Thanks

 

Yes, there is an unfortunate regression in the Chia command-line binaries that breaks automation.  CNI ("Chia Network Inc." may fix it one day).   Workaround is to issue the `chia plotnft ... ` commands from within the container's shell. 

[guy.davis]

On 10/28/2023 at 10:32 AM, 666sniperererer said:

Hello, I am a bit hopeless now and really need to ask for help...

 

I got Tesla P4 in my Unraid tower, all settings to Machinaris container seem to be OK (I am able to see the card via "nvidia-smi" inside the container), but it is not being used at all - Machinaris tries to decompress (C7) using only CPU.

 

I run the same absolutely same settings as on my previous server (with the same Tesla P4):

 

harvester:
  chia_ssl_ca:
    crt: config/ssl/ca/chia_ca.crt
    key: config/ssl/ca/chia_ca.key
  decompressor_thread_count: 1
  decompressor_timeout: 20
  disable_cpu_affinity: false
  enforce_gpu_index: false
  farmer_peer:
    host: 127.0.0.1
    port: 8447
  gpu_index: 0
  logging: *id001
  max_compression_level_allowed: 7
  network_overrides: *id002
  num_threads: 30
  parallel_decompressor_count: 1
  parallel_read: true
  plot_directories:
  - /plots1
  - /plots2
  plots_refresh_parameter:
    batch_size: 300
    batch_sleep_milliseconds: 1
    interval_seconds: 120
    retry_invalid_seconds: 1200
  port: 8448
  private_ssl_ca:
    crt: config/ssl/ca/private_ca.crt
    key: config/ssl/ca/private_ca.key
  recursive_plot_scan: false
  rpc_port: 8560
  selected_network: mainnet
  ssl:
    private_crt: config/ssl/harvester/private_harvester.crt
    private_key: config/ssl/harvester/private_harvester.key
  start_rpc_server: true
  use_gpu_harvesting: true
inbound_rate_limit_percent: 100

 

And in log this repeats:

2023-10-28T18:34:37.200 harvester chia.harvester.harvester: WARNING No decompressor available. Cancelling qualities retrieving for /plots2/plot-k32-c07-2023-10-14-00-57-ef88c41d8f61deda9d44059d58a4085a764392813d497cc24dd4f65f797470f5.plot

 

I will be very grateful for advice, thanks in advance!

 

All I can suggest is a reset of the Chial blockchain config to get back to a default state.  This assumes you have already installed the Nvidia plugin for Unraid.

Edited November 2, 2023 by guy.davis

[666sniperererer]

On 10/31/2023 at 3:02 PM, guy.davis said:

 

All I can suggest is a reset of the Chial blockchain config to get back to a default state.

 

Thank You for response, however now I tried everything - even completely removing (appdata included) Machinaris, reinstall, etc.

 

The Tesla P4 simply refuses to be utilised only by Machinaris container, I am out of ideas.

 

Thanks anyway, the app is great otherwise 

[gerard4]

Im trying to join space pool but i get this error:

Timeout exceeded. command: /usr/bin/chia args: ['/usr/bin/chia', 'plotnft', 'create', '-y', '-u', 'https://eu1.pool.space', '-s', 'pool', '--fee', '0.000000000001'] buffer (last 100 chars): b'--------------------\r\nWill create a plot NFT and join pool: https://eu1.pool.space.\r\nConfirm [n]/y: ' before (last 100 chars): b'--------------------\r\nWill create a plot NFT and join pool: https://eu1.pool.space.\r\nConfirm [n]/y: ' after: match: None match_index: None exitstatus: None flag_eof: False pid: 32051 child_fd: 108 closed: False timeout: 30 delimiter: logfile: <_io.BufferedWriter name=''> logfile_read: None logfile_send: None maxread: 2000 ignorecase: False searchwindowsize: None delaybeforesend: 0.05 delayafterclose: 0.1 delayafterterminate: 0.1 searcher: searcher_re: 0: re.compile(b'Wallet keys:.*\r\n') 1: EOF

[radiumx3]

On 11/8/2023 at 6:24 PM, gerard4 said:

Im trying to join space pool but i get this error:

Timeout exceeded. command: /usr/bin/chia args: ['/usr/bin/chia', 'plotnft', 'create', '-y', '-u', 'https://eu1.pool.space', '-s', 'pool', '--fee', '0.000000000001'] buffer (last 100 chars): b'--------------------\r\nWill create a plot NFT and join pool: https://eu1.pool.space.\r\nConfirm [n]/y: ' before (last 100 chars): b'--------------------\r\nWill create a plot NFT and join pool: https://eu1.pool.space.\r\nConfirm [n]/y: ' after: match: None match_index: None exitstatus: None flag_eof: False pid: 32051 child_fd: 108 closed: False timeout: 30 delimiter: logfile: <_io.BufferedWriter name=''> logfile_read: None logfile_send: None maxread: 2000 ignorecase: False searchwindowsize: None delaybeforesend: 0.05 delayafterclose: 0.1 delayafterterminate: 0.1 searcher: searcher_re: 0: re.compile(b'Wallet keys:.*\r\n') 1: EOF

 

Same Error while trying to switch from flexpool to spacepool

[ftrees]

I just updated to new version and have ~50% of partials reporting stale and SpacePool is showing estimated size around 15% of my actual space.  Never had an issue previously, haven't changed anything else (no compressed plots etc).  Any idea on what I should check?  Client showing all plots and lookup times around 1 second in log.

 

on 11/11 for 6 hours it shows 34,000 valid partials, 0 stale.  In the last 6 hours I show 3,400 valid 4,400 stale.  

 

UPDATE - Overnight everything went back to normal on its own?!

Edited November 15, 2023 by ftrees
UPDATE

[radiumx3]

On 11/8/2023 at 6:24 PM, gerard4 said:

Im trying to join space pool but i get this error:

Timeout exceeded. command: /usr/bin/chia args: ['/usr/bin/chia', 'plotnft', 'create', '-y', '-u', 'https://eu1.pool.space', '-s', 'pool', '--fee', '0.000000000001'] buffer (last 100 chars): b'--------------------\r\nWill create a plot NFT and join pool: https://eu1.pool.space.\r\nConfirm [n]/y: ' before (last 100 chars): b'--------------------\r\nWill create a plot NFT and join pool: https://eu1.pool.space.\r\nConfirm [n]/y: ' after: match: None match_index: None exitstatus: None flag_eof: False pid: 32051 child_fd: 108 closed: False timeout: 30 delimiter: logfile: <_io.BufferedWriter name=''> logfile_read: None logfile_send: None maxread: 2000 ignorecase: False searchwindowsize: None delaybeforesend: 0.05 delayafterclose: 0.1 delayafterterminate: 0.1 searcher: searcher_re: 0: re.compile(b'Wallet keys:.*\r\n') 1: EOF

 

@gerard4 did you found out the issue ? Can't figure out what is wrong..

[guy.davis]

On 11/20/2023 at 5:32 AM, radiumx3 said:

 

@gerard4 did you found out the issue ? Can't figure out what is wrong..

 

Due to a regression in the Chia binaries provided by CNI, they no longer honor the "-y" flag allowing the commandline to be run by the WebUI. You'll need to run the "chia plotnft create" command (see log for exact parameters) yourself within the shell of the container as you will be prompted for a manual confirmation.  Sorry for the trouble this defect from the CNI group has caused.

[DoeBoye]

I'm having problems deleting a cold wallet address I mistakenly added to the Chinilla fork. On the wallet page, I open the edit wallet option, delete the key for the cold wallet, save and close. When I reopen the edit option, the wallet key is still there.

 

Am I doing something wrong, or is this a bug? Is there somewhere I can manually remove it?

[guy.davis]

On 11/23/2023 at 9:44 AM, DoeBoye said:

I'm having problems deleting a cold wallet address I mistakenly added to the Chinilla fork. On the wallet page, I open the edit wallet option, delete the key for the cold wallet, save and close. When I reopen the edit option, the wallet key is still there.

 

Am I doing something wrong, or is this a bug? Is there somewhere I can manually remove it?

 

Go into the shell of the `machinaris` Chia fullnode container and delete file:
 

/root/.chia/machinaris/config/cold_wallet_addresses.json

 

Then add your address back, just for the Chia row, using the Machinaris WebUI's wallets page.

[DoeBoye]

2 hours ago, guy.davis said:

 

Go into the shell of the `machinaris` Chia fullnode container and delete file:
 

/root/.chia/machinaris/config/cold_wallet_addresses.json

 

Then add your address back, just for the Chia row, using the Machinaris WebUI's wallets page.

That did the trick! Thank you sir!!

[guy.davis]

Version 2.1.2 now available.

### Added

- Settings | Plotting | Bladebit now supports "no_direct_io: true" option

- Settings | Plotting | Bladebit now supports "check_plots: 100" option to check at end of plot creation

- Settings | Plotting | Bladebit now supports "check_threshold: 0.6" option to delete invalid plots at end of plot creation

### Changed

- Support for Gigahorse Recompute Server (single GPU on fullnode/farmer), shared by multiple Gigahorse harvesters.

### Updated

- Chia to v2.1.2 - misc improvements, see their release notes.

- Gigahorse to v2.1.1.giga25 with C20 compression support.

- Flask to v3.0.0 - serves up the Machinaris WebUI.

### Notes

- Regression in Chia binaries (since v2.0.0) ignoring the "-y" parameter on plotnft changes, has broken pool join/leave thru WebUI.

[guy.davis]

Version 2.1.3 now available that addresses the unfortunate bug CNI released in v2.1.2.  Details at: https://github.com/guydavis/machinaris/releases/tag/2.1.3

[Einsteinjr]

FYI - for a while now, I've been getting much higher skipped SPs than normal (>20%). Did a bit of research and debugging the logs and found that modifying [machinaris.Config]/mainnet/config/config.yaml file fixed the issue.

 

target_peer_count needs to be changed from 80 to 20 and the errors I was seeing seemed to have disappeared and the skipped rates is <1%.

[guy.davis]

On 1/8/2024 at 11:34 AM, Einsteinjr said:

FYI - for a while now, I've been getting much higher skipped SPs than normal (>20%). Did a bit of research and debugging the logs and found that modifying [machinaris.Config]/mainnet/config/config.yaml file fixed the issue.

 

target_peer_count needs to be changed from 80 to 20 and the errors I was seeing seemed to have disappeared and the skipped rates is <1%.

Good point.  Yes, I run at 10 to minimize memory usage for synced blockchains.  Details on the wiki.

[guy.davis]

Machinaris version 2.1.4 is now available.  
 

Added

- Optionally launch `chia-exporter` [metrics endpoint](https://github.com/Chia-Network/chia-exporter) for Prometheus reporting if env var `chia_exporter=true` is set.

- Support for running Gigahorse containers on arm64 architectures such as Raspberry Pi.

- Main dashboard page can now be pinned (Pin Icon) to display only a blockchain of interest, rather than rotating through each in turn.

Changed

- Optionally launch of Gigahorse recompute server when in harvester mode if env var `gigahorse_recompute_server=true` is set.

- Fix for Bladebit GPU plotting jobs taking a minute to display on Plotting page on job start. Should now be seconds only.
Updated

- [Chia](https://github.com/Chia-Network/chia-blockchain/releases/tag/2.1.4) to v2.1.4 - misc improvements, see their release notes.

- [Gigahorse](https://github.com/madMAx43v3r/chia-gigahorse/releases/tag/v2.1.3.giga26) to v2.1.3.giga26.

[guy.davis]

Machinaris v2.2.0 is now available:

Added

- Support for Achi blockchain. Requires its own plots (like Chives), you'll have to plot separately if interested. Thanks @priyankub

- Optionally launch Chia Data Layer services if env var `chia_data=true` is set.

Changed

- Harvester mode will now optionally also run chia-exporter for Prometheus results.

Updated

- Chia to v2.2.0 - misc improvements, see their release notes.

- Cactus to v2.1.4.

- Gigahorse to v2.1.4.giga26.

- Wheat to v2.1.6

Notes

- Support for new blockchains and tools DOES NOT imply my endorsement for them. Only run those you are comfortable with.

UPDATE: CNI corporate retracted their v2.2.0 release due to nasty bugs in their database code.  As such, I had to pull Machinaris v2.2.0 until they get their issues sorted out.

Edited March 4 by guy.davis