[REQUEST] Musicbrainz

[heffe2001]

There's a docker already partially configured for Musicbrainz, but apparently it requires some additional software installed to completely work.  I'm forking this from the other request thread at NAS' request.  My last post about it was:

 

I'm running the vmware vm currently on a windows box, and it appears that I still get 503 errors occasionally, although much less often than with the live server.

 

There IS a musicbrainz docker, but it's kind of a PITA to set up.  I've got the first parts done, just need to get a good, working DBDefs.pm file set up for it.  My current VM is using about 34g of space total (that's everything tho, not sure how much is database, and how much is OS), and it's up to date as of about 2am last night.  It takes FOREVER to update the database from the 05/14 VM release to current, then build the search indicies.  But to me it's well worth it if it keeps me from hitting that spam protection 503 error every half second, lol.

 

 

The docker is located here:  https://registry.hub.docker.com/u/rickatnight11/musicbrainz-server/

 

I'll see if I can get it up and running, if I do, I'll post notes on how to go about it.  It's not going to work with the nice extended dock config, as you have to access the docker container directly to edit files, and start replication, etc.

 

Looks like even with a properly configured DBDefs.pm, the docker (as it's set up anyway) doesn't include postgresql in the install, so there's no database or connection configured.  I'm guessing the original creator of this docker has a postgresql docker set up on his system with the required database already configured in it, and this docker just connects to that instance.  Adding postgressql to the docker is above my pay grade, so hopefully someone else can take what he's started, and create a docker that will run out of the box, with postgresql and all that installed, ready to go.

[heffe2001]

Not sure if this would help (not sure how to go from github to a docker):

 

https://github.com/jsturgis/musicbrainz-docker/commits/master

 

[NAS]

Adding to voting list as I can see a need for this.

[Croaker]

Just wanted to tag on that I've also been trying to get this working to no avail. I voted for it in the poll, for what that's worth. Headphones is virtually useless without this it would seem, the main musicbrainz db is always slow and frequently just fails to respond at all.

[heffe2001]

It's actually not failing, it's blocking your request if it receives too many from your IP at once.  I ended up just running it in a VM on my windows box, although I could convert it over to a KVM vm and run it on the unraid box, just haven't gotten that far after I got it all set up, lol.

 

[smdion]

I'll take a look at this tonight...

[heffe2001]

I see that you have a beta for musicbrainz, haven't looked at it yet, just noticed it on your beta repo.  Had any luck with it yet?  Between that and a Win7 VM, those are the only things I'm still running that way (the win7 VM is only for me to test stuff from an outside-work PC, see how something looks/acts for an 'end user').

 

It'd be nice to get the 60g VM image closed out for musicbrainz and just have the database up and running that can be queried by headphones (a lot of trouble for one docker to access, but sure beats the lookup failures you get otherwise with a large music collection).

 

[smdion]

I see that you have a beta for musicbrainz, haven't looked at it yet, just noticed it on your beta repo.  Had any luck with it yet?  Between that and a Win7 VM, those are the only things I'm still running that way (the win7 VM is only for me to test stuff from an outside-work PC, see how something looks/acts for an 'end user').

 

It'd be nice to get the 60g VM image closed out for musicbrainz and just have the database up and running that can be queried by headphones (a lot of trouble for one docker to access, but sure beats the lookup failures you get otherwise with a large music collection).

 

It's a beast..... not working yet, but haven't given up.

[heffe2001]

Going to take a stab at setting up the other Musicbrainz docker out there, now that we should be able to connect to a running docker environment.  I'll let everybody know how it goes tomorrow hopefully.

 

[sacretagent]

anybody got this working ?

there is a free mirror out there but still a lot of issues connecting to that one too

so running our own server is still better

[aptalca]

Are you guys requesting the musicbrainz server or Picard?

[alexricher]

Are you guys requesting the musicbrainz server or Picard?

 

Server I'm guessing... and I won't lie that I'm also looking forward to this one.

[aptalca]

Setting up the server looks like a PITA

 

On the bright side, they provide a KVM image: http://musicbrainz.org/doc/MusicBrainz_Server/Setup#Running_with_QEMU.2FKVM

 

I think it's easier to just run the VM image they provide

[sparklyballs]

i have the container itself built, just need to initialise the database and work out a start script.

 

[sparklyballs]

just need to initialise the database

 

 

lol, that was rather optimistic, but i've initialised the database, so now to get the webserver going and then the start files

[sparklyballs]

Loaded 179 tables (86330932 rows) in 649 seconds

[sparklyballs]

damn it janet, it's doing some indexing now and i'm in danger of it filling up my 30GB VM

[sacretagent]

Their VMWare image is 40 GB big and they already put a warning there when turning the thing into a development box that it could run out of space

so your 30gb vm might be too small

 

 

[sparklyballs]

Their VMWare image is 40 GB big and they already put a warning there when turning the thing into a development box that it could run out of space

so your 30gb vm might be too small

 

the VM in question is a docker server (what i build new containers on(

 

 

[heffe2001]

Setting up the server looks like a PITA

 

On the bright side, they provide a KVM image: http://musicbrainz.org/doc/MusicBrainz_Server/Setup#Running_with_QEMU.2FKVM

 

I think it's easier to just run the VM image they provide

 

Try using the supplied VM file, and do a full update including artwork.  The small image size they used won't hold the latest database with all data.  I'd definitely rather have a docker of this than the VM I current use (I rolled my own from source, was a pain in the butt, but it's current as of a week ago, and seems to run fine, just uses more resources to run a whole VM rather than as a docker).

 

 

My current data directory is just over 50g, if that helps you out..

 

[sparklyballs]

i'm not giving this any more time, everything i try with this POS is a dead end, lulls you with building succesfully only to not run.

 

it takes over an hour to run each build, just to have the damn thing not work everytime.

 

i even got to the stage where i could import data, only at the end for it to say you need to be superuser to complete this task, so i made the user a superuser and tried again, it then told me you cannot run this task as superuser.

[sparklyballs]

got the interface up on this mother pig finally.

 

they're going to change the schema tomorrow, but this is progress at long last.

 

 

[sparklyballs]

 

 

^^^^ my mirror , up and running.....

 

 

all from the command line at the moment, need to script the bish next...

 

but i'm actually getting this thing really moving now......

[sparklyballs]

 

 

haven't done any api testing yet.....

 

but DAMN IT , i did it, lol.

 

this one was/is the biggest PITA i've tackled so far.

[joe.jenkins]

Are you guys requesting the musicbrainz server or Picard?

i wished we had musicbrainz picard