[DOCKER] MusicBrainz Server


Recommended Posts

had to revert back to a commit from august of this year (the last schema change commit) to get this working again.

 

So that seems to be working but the download is still failing. I have manually downloaded the files. Is there any way for me to keep the docker from overwriting the info in the data file? Alternatively, can I do a manual extraction to overwrite the files? I can't figure out the directory structure to do it thus far...

Link to comment
  • Replies 118
  • Created
  • Last Reply

Top Posters In This Topic

  • 3 weeks later...

I just did a delete and reinstall and seems that I'm getting the same issue as prior.  Am I doing something wrong?

 

Caught exception in MusicBrainz::Server::Controller::Root->begin "08006 DBI connect('dbname=musicbrainz_db','musicbrainz',...) failed: could not connect to server: No such file or directory
Is the server running locally and accepting
connections on Unix domain socket "/var/run/postgresql/.s.PGSQL.5432"? at lib/MusicBrainz/Server/Connector.pm line 42.
at lib/Sql.pm line 465.
Sql::catch {...} ('08006 DBI connect(\'dbname=musicbrainz_db\',\'musicbrainz\',....') called at /usr/local/share/perl/5.18.2/Try/Tiny.pm line 104
Try::Tiny::try('CODE(0x133aaf70)', 'Try::Tiny::Catch=REF(0x1337e610)', 'Try::Tiny::Finally=REF(0x804210)') called at lib/Sql.pm line 469
Sql::_select_list('Sql=HASH(0x133abe98)', 'SELECT last_replication_date FROM replication_control', 'ARRAY(0x6562f20)', 'arrayref', 'CODE(0x6562fb0)') called at lib/Sql.pm line 488
Sql::select_list_of_lists('Sql=HASH(0x133abe98)', 'SELECT last_replication_date FROM replication_control') called at lib/Sql.pm line 419
Sql::select_single_column_array('Sql=HASH(0x133abe98)', 'SELECT last_replication_date FROM replication_control') called at lib/Sql.pm line 434
Sql::select_single_value('Sql=HASH(0x133abe98)', 'SELECT last_replication_date FROM replication_control') called at lib/MusicBrainz/Server/Data/Replication.pm line 13
MusicBrainz::Server::Data::Replication::last_replication_date('MusicBrainz::Server::Data::Replication=HASH(0x101873e8)') called at lib/Plack/Middleware/Debug/DAOLogger.pm line 73
Class::MOP::Class:::around('CODE(0x10188ec8)', 'MusicBrainz::Server::Data::Replication=HASH(0x101873e8)') called at /usr/local/lib/perl/5.18.2/Class/MOP/Method/Wrapped.pm line 164
Class::MOP::Method::Wrapped::__ANON__('MusicBrainz::Server::Data::Replication=HASH(0x101873e8)') called at lib/Plack/Middleware/Debug/ExclusiveTime.pm line 41
Class::MOP::Class:::around('CODE(0x12353b10)', 'MusicBrainz::Server::Data::Replication=HASH(0x101873e8)') called at /usr/local/lib/perl/5.18.2/Class/MOP/Method/Wrapped.pm line 164
MusicBrainz::Server::Data::Replication::_wrapped_last_replication_date('MusicBrainz::Server::Data::Replication=HASH(0x101873e8)') called at /usr/local/lib/perl/5.18.2/Class/MOP/Method/Wrapped.pm line 95
MusicBrainz::Server::Data::Replication::last_replication_date('MusicBrainz::Server::Data::Replication=HASH(0x101873e8)') called at lib/MusicBrainz/Server/Controller/Root.pm line 310
MusicBrainz::Server::Controller::Root::begin('MusicBrainz::Server::Controller::Root=HASH(0x10c21158)', 'MusicBrainz::Server=HASH(0x10141ec0)') called at /usr/local/share/perl/5.18.2/Catalyst/Action.pm line 352
Catalyst::Action::execute('Catalyst::Action=HASH(0x1105a5c8)', 'MusicBrainz::Server::Controller::Root=HASH(0x10c21158)', 'MusicBrainz::Server=HASH(0x10141ec0)') called at /usr/local/share/perl/5.18.2/Catalyst.pm line 2027
eval {...} called at /usr/local/share/perl/5.18.2/Catalyst.pm line 2027
Catalyst::execute('MusicBrainz::Server=HASH(0x10141ec0)', 'MusicBrainz::Server::Controller::Root', 'Catalyst::Action=HASH(0x1105a5c8)') called at /usr/local/share/perl/5.18.2/Catalyst/Plugin/StackTrace.pm line 93
Catalyst::Plugin::StackTrace::execute('MusicBrainz::Server=HASH(0x10141ec0)', 'MusicBrainz::Server::Controller::Root', 'Catalyst::Action=HASH(0x1105a5c8)') called at /usr/local/share/perl/5.18.2/Catalyst/Action.pm line 347
Catalyst::Action::dispatch('Catalyst::Action=HASH(0x1105a5c8)', 'MusicBrainz::Server=HASH(0x10141ec0)') called at /usr/local/share/perl/5.18.2/Catalyst/Controller.pm line 145
Catalyst::Controller::_BEGIN('MusicBrainz::Server::Controller::Root=HASH(0x10c21158)', 'MusicBrainz::Server=HASH(0x10141ec0)') called at /usr/local/share/perl/5.18.2/Catalyst/Action.pm line 352
Catalyst::Action::execute('Catalyst::Action=HASH(0x11054350)', 'MusicBrainz::Server::Controller::Root=HASH(0x10c21158)', 'MusicBrainz::Server=HASH(0x10141ec0)') called at /usr/local/share/perl/5.18.2/Catalyst.pm line 2027
eval {...} called at /usr/local/share/perl/5.18.2/Catalyst.pm line 2027
Catalyst::execute('MusicBrainz::Server=HASH(0x10141ec0)', 'MusicBrainz::Server::Controller::Root', 'Catalyst::Action=HASH(0x11054350)') called at /usr/local/share/perl/5.18.2/Catalyst/Plugin/StackTrace.pm line 93
Catalyst::Plugin::StackTrace::execute('MusicBrainz::Server=HASH(0x10141ec0)', 'MusicBrainz::Server::Controller::Root', 'Catalyst::Action=HASH(0x11054350)') called at /usr/local/share/perl/5.18.2/Catalyst/Action.pm line 347
Catalyst::Action::dispatch('Catalyst::Action=HASH(0x11054350)', 'MusicBrainz::Server=HASH(0x10141ec0)') called at /usr/local/share/perl/5.18.2/Catalyst/Dispatcher.pm line 262
Catalyst::Dispatcher::_do_forward('Catalyst::Dispatcher=HASH(0x3f74020)', 'forward', 'MusicBrainz::Server=HASH(0x10141ec0)', '_BEGIN') called at /usr/local/share/perl/5.18.2/Catalyst/Dispatcher.pm line 242
Catalyst::Dispatcher::forward('Catalyst::Dispatcher=HASH(0x3f74020)', 'MusicBrainz::Server=HASH(0x10141ec0)', '_BEGIN') called at /usr/local/share/perl/5.18.2/Catalyst.pm line 457
Catalyst::forward('MusicBrainz::Server=HASH(0x10141ec0)', '_BEGIN') called at /usr/local/share/perl/5.18.2/Catalyst/Controller.pm line 135
Catalyst::Controller::_DISPATCH('MusicBrainz::Server::Controller::Root=HASH(0x10c21158)', 'MusicBrainz::Server=HASH(0x10141ec0)') called at /usr/local/share/perl/5.18.2/Catalyst/Action.pm line 352
Catalyst::Action::execute('Catalyst::Action=HASH(0x11054230)', 'MusicBrainz::Server::Controller::Root=HASH(0x10c21158)', 'MusicBrainz::Server=HASH(0x10141ec0)') called at /usr/local/share/perl/5.18.2/Catalyst.pm line 2027
eval {...} called at /usr/local/share/perl/5.18.2/Catalyst.pm line 2027
Catalyst::execute('MusicBrainz::Server=HASH(0x10141ec0)', 'MusicBrainz::Server::Controller::Root', 'Catalyst::Action=HASH(0x11054230)') called at /usr/local/share/perl/5.18.2/Catalyst/Plugin/StackTrace.pm line 93
Catalyst::Plugin::StackTrace::execute('MusicBrainz::Server=HASH(0x10141ec0)', 'MusicBrainz::Server::Controller::Root', 'Catalyst::Action=HASH(0x11054230)') called at /usr/local/share/perl/5.18.2/Catalyst/Action.pm line 347
Catalyst::Action::dispatch('Catalyst::Action=HASH(0x11054230)', 'MusicBrainz::Server=HASH(0x10141ec0)') called at /usr/local/share/perl/5.18.2/Catalyst/Dispatcher.pm line 262
Catalyst::Dispatcher::_do_forward('Catalyst::Dispatcher=HASH(0x3f74020)', 'forward', 'MusicBrainz::Server=HASH(0x10141ec0)', '//_DISPATCH') called at /usr/local/share/perl/5.18.2/Catalyst/Dispatcher.pm line 242
Catalyst::Dispatcher::forward('Catalyst::Dispatcher=HASH(0x3f74020)', 'MusicBrainz::Server=HASH(0x10141ec0)', '//_DISPATCH') called at /usr/local/share/perl/5.18.2/Catalyst.pm line 457
Catalyst::forward('MusicBrainz::Server=HASH(0x10141ec0)', '//_DISPATCH') called at /usr/local/share/perl/5.18.2/Catalyst/Dispatcher.pm line 107
Catalyst::Dispatcher::dispatch('Catalyst::Dispatcher=HASH(0x3f74020)', 'MusicBrainz::Server=HASH(0x10141ec0)') called at /usr/local/share/perl/5.18.2/Catalyst.pm line 1973
Catalyst::dispatch('MusicBrainz::Server=HASH(0x10141ec0)') called at lib/MusicBrainz/Server.pm line 333
MusicBrainz::Server::__ANON__() called at lib/MusicBrainz/Server.pm line 307
MusicBrainz::Server::with_translations('MusicBrainz::Server=HASH(0x10141ec0)', 'CODE(0x115a1f00)') called at lib/MusicBrainz/Server.pm line 334
Class::MOP::Class:::around('CODE(0x34b8768)', 'MusicBrainz::Server=HASH(0x10141ec0)') called at /usr/local/lib/perl/5.18.2/Class/MOP/Method/Wrapped.pm line 164
Class::MOP::Method::Wrapped::__ANON__('MusicBrainz::Server=HASH(0x10141ec0)') called at lib/MusicBrainz/Server.pm line 348
Class::MOP::Class:::around('CODE(0x10bee968)', 'MusicBrainz::Server=HASH(0x10141ec0)') called at /usr/local/lib/perl/5.18.2/Class/MOP/Method/Wrapped.pm line 164
Class::MOP::Method::Wrapped::__ANON__('MusicBrainz::Server=HASH(0x10141ec0)') called at lib/MusicBrainz/Server.pm line 387
Class::MOP::Class:::around('CODE(0x111b2ce8)', 'MusicBrainz::Server=HASH(0x10141ec0)') called at /usr/local/lib/perl/5.18.2/Class/MOP/Method/Wrapped.pm line 164
Class::MOP::Method::Wrapped::__ANON__('MusicBrainz::Server=HASH(0x10141ec0)') called at /usr/local/lib/perl/5.18.2/Class/MOP/Method/Wrapped.pm line 29
MusicBrainz::Server::_wrapped_dispatch('MusicBrainz::Server=HASH(0x10141ec0)') called at /usr/local/lib/perl/5.18.2/Class/MOP/Method/Wrapped.pm line 95
MusicBrainz::Server::dispatch('MusicBrainz::Server=HASH(0x10141ec0)') called at /usr/local/share/perl/5.18.2/Catalyst.pm line 2364
Catalyst::try {...} () called at /usr/local/share/perl/5.18.2/Try/Tiny.pm line 81
eval {...} called at /usr/local/share/perl/5.18.2/Try/Tiny.pm line 72
Try::Tiny::try('CODE(0x10ad71a0)', 'Try::Tiny::Catch=REF(0x1136fca8)') called at /usr/local/share/perl/5.18.2/Catalyst.pm line 2373
Catalyst::handle_request('MusicBrainz::Server', 'env', 'HASH(0xe1d6118)', 'response_cb', 'CODE(0x10ad7170)') called at /usr/local/share/perl/5.18.2/Catalyst/Engine.pm line 796
Catalyst::Engine::__ANON__('CODE(0x10ad7170)') called at /usr/local/share/perl/5.18.2/Plack/Middleware/HTTPExceptions.pm line 32
Plack::Middleware::HTTPExceptions::try {...} () called at /usr/local/share/perl/5.18.2/Try/Tiny.pm line 81
eval {...} called at /usr/local/share/perl/5.18.2/Try/Tiny.pm line 72
Try::Tiny::try('CODE(0x1136d530)', 'Try::Tiny::Catch=REF(0x1120b008)') called at /usr/local/share/perl/5.18.2/Plack/Middleware/HTTPExceptions.pm line 41
Plack::Middleware::HTTPExceptions::__ANON__('CODE(0x10ad70f8)') called at /usr/local/share/perl/5.18.2/Plack/Util.pm line 339
Plack::Util::__ANON__('CODE(0x1135ca70)') called at /usr/local/share/perl/5.18.2/Plack/Util.pm line 339
Plack::Util::__ANON__('CODE(0x112a6f70)') called at /usr/local/share/perl/5.18.2/Plack/Util.pm line 339
Plack::Util::__ANON__('CODE(0x11291d40)') called at /usr/local/share/perl/5.18.2/Plack/Util.pm line 339
Plack::Util::__ANON__('CODE(0x10cea3b8)') called at /usr/local/share/perl/5.18.2/Plack/Util.pm line 339
Plack::Util::__ANON__('CODE(0x1137dc18)') called at /usr/local/share/perl/5.18.2/Plack/Util.pm line 339
Plack::Util::__ANON__('CODE(0x10ad6b28)') called at /usr/local/share/perl/5.18.2/Plack/Util.pm line 339
Plack::Util::__ANON__('CODE(0x11380a58)') called at /usr/local/share/perl/5.18.2/Plack/Util.pm line 339
Plack::Util::__ANON__('CODE(0x113788c0)') called at /usr/local/share/perl/5.18.2/Plack/Util.pm line 339
Plack::Util::__ANON__('CODE(0x11367ac0)') called at /usr/local/share/perl/5.18.2/Plack/Util.pm line 339
Plack::Util::__ANON__('CODE(0x112aa970)') called at /usr/local/share/perl/5.18.2/Plack/Util.pm line 339
Plack::Util::__ANON__('CODE(0x112a3b10)') called at /usr/local/share/perl/5.18.2/Plack/Util.pm line 339
Plack::Util::__ANON__('CODE(0x126fe780)') called at /usr/local/share/perl/5.18.2/Plack/Util.pm line 339
Plack::Util::__ANON__('CODE(0x365c838)') called at /usr/local/share/perl/5.18.2/Plack/Util.pm line 339
Plack::Util::__ANON__('CODE(0xeb59600)') called at /usr/local/share/perl/5.18.2/HTTP/Server/PSGI.pm line 181
HTTP::Server::PSGI::handle_connection('HTTP::Server::PSGI=HASH(0x12917a68)', 'HASH(0xe1d6118)', 'IO::Socket::INET=GLOB(0x31c9350)', 'CODE(0x12917ba0)') called at /usr/local/share/perl/5.18.2/HTTP/Server/PSGI.pm line 129
HTTP::Server::PSGI::accept_loop('HTTP::Server::PSGI=HASH(0x12917a68)', 'CODE(0x365c6d0)') called at /usr/local/share/perl/5.18.2/HTTP/Server/PSGI.pm line 55
HTTP::Server::PSGI::run('HTTP::Server::PSGI=HASH(0x12917a68)', 'CODE(0x365c6d0)') called at /usr/local/share/perl/5.18.2/Plack/Handler/HTTP/Server/PSGI.pm line 14
Plack::Handler::HTTP::Server::PSGI::run('Plack::Handler::Standalone=HASH(0x9641f0)', 'CODE(0x365c6d0)') called at /usr/local/share/perl/5.18.2/Plack/Loader/Restarter.pm line 31
Plack::Loader::Restarter::_fork_and_start('Plack::Loader::Restarter=HASH(0x7f4540)', 'Plack::Handler::Standalone=HASH(0x9641f0)') called at /usr/local/share/perl/5.18.2/Plack/Loader/Restarter.pm line 61
Plack::Loader::Restarter::run('Plack::Loader::Restarter=HASH(0x7f4540)', 'Plack::Handler::Standalone=HASH(0x9641f0)') called at /usr/local/share/perl/5.18.2/Plack/Runner.pm line 277
Plack::Runner::run('Plack::Runner=HASH(0x622a60)') called at /usr/local/bin/plackup line 10"

Link to comment

i just blitzed my local container and am reinstalling.

 

-rw-r--r-- 1 nobody users  18M Dec 22 18:12 mbdump-cover-art-archive.tar.bz2
-rw-r--r-- 1 nobody users 116M Dec 22 18:12 mbdump-derived.tar.bz2
-rw-r--r-- 1 nobody users  61M Dec 22 18:12 mbdump-editor.tar.bz2
-rw-r--r-- 1 nobody users  39M Dec 22 18:17 mbdump-sitemaps.tar.bz2
-rw-r--r-- 1 nobody users  26M Dec 22 18:12 mbdump-stats.tar.bz2
-rw-r--r-- 1 nobody users 7.0K Dec 22 18:12 mbdump-wikidocs.tar.bz2
-rw-r--r-- 1 nobody users 2.0G Dec 22 18:17 mbdump.tar.bz2

 

datadump file times... and it's a little shy of 18:20 here in the uk.

Link to comment

I get a similar situation, fresh install last night, let it run over night before checking any logs and the total file size is just over 2Gb

 

I'll upload the logs and error messages in detail this evening.

 

are you mapping the /data volume to a large enough drive ?

Yes, mapped to a 256gb ssd that I mapped my other dockers to which detect the full 235gb after format.

Link to comment

I'm getting the full MusicBrainz webgui (yay!) but not sure what changed.  Did another reinstall and nothing else.

 

I'm currently sitting around 2.4GB...not sure if its growing or how to check if things are processing.

 

I'll monitor directory size over the day and report back.

Link to comment

So this is what I get in the logs right from when the first import was happening.

 

The lines at the end (copied below) were repeating every hour.

 

Dec 22 00:00:01 9bc372c1b5a3 /USR/SBIN/CRON[1195]: (root) CMD (/bin/bash /root/update-script.sh)

Dec 22 00:00:02 9bc372c1b5a3 /USR/SBIN/CRON[1194]: (CRON) info (No MTA installed, discarding output)

 

The files belonging to this database system will be owned by user "postgres".
This user must also own the server process.

The database cluster will be initialized with locale "en_US.UTF-8".
The default database encoding has accordingly been set to "UTF8".
The default text search configuration will be set to "english".

Data page checksums are disabled.

fixing permissions on existing directory /data/main ... 2015-12-21 23:15:36,131 CRIT Supervisor running as root (no user in config file)
2015-12-21 23:15:36,133 INFO supervisord started with pid 39
2015-12-21 23:15:37,136 INFO spawned: 'redis-server' with pid 43
2015-12-21 23:15:37,137 INFO spawned: 'postgres' with pid 44
2015-12-21 23:15:37,149 INFO exited: postgres (exit status 2; not expected)
2015-12-21 23:15:38,153 INFO success: redis-server entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
2015-12-21 23:15:38,154 INFO spawned: 'postgres' with pid 47
2015-12-21 23:15:38,165 INFO exited: postgres (exit status 2; not expected)
2015-12-21 23:15:40,169 INFO spawned: 'postgres' with pid 48
2015-12-21 23:15:40,179 INFO exited: postgres (exit status 2; not expected)
2015-12-21 23:15:43,184 INFO spawned: 'postgres' with pid 49
2015-12-21 23:15:43,195 INFO exited: postgres (exit status 2; not expected)
2015-12-21 23:15:44,196 INFO gave up: postgres entered FATAL state, too many start retries too quickly
BEGINNING INITIAL DATABASE IMPORT ROUTINE, THIS COULD TAKE SEVERAL HOURS AND THE DOCKER MAY LOOK UNRESPONSIVE
DO NOT STOP DOCKER UNTIL IT IS COMPLETED
/data/import /
mbdump-cdstubs.tar.bz2: OK
mbdump-cover-art-archive.tar.bz2: OK
mbdump-derived.tar.bz2: OK
mbdump-documentation.tar.bz2: FAILED open or read
mbdump-edit.tar.bz2: FAILED open or read
mbdump-editor.tar.bz2: OK
mbdump-sitemaps.tar.bz2: FAILED open or read
mbdump-stats.tar.bz2: OK
mbdump-wikidocs.tar.bz2: OK
mbdump.tar.bz2: OK
IMPORT IS COMPLETE, MOVING TO NEXT PHASE
Dec 21 23:22:17 9bc372c1b5a3 syslog-ng[77]: syslog-ng starting up; version='3.5.3'
Dec 21 23:59:01 9bc372c1b5a3 /USR/SBIN/CRON[1158]: (root) CMD (/bin/bash /root/update-script.sh)
Dec 21 23:59:02 9bc372c1b5a3 /USR/SBIN/CRON[1157]: (CRON) info (No MTA installed, discarding output)
Dec 22 00:00:01 9bc372c1b5a3 /USR/SBIN/CRON[1195]: (root) CMD (/bin/bash /root/update-script.sh)
Dec 22 00:00:02 9bc372c1b5a3 /USR/SBIN/CRON[1194]: (CRON) info (No MTA installed, discarding output)

Link to comment

Of course not, I use the same directories but delete all contents.

 

After I pull the data for the docker, the docker itself is stopped with the below in the logs with the docker stopped.

 

 

-----------------------------------
_ _ _
| |___| (_) ___
| / __| | |/ _ \ 
| \__ \ | | (_) |
|_|___/ |_|\___/
|_|

Brought to you by linuxserver.io
-----------------------------------
GID/UID
-----------------------------------
User uid: 99
User gid: 100
-----------------------------------

We are now refreshing packages from apt repositorys, this *may* take a while
(Reading database ... 27044 files and directories currently installed.)
Preparing to unpack .../git-core_1%3a1.9.1-1ubuntu0.2_all.deb ...
Unpacking git-core (1:1.9.1-1ubuntu0.2) over (1:1.9.1-1ubuntu0.1) ...
Setting up git-core (1:1.9.1-1ubuntu0.2) ...
initialising empty databases

Link to comment

that's not stopped, it's initialising the database..

Even with the docker itself giving the option to start?

 

Just want to make sure things are in motion.

 

if the start docker button is showing then something is amiss.

 

can you paste your volume mappings etc.. black out any musicbrainz code etc...

Link to comment
Guest
This topic is now closed to further replies.