[Support] uberchuckie - observium


Recommended Posts

After updating to the latest docker I am getting nearly the same message loop as @kimocal. I don't believe this is due to database corruption, because when I revert to docker image 2.0.2 everything works. Any other ideas how to resolve? I have looked at the observium.err file and there are multiple errors related to mysql plugins and then the InnoDB file ibdata1 is deemed not writable, and then everything aborts. Thanks for any advice.

 

Docker log:

ErrorWarningSystemArrayLogin


*** Running /etc/my_init.d/10_syslog-ng.init...
Aug 13 17:47:15 observium syslog-ng[12]: syslog-ng starting up; version='3.13.2'
*** Running /etc/my_init.d/firstrun.sh...
Using existing PHP database config file.
warning: commands will be executed using /bin/sh
job 1 at Thu Aug 13 17:48:00 2020
warning: commands will be executed using /bin/sh
job 2 at Thu Aug 13 17:48:00 2020
*** Booting runit daemon...
*** Runit started as PID 33
Database exists.
Starting MariaDB...
Aug 13 17:47:18 observium cron[37]: (CRON) INFO (pidfile fd = 3)
Aug 13 17:47:18 observium cron[37]: (CRON) INFO (Running @reboot jobs)
200813 17:47:18 mysqld_safe Logging to '/config/databases/observium.err'.
200813 17:47:18 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.
Starting MariaDB...
200813 17:47:19 mysqld_safe Logging to '/config/databases/observium.err'.
200813 17:47:19 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.
Starting MariaDB...
...

observium.err log leading up to shutdown sequence:

2020-08-13 18:02:43 0 [ERROR] mariadbd: File '/config/databases/aria_log_control' not found (Errcode: 13 "Permission denied")
2020-08-13 18:02:43 0 [ERROR] mariadbd: Got error 'Can't open file' when trying to use aria control file '/config/databases/aria_log
_control'
2020-08-13 18:02:43 0 [ERROR] Plugin 'Aria' init function returned error.
2020-08-13 18:02:43 0 [ERROR] Plugin 'Aria' registration as a STORAGE ENGINE failed.
2020-08-13 18:02:43 0 [Note] InnoDB: Using Linux native AIO
2020-08-13 18:02:43 0 [ERROR] InnoDB: The innodb_system data file 'ibdata1' must be writable
2020-08-13 18:02:43 0 [ERROR] InnoDB: The innodb_system data file 'ibdata1' must be writable
2020-08-13 18:02:43 0 [ERROR] Plugin 'InnoDB' init function returned error.
2020-08-13 18:02:43 0 [ERROR] Plugin 'InnoDB' registration as a STORAGE ENGINE failed.
2020-08-13 18:02:43 0 [Note] Plugin 'FEEDBACK' is disabled.
2020-08-13 18:02:43 0 [ERROR] Could not open mysql.plugin table: "Table 'mysql.plugin' doesn't exist". Some plugins may be not loade
d
2020-08-13 18:02:43 0 [ERROR] Failed to initialize plugins.
2020-08-13 18:02:43 0 [ERROR] Aborting

 

Link to comment

It looks like file permission problems.

 

Here are my file permissions.

Quote

-rwxr-xr-x 1 root root 52 Aug 13 05:00 aria_log_control*

-rwxr-xr-x 1 root root 18874368 Aug 13 21:20 ibdata1*

 

Creating the database files from scratch, I see the following permissions

Quote

-rwxr-xr-x 1 nobody users        52 Aug 13 21:24 aria_log_control*
-rwxr-xr-x 1 nobody users  79691776 Aug 13 21:25 ibdata1*

Can you post your config permissions?

Link to comment

Thanks, @uberchuckie. My permissions on the files of interest looked good, as far as I could tell, though I went ahead and installed the dev branch to see if changing all permissions in the databases folder would help. With the dev branch installed, I get basically the same errors in the log, with an additional entry each time for Fixing file permissions. Again, reverting to 2.0.2 brings everything back to normal.

 

I'm happy to try deleting the database itself, though I'm not exactly sure which files to delete and which to preserve. I had tried deleting a few things before my original post, but that led 2.0.2 to break as well. Thanks!

 

Outputs of ls -l before running dev branch: 

drwxr-xr-x 1 nobody users  450 Aug 14 02:26 databases/

-rwxr-xr-x 1 nobody users    73728 Aug 14 02:00 aria_log.00000001*
-rwxr-xr-x 1 nobody users       52 Aug 14 02:00 aria_log_control*
-rw-rw---- 1 nobody users    30661 Apr 18 12:24 d5f1933a656f.err
-rw-rw---- 1 nobody users    26061 Aug 14 02:00 ib_buffer_pool
-rwxr-xr-x 1 nobody users 50331648 Aug 14 11:25 ib_logfile0*
-rwxr-xr-x 1 nobody users 50331648 Aug 14 06:55 ib_logfile1*
-rwxr-xr-x 1 nobody users 79691776 Aug 14 11:25 ibdata1*

 

Docker log:

*** Running /etc/my_init.d/10_syslog-ng.init...
Aug 14 11:28:19 observium syslog-ng[12]: syslog-ng starting up; version='3.13.2'
*** Running /etc/my_init.d/firstrun.sh...
Using existing PHP database config file.
warning: commands will be executed using /bin/sh
job 1 at Fri Aug 14 11:29:00 2020
warning: commands will be executed using /bin/sh
job 2 at Fri Aug 14 11:29:00 2020
*** Booting runit daemon...
*** Runit started as PID 33
Database exists.
Fixing file permissions.
Aug 14 11:28:21 observium cron[38]: (CRON) INFO (pidfile fd = 3)
Aug 14 11:28:21 observium cron[38]: (CRON) INFO (Running @reboot jobs)
Starting MariaDB...
200814 11:28:24 mysqld_safe Logging to '/config/databases/observium.err'.
200814 11:28:24 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.
Fixing file permissions.
Database exists.
Fixing file permissions.
Starting MariaDB...
...

 

Link to comment

So...not sure if this helps or not, but at present the latest docker in the main branch and the docker in the dev branch do not write to my observium.err file. The 2.0.2 version does. Here is the log from my last start/stop of 2.0.2, in case helpful:

2020-08-14 15:50:23 0 [Note] InnoDB: Using Linux native AIO
2020-08-14 15:50:23 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
2020-08-14 15:50:23 0 [Note] InnoDB: Uses event mutexes
2020-08-14 15:50:23 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
2020-08-14 15:50:23 0 [Note] InnoDB: Number of pools: 1
2020-08-14 15:50:23 0 [Note] InnoDB: Using SSE2 crc32 instructions
2020-08-14 15:50:23 0 [Note] mysqld: O_TMPFILE is not supported on /tmp (disabling future attempts)
2020-08-14 15:50:23 0 [Note] InnoDB: Initializing buffer pool, total size = 256M, instances = 1, chunk size = 128M
2020-08-14 15:50:23 0 [Note] InnoDB: Completed initialization of buffer pool
2020-08-14 15:50:23 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See th
e man page of setpriority().
2020-08-14 15:50:23 0 [Note] InnoDB: 128 out of 128 rollback segments are active.
2020-08-14 15:50:23 0 [Note] InnoDB: Creating shared tablespace for temporary tables
2020-08-14 15:50:23 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
2020-08-14 15:50:23 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
2020-08-14 15:50:23 0 [Note] InnoDB: 10.4.12 started; log sequence number 25563225979; transaction id 55235761
2020-08-14 15:50:23 0 [Note] InnoDB: Loading buffer pool(s) from /config/databases/ib_buffer_pool
2020-08-14 15:50:23 0 [Note] Plugin 'FEEDBACK' is disabled.
2020-08-14 15:50:23 0 [Note] Server socket created on IP: '127.0.0.1'.
2020-08-14 15:50:23 0 [Note] Reading of all Master_info entries succeeded
2020-08-14 15:50:23 0 [Note] Added new Master_info '' to hash table
2020-08-14 15:50:23 0 [Note] /usr/sbin/mysqld: ready for connections.
Version: '10.4.12-MariaDB-1:10.4.12+maria~bionic-log'  socket: '/var/run/mysqld/mysqld.sock'  port: 3306  mariadb.org binary distrib
ution
2020-08-14 15:50:24 0 [Note] InnoDB: Buffer pool(s) load completed at 200814 15:50:24
2020-08-14 15:51:50 0 [Note] /usr/sbin/mysqld (initiated by: unknown): Normal shutdown
2020-08-14 15:51:50 0 [Note] Event Scheduler: Purging the queue. 0 events
2020-08-14 15:51:50 0 [Note] InnoDB: FTS optimize thread exiting.
2020-08-14 15:51:50 0 [Note] InnoDB: Starting shutdown...
2020-08-14 15:51:50 0 [Note] InnoDB: Dumping buffer pool(s) to /config/databases/ib_buffer_pool
2020-08-14 15:51:50 0 [Note] InnoDB: Buffer pool(s) dump completed at 200814 15:51:50
2020-08-14 15:51:51 0 [Note] InnoDB: Shutdown completed; log sequence number 25563233366; transaction id 55235778
2020-08-14 15:51:51 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1"
2020-08-14 15:51:51 0 [Note] /usr/sbin/mysqld: Shutdown complete

 

Link to comment
On 8/5/2020 at 7:45 AM, uberchuckie said:

@kimocal The embedded MariaDB service was stuck in a restart loop. The /config/databases/ea65e1ef1086.err file should show why. I've had this error once before. MariaDB couldn't read the InnoDB files for me. Restoring from backups or creating the database from scratch resolved the issue for me.

 

This image doesn't need privileged access and works without it.

Thanks @uberchuckie It's up and running.  I pointed to my Maria DB docker so not sure if that's what fixed it.  I was able to add my Ubiquiti ER-X device for it to monitor, as all I'm really interested in is tracking my monthly data usage thru my ISP.  Beyond that I haven't had much time to tinker with it though.

Link to comment
  • 2 weeks later...

I can not get this to work. I've deleted it a dozen times, left it overnight before trying to login, and I get different error messages all the time even with new install dir's. 

 

Most recent one: DB Error 2002: No such file or directory

Or the "observium" username and password don't work. 

Log keeps spamming 

 

Starting MariaDB...
200828 07:31:48 mysqld_safe Logging to '/config/databases/9ac22bf8d797.err'.
200828 07:31:48 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.
Starting MariaDB...
200828 07:31:49 mysqld_safe Logging to '/config/databases/9ac22bf8d797.err'.
200828 07:31:49 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.
Starting MariaDB...
200828 07:31:51 mysqld_safe Logging to '/config/databases/9ac22bf8d797.err'.
200828 07:31:51 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.
Starting MariaDB...
200828 07:31:52 mysqld_safe Logging to '/config/databases/9ac22bf8d797.err'.
200828 07:31:52 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.


Here is a new install:

 

___ _ _
/ _ \ | |__ ___ ___ _ __ __ __(_) _ _ _ __ ___
| | | || '_ \ / __| / _ \| '__|\ \ / /| || | | || '_ ` _ \
| |_| || |_) |\__ \| __/| | \ V / | || |_| || | | | | |
\___/ |_.__/ |___/ \___||_| \_/ |_| \__,_||_| |_| |_|[0;36m
Observium Community Edition 19.8.10000
http://www.observium.org[0m
[0m

CMD[[0;33m/opt/observium/scripts/distro[0m]
[0m
CMD EXITCODE[[0;32m0[0m]
CMD RUNTIME[[0;32m0.0153s[0m][0m
STDOUT[
Linux|4.19.107-Unraid|amd64|Ubuntu|18.04|vmware|docker
][0m

CMD[[0;33m/usr/bin/env python --version 2>&1[0m]

[0m
CMD EXITCODE[[0;32m0[0m]
CMD RUNTIME[[0;32m0.0016s[0m][0m
STDOUT[
Python 2.7.17
][0m

SQL[[0;33mSELECT version();[0m][0m

SQL RUNTIME[[0;32m0.00018501s[0m][0m

CMD[[0;33m/usr/bin/snmpget --version 2>&1[0m]

[0m
CMD EXITCODE[[0;32m0[0m]
CMD RUNTIME[[0;32m0.0018s[0m][0m
STDOUT[
NET-SNMP version: 5.7.3

][0m

CMD[[0;33m/usr/bin/rrdtool --version | head -n1[0m]

[0m
CMD EXITCODE[[0;32m0[0m]
CMD RUNTIME[[0;32m0.0068s[0m][0m
STDOUT[
RRDtool 1.7.0 Copyright by Tobias Oetiker <tobi@oetiker.ch>
][0m

CMD[[0;33m/usr/bin/fping -v 2>&1[0m]
[0m
CMD EXITCODE[[0;32m0[0m]
CMD RUNTIME[[0;32m0.0015s[0m][0m
STDOUT[
/usr/bin/fping: Version 4.0

/usr/bin/fping: comments to [email protected]
][0m

CMD[[0;33m/usr/sbin/apache2 -v | awk '/Server version:/ {print $3}'[0m]

[0m
CMD EXITCODE[[0;32m0[0m]
CMD RUNTIME[[0;32m0.0414s[0m][0m
STDOUT[
Apache/2.4.29
][0m

CMD[[0;33mdate "+%:z"[0m]
[0m
CMD EXITCODE[[0;32m0[0m]
CMD RUNTIME[[0;32m0.0009s[0m][0m
CMD EXITDELAY[[0;31m10ms[0m][0m
STDOUT[
-07:00
][0m

SQL[[0;33mSELECT TIMEDIFF(NOW(), UTC_TIMESTAMP);[0m][0m
SQL RUNTIME[[0;32m0.00020695s[0m][0m

SQL[[0;33mSELECT @@SESSION.sql_mode;[0m][0m
SQL RUNTIME[[0;32m0.00009990s[0m][0m

SQL[[0;33mSHOW VARIABLES LIKE 'character_set_connection'[0m][0m
SQL RUNTIME[[0;32m0.00091219s[0m][0m

[0;36m##### [1;37mSoftware versions[0;36m #####[0m
[0m
[0;36m o [1;37mOS [0m Linux 4.19.107-Unraid [amd64] (Ubuntu 18.04)
[0;36m o [1;37mApache [0m 2.4.29
[0;36m o [1;37mPHP [0m 7.2.24-0ubuntu0.18.04.6 (OPcache: DISABLED)
[0;36m o [1;37mPython [0m 2.7.17
[0;36m o [1;37mMySQL [0m 10.5.4-MariaDB-1:10.5.4+maria~bionic (extension: mysqli 5.0.12-dev)
[0;36m o [1;37mSNMP [0m NET-SNMP 5.7.3
[0;36m o [1;37mRRDtool [0m 1.7.0
[0;36m o [1;37mFping [0m 4.0 (IPv4 and IPv6)

[0;35m##### [1;37mMemory Limit[0;35m #####[0m
[0m
[0;35m o [1;37mPHP [0m Unlimited

[0;35m##### [1;37mMySQL mode[0;35m #####[0m
[0m
[0;35m o [1;37mMySQL [0m ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION

[0;35m##### [1;37mCharset info[0;35m #####[0m
[0m
[0;35m o [1;37mPHP [0m UTF-8
[0;35m o [1;37mMySQL [0m utf8

[0;35m##### [1;37mTimezones info[0;35m #####[0m
[0m
[0;35m o [1;37mDate [0m Friday, 28-Aug-20 07:36:54 PDT
[0;35m o [1;37mPHP [0m -07:00
[0;35m o [1;37mMySQL [0m -07:00


SQL[[0;33mSELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'dbSchema';[0m][0m
SQL RUNTIME[[0;32m0.00015116s[0m][0m

SQL[[0;33mSELECT `version` FROM `dbSchema` ORDER BY `version` DESC LIMIT 1[0m][0m

SQL RUNTIME[[0;32m0.00010705s[0m][0m

SQL[[0;33mSELECT 1 FROM `devices` LIMIT 1;[0m][0m
SQL RUNTIME[[0;32m0.00011396s[0m]
SQL ERROR[[0;31mError in query: (Table 'observium.devices' doesn't exist) 1146[0m][0m

Install initial database schema ...
CMD[[0;33m/usr/bin/mysql -u'observium' -p'bjccHfoupBCWBTWPODmOFa16nN8DYF7X' -h'localhost' -D 'observium' < '/opt/observium/update/db_schema_mysql.sql'[0m]
[0m
CMD EXITCODE[[0;32m0[0m]
CMD RUNTIME[[0;31m115.721s[0m][0m
STDOUT[

][0m

SQL[[0;33mSELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'dbSchema';[0m][0m
SQL RUNTIME[[0;32m0.00043917s[0m][0m
done.

SQL[[0;33mSELECT * FROM `observium_processes` WHERE `process_name` = 'discovery.php' AND `device_id` = '-1'[0m][0m
SQL RUNTIME[[0;32m0.00041986s[0m][0m

SQL[[0;33mINSERT INTO `observium_processes` (`process_pid`,`process_name`,`process_ppid`,`process_uid`,`process_command`,`process_start`,`device_id`) VALUES ('225','discovery.php','36','0','php ./discovery.php -d -u','1598625529','-1')[0m][0m
SQL RUNTIME[[0;32m0.02732396s[0m][0m
-- Database is up to date.

SQL[[0;33mDELETE FROM `observium_processes` WHERE `process_pid` = '225' AND `process_name` = 'discovery.php' AND `device_id` = '-1'[0m][0m
SQL RUNTIME[[0;32m0.02290606s[0m][0m

SQL[[0;33mSELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'last_versioncheck';[0m][0m
SQL RUNTIME[[0;32m0.00021791s[0m][0m

REQUEST[[0;33mhttp://www.observium.org/versions.php[0m]
REQUEST STATUS[[0;32mTRUE[0m]
REQUEST RUNTIME[[0;32m1.3866s[0m]
RESPONSE CODE[200 OK][0m

SQL[[0;33mSELECT EXISTS (SELECT 1 FROM `observium_attribs` WHERE `attrib_type` = 'latest_ver')[0m][0m
SQL RUNTIME[[0;32m0.00026703s[0m][0m

SQL[[0;33mINSERT INTO `observium_attribs` (`attrib_type`,`attrib_value`) VALUES ('latest_ver','19.8')[0m][0m
SQL RUNTIME[[0;32m0.01941109s[0m][0m

SQL[[0;33mSELECT EXISTS (SELECT 1 FROM `observium_attribs` WHERE `attrib_type` = 'latest_rev')[0m][0m
SQL RUNTIME[[0;32m0.00016999s[0m][0m

SQL[[0;33mINSERT INTO `observium_attribs` (`attrib_type`,`attrib_value`) VALUES ('latest_rev','10000')[0m][0m
SQL RUNTIME[[0;32m0.01637483s[0m][0m

SQL[[0;33mSELECT EXISTS (SELECT 1 FROM `observium_attribs` WHERE `attrib_type` = 'latest_rev_date')[0m][0m
SQL RUNTIME[[0;32m0.00024509s[0m][0m

SQL[[0;33mINSERT INTO `observium_attribs` (`attrib_type`,`attrib_value`) VALUES ('latest_rev_date','2019-08-24')[0m][0m
SQL RUNTIME[[0;32m0.04439902s[0m][0m

SQL[[0;33mSELECT EXISTS (SELECT 1 FROM `observium_attribs` WHERE `attrib_type` = 'last_versioncheck')[0m][0m
SQL RUNTIME[[0;32m0.00021100s[0m][0m

SQL[[0;33mINSERT INTO `observium_attribs` (`attrib_type`,`attrib_value`) VALUES ('last_versioncheck','1598625531')[0m][0m
SQL RUNTIME[[0;32m0.04074883s[0m][0m

SQL[[0;33mSELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'latest_rev';[0m][0m
SQL RUNTIME[[0;32m0.00024605s[0m][0m
Adding the 'observium' user to the app.
[0;32mObservium CE 19.8.10000
[1;37mAdd User[0m
[0m
User observium added successfully.
Shutting down.
Aug 28 07:38:51 9ac22bf8d797 mysqld: 2020-08-28 7:38:51 0 [Note] /usr/sbin/mariadbd (initiated by: root[root] @ localhost []): Normal shutdown
Aug 28 07:38:51 9ac22bf8d797 mysqld: 2020-08-28 7:38:51 0 [Note] Event Scheduler: Purging the queue. 0 events
Aug 28 07:38:51 9ac22bf8d797 mysqld: 2020-08-28 7:38:51 0 [Note] InnoDB: FTS optimize thread exiting.
Aug 28 07:38:51 9ac22bf8d797 mysqld: 2020-08-28 7:38:51 0 [Note] InnoDB: Starting shutdown...
Aug 28 07:38:51 9ac22bf8d797 mysqld: 2020-08-28 7:38:51 0 [Note] InnoDB: Dumping buffer pool(s) to /config/databases/ib_buffer_pool
Aug 28 07:38:51 9ac22bf8d797 mysqld: 2020-08-28 7:38:51 0 [Note] InnoDB: Restricted to 2013 pages due to innodb_buf_pool_dump_pct=25
Aug 28 07:38:51 9ac22bf8d797 mysqld: 2020-08-28 7:38:51 0 [Note] InnoDB: Buffer pool(s) dump completed at 200828 7:38:51
Aug 28 07:38:53 9ac22bf8d797 mysqld: 2020-08-28 7:38:53 0 [Note] InnoDB: Shutdown completed; log sequence number 5767295; transaction id 5202
Aug 28 07:38:53 9ac22bf8d797 mysqld: 2020-08-28 7:38:53 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1"
Aug 28 07:38:53 9ac22bf8d797 mysqld: 2020-08-28 7:38:53 0 [Note] /usr/sbin/mariadbd: Shutdown complete
Aug 28 07:38:53 9ac22bf8d797 mysqld:
Aug 28 07:38:53 9ac22bf8d797 mysqld_safe: mysqld from pid file /run/mysqld/mysqld.pid ended
Aug 28 07:38:53 9ac22bf8d797 mysqld: 2020-08-28 7:38:53 0 [Note] InnoDB: Shutdown completed; log sequence number 5767295; transaction id 5202
Aug 28 07:38:53 9ac22bf8d797 mysqld: 2020-08-28 7:38:53 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1"
Aug 28 07:38:53 9ac22bf8d797 mysqld: 2020-08-28 7:38:53 0 [Note] /usr/sbin/mariadbd: Shutdown complete
Aug 28 07:38:53 9ac22bf8d797 mysqld:
Aug 28 07:38:53 9ac22bf8d797 mysqld_safe: mysqld from pid file /run/mysqld/mysqld.pid ended
chown time
Initialization complete.
Starting MariaDB...
200828 07:38:57 mysqld_safe Logging to '/config/databases/9ac22bf8d797.err'.
200828 07:38:57 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.
Starting MariaDB...
200828 07:38:58 mysqld_safe Logging to '/config/databases/9ac22bf8d797.err'.
200828 07:38:58 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.
Starting MariaDB...
200828 07:38:59 mysqld_safe Logging to '/config/databases/9ac22bf8d797.err'.
200828 07:38:59 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.
Starting MariaDB...
200828 07:38:59 mysqld_safe Logging to '/config/databases/9ac22bf8d797.err'.
200828 07:38:59 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.
Starting MariaDB...
200828 07:39:00 mysqld_safe Logging to '/config/databases/9ac22bf8d797.err'.
200828 07:39:00 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.
Starting MariaDB...
200828 07:39:01 mysqld_safe Logging to '/config/databases/9ac22bf8d797.err'.
200828 07:39:01 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Aug 28 07:39:02 9ac22bf8d797 CRON[906]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Aug 28 07:39:02 9ac22bf8d797 CRON[906]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Database exists.
Starting MariaDB...
200828 07:39:03 mysqld_safe Logging to '/config/databases/9ac22bf8d797.err'.
200828 07:39:03 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.
Starting MariaDB...
200828 07:39:04 mysqld_safe Logging to '/config/databases/9ac22bf8d797.err'.
200828 07:39:04 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.
Starting MariaDB...
200828 07:39:04 mysqld_safe Logging to '/config/databases/9ac22bf8d797.err'.
200828 07:39:04 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.
Starting MariaDB...
200828 07:39:05 mysqld_safe Logging to '/config/databases/9ac22bf8d797.err'.
200828 07:39:05 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.
Starting MariaDB...
200828 07:39:06 mysqld_safe Logging to '/config/databases/9ac22bf8d797.err'.
200828 07:39:06 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.
Starting MariaDB...
200828 07:39:06 mysqld_safe Logging to '/config/databases/9ac22bf8d797.err'.
200828 07:39:06 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.
Starting MariaDB...
200828 07:39:08 mysqld_safe Logging to '/config/databases/9ac22bf8d797.err'.
200828 07:39:08 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.
Starting MariaDB...


Any ideas?

Link to comment
On 8/29/2020 at 2:22 PM, Fiala06 said:

@uberchuckieThat file doesn't exist. 

 

I've attached the logs and database folder. 

observium2.zip 2.48 MB · 1 download

Nothing looks out of the ordinary. It's strange that the database log file doesn't exist. Maybe it can't create it and that's why it's failing? What version of unRAID are you running?

 

It looks like MariaDB is running fine during the schema creation but the service won't start after it shuts down and restarted.

 

Can you run

/usr/bin/mysqld_safe --skip-syslog --datadir='/config/databases'

in the container console?

 

I can't reproduce this problem on my server.

Edited by uberchuckie
Link to comment
13 hours ago, uberchuckie said:

Nothing looks out of the ordinary. It's strange that the database log file doesn't exist. Maybe it can't create it and that's why it's failing? What version of unRAID are you running?

 

 6.8.3

 

13 hours ago, uberchuckie said:

Can you run


/usr/bin/mysqld_safe --skip-syslog --datadir='/config/databases'

in the container console?

 

root@9ac22bf8d797:/# /usr/bin/mysqld_safe --skip-syslog --datadir='/config/databases'
200906 09:40:31 mysqld_safe Logging to '/config/databases/9ac22bf8d797.err'.
200906 09:40:31 mysqld_safe Starting mariadbd daemon with databases from /config/databases
root@9ac22bf8d797:/# 

 

I've reboot still nothing

 

image.png.d0a6d81edca5632deee31dff05b67f39.png

Link to comment

@uberchuckie, thanks for all your efforts to help troubleshoot this. Since it seems @Fiala06 and I are having similar issues, I went ahead and ran the mysqld_safe command in my console as well. I get the same result:

root@observium:/# /usr/bin/mysqld_safe --skip-syslog --datadir='/config/databases'
200912 16:06:02 mysqld_safe Logging to '/config/databases/observium.err'.
200912 16:06:02 mysqld_safe Starting mariadbd daemon with databases from /config/databases

However, if I run the same command using the 2.0.2 docker image (which still works for me), I get a different result:

root@observium:/# /usr/bin/mysqld_safe --skip-syslog --datadir='/config/databases'
200912 16:09:58 mysqld_safe Logging to '/config/databases/observium.err'.
200912 16:09:58 mysqld_safe A mysqld process already exists

Hopefully that helps a little.

Link to comment
On 8/28/2020 at 9:40 AM, Fiala06 said:

I can not get this to work. I've deleted it a dozen times, left it overnight before trying to login, and I get different error messages all the time even with new install dir's. 

 

Most recent one: DB Error 2002: No such file or directory

Or the "observium" username and password don't work. 

Log keeps spamming 

 


Starting MariaDB...
200828 07:31:48 mysqld_safe Logging to '/config/databases/9ac22bf8d797.err'.
200828 07:31:48 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.
Starting MariaDB...
200828 07:31:49 mysqld_safe Logging to '/config/databases/9ac22bf8d797.err'.
200828 07:31:49 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.
Starting MariaDB...
200828 07:31:51 mysqld_safe Logging to '/config/databases/9ac22bf8d797.err'.
200828 07:31:51 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.
Starting MariaDB...
200828 07:31:52 mysqld_safe Logging to '/config/databases/9ac22bf8d797.err'.
200828 07:31:52 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.


Here is a new install:

 


___ _ _
/ _ \ | |__ ___ ___ _ __ __ __(_) _ _ _ __ ___
| | | || '_ \ / __| / _ \| '__|\ \ / /| || | | || '_ ` _ \
| |_| || |_) |\__ \| __/| | \ V / | || |_| || | | | | |
\___/ |_.__/ |___/ \___||_| \_/ |_| \__,_||_| |_| |_|[0;36m
Observium Community Edition 19.8.10000
http://www.observium.org[0m
[0m

CMD[[0;33m/opt/observium/scripts/distro[0m]
[0m
CMD EXITCODE[[0;32m0[0m]
CMD RUNTIME[[0;32m0.0153s[0m][0m
STDOUT[
Linux|4.19.107-Unraid|amd64|Ubuntu|18.04|vmware|docker
][0m

CMD[[0;33m/usr/bin/env python --version 2>&1[0m]

[0m
CMD EXITCODE[[0;32m0[0m]
CMD RUNTIME[[0;32m0.0016s[0m][0m
STDOUT[
Python 2.7.17
][0m

SQL[[0;33mSELECT version();[0m][0m

SQL RUNTIME[[0;32m0.00018501s[0m][0m

CMD[[0;33m/usr/bin/snmpget --version 2>&1[0m]

[0m
CMD EXITCODE[[0;32m0[0m]
CMD RUNTIME[[0;32m0.0018s[0m][0m
STDOUT[
NET-SNMP version: 5.7.3

][0m

CMD[[0;33m/usr/bin/rrdtool --version | head -n1[0m]

[0m
CMD EXITCODE[[0;32m0[0m]
CMD RUNTIME[[0;32m0.0068s[0m][0m
STDOUT[
RRDtool 1.7.0 Copyright by Tobias Oetiker <tobi@oetiker.ch>
][0m

CMD[[0;33m/usr/bin/fping -v 2>&1[0m]
[0m
CMD EXITCODE[[0;32m0[0m]
CMD RUNTIME[[0;32m0.0015s[0m][0m
STDOUT[
/usr/bin/fping: Version 4.0

/usr/bin/fping: comments to [email protected]
][0m

CMD[[0;33m/usr/sbin/apache2 -v | awk '/Server version:/ {print $3}'[0m]

[0m
CMD EXITCODE[[0;32m0[0m]
CMD RUNTIME[[0;32m0.0414s[0m][0m
STDOUT[
Apache/2.4.29
][0m

CMD[[0;33mdate "+%:z"[0m]
[0m
CMD EXITCODE[[0;32m0[0m]
CMD RUNTIME[[0;32m0.0009s[0m][0m
CMD EXITDELAY[[0;31m10ms[0m][0m
STDOUT[
-07:00
][0m

SQL[[0;33mSELECT TIMEDIFF(NOW(), UTC_TIMESTAMP);[0m][0m
SQL RUNTIME[[0;32m0.00020695s[0m][0m

SQL[[0;33mSELECT @@SESSION.sql_mode;[0m][0m
SQL RUNTIME[[0;32m0.00009990s[0m][0m

SQL[[0;33mSHOW VARIABLES LIKE 'character_set_connection'[0m][0m
SQL RUNTIME[[0;32m0.00091219s[0m][0m

[0;36m##### [1;37mSoftware versions[0;36m #####[0m
[0m
[0;36m o [1;37mOS [0m Linux 4.19.107-Unraid [amd64] (Ubuntu 18.04)
[0;36m o [1;37mApache [0m 2.4.29
[0;36m o [1;37mPHP [0m 7.2.24-0ubuntu0.18.04.6 (OPcache: DISABLED)
[0;36m o [1;37mPython [0m 2.7.17
[0;36m o [1;37mMySQL [0m 10.5.4-MariaDB-1:10.5.4+maria~bionic (extension: mysqli 5.0.12-dev)
[0;36m o [1;37mSNMP [0m NET-SNMP 5.7.3
[0;36m o [1;37mRRDtool [0m 1.7.0
[0;36m o [1;37mFping [0m 4.0 (IPv4 and IPv6)

[0;35m##### [1;37mMemory Limit[0;35m #####[0m
[0m
[0;35m o [1;37mPHP [0m Unlimited

[0;35m##### [1;37mMySQL mode[0;35m #####[0m
[0m
[0;35m o [1;37mMySQL [0m ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION

[0;35m##### [1;37mCharset info[0;35m #####[0m
[0m
[0;35m o [1;37mPHP [0m UTF-8
[0;35m o [1;37mMySQL [0m utf8

[0;35m##### [1;37mTimezones info[0;35m #####[0m
[0m
[0;35m o [1;37mDate [0m Friday, 28-Aug-20 07:36:54 PDT
[0;35m o [1;37mPHP [0m -07:00
[0;35m o [1;37mMySQL [0m -07:00


SQL[[0;33mSELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'dbSchema';[0m][0m
SQL RUNTIME[[0;32m0.00015116s[0m][0m

SQL[[0;33mSELECT `version` FROM `dbSchema` ORDER BY `version` DESC LIMIT 1[0m][0m

SQL RUNTIME[[0;32m0.00010705s[0m][0m

SQL[[0;33mSELECT 1 FROM `devices` LIMIT 1;[0m][0m
SQL RUNTIME[[0;32m0.00011396s[0m]
SQL ERROR[[0;31mError in query: (Table 'observium.devices' doesn't exist) 1146[0m][0m

Install initial database schema ...
CMD[[0;33m/usr/bin/mysql -u'observium' -p'bjccHfoupBCWBTWPODmOFa16nN8DYF7X' -h'localhost' -D 'observium' < '/opt/observium/update/db_schema_mysql.sql'[0m]
[0m
CMD EXITCODE[[0;32m0[0m]
CMD RUNTIME[[0;31m115.721s[0m][0m
STDOUT[

][0m

SQL[[0;33mSELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'dbSchema';[0m][0m
SQL RUNTIME[[0;32m0.00043917s[0m][0m
done.

SQL[[0;33mSELECT * FROM `observium_processes` WHERE `process_name` = 'discovery.php' AND `device_id` = '-1'[0m][0m
SQL RUNTIME[[0;32m0.00041986s[0m][0m

SQL[[0;33mINSERT INTO `observium_processes` (`process_pid`,`process_name`,`process_ppid`,`process_uid`,`process_command`,`process_start`,`device_id`) VALUES ('225','discovery.php','36','0','php ./discovery.php -d -u','1598625529','-1')[0m][0m
SQL RUNTIME[[0;32m0.02732396s[0m][0m
-- Database is up to date.

SQL[[0;33mDELETE FROM `observium_processes` WHERE `process_pid` = '225' AND `process_name` = 'discovery.php' AND `device_id` = '-1'[0m][0m
SQL RUNTIME[[0;32m0.02290606s[0m][0m

SQL[[0;33mSELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'last_versioncheck';[0m][0m
SQL RUNTIME[[0;32m0.00021791s[0m][0m

REQUEST[[0;33mhttp://www.observium.org/versions.php[0m]
REQUEST STATUS[[0;32mTRUE[0m]
REQUEST RUNTIME[[0;32m1.3866s[0m]
RESPONSE CODE[200 OK][0m

SQL[[0;33mSELECT EXISTS (SELECT 1 FROM `observium_attribs` WHERE `attrib_type` = 'latest_ver')[0m][0m
SQL RUNTIME[[0;32m0.00026703s[0m][0m

SQL[[0;33mINSERT INTO `observium_attribs` (`attrib_type`,`attrib_value`) VALUES ('latest_ver','19.8')[0m][0m
SQL RUNTIME[[0;32m0.01941109s[0m][0m

SQL[[0;33mSELECT EXISTS (SELECT 1 FROM `observium_attribs` WHERE `attrib_type` = 'latest_rev')[0m][0m
SQL RUNTIME[[0;32m0.00016999s[0m][0m

SQL[[0;33mINSERT INTO `observium_attribs` (`attrib_type`,`attrib_value`) VALUES ('latest_rev','10000')[0m][0m
SQL RUNTIME[[0;32m0.01637483s[0m][0m

SQL[[0;33mSELECT EXISTS (SELECT 1 FROM `observium_attribs` WHERE `attrib_type` = 'latest_rev_date')[0m][0m
SQL RUNTIME[[0;32m0.00024509s[0m][0m

SQL[[0;33mINSERT INTO `observium_attribs` (`attrib_type`,`attrib_value`) VALUES ('latest_rev_date','2019-08-24')[0m][0m
SQL RUNTIME[[0;32m0.04439902s[0m][0m

SQL[[0;33mSELECT EXISTS (SELECT 1 FROM `observium_attribs` WHERE `attrib_type` = 'last_versioncheck')[0m][0m
SQL RUNTIME[[0;32m0.00021100s[0m][0m

SQL[[0;33mINSERT INTO `observium_attribs` (`attrib_type`,`attrib_value`) VALUES ('last_versioncheck','1598625531')[0m][0m
SQL RUNTIME[[0;32m0.04074883s[0m][0m

SQL[[0;33mSELECT `attrib_value` FROM `observium_attribs` WHERE `attrib_type` = 'latest_rev';[0m][0m
SQL RUNTIME[[0;32m0.00024605s[0m][0m
Adding the 'observium' user to the app.
[0;32mObservium CE 19.8.10000
[1;37mAdd User[0m
[0m
User observium added successfully.
Shutting down.
Aug 28 07:38:51 9ac22bf8d797 mysqld: 2020-08-28 7:38:51 0 [Note] /usr/sbin/mariadbd (initiated by: root[root] @ localhost []): Normal shutdown
Aug 28 07:38:51 9ac22bf8d797 mysqld: 2020-08-28 7:38:51 0 [Note] Event Scheduler: Purging the queue. 0 events
Aug 28 07:38:51 9ac22bf8d797 mysqld: 2020-08-28 7:38:51 0 [Note] InnoDB: FTS optimize thread exiting.
Aug 28 07:38:51 9ac22bf8d797 mysqld: 2020-08-28 7:38:51 0 [Note] InnoDB: Starting shutdown...
Aug 28 07:38:51 9ac22bf8d797 mysqld: 2020-08-28 7:38:51 0 [Note] InnoDB: Dumping buffer pool(s) to /config/databases/ib_buffer_pool
Aug 28 07:38:51 9ac22bf8d797 mysqld: 2020-08-28 7:38:51 0 [Note] InnoDB: Restricted to 2013 pages due to innodb_buf_pool_dump_pct=25
Aug 28 07:38:51 9ac22bf8d797 mysqld: 2020-08-28 7:38:51 0 [Note] InnoDB: Buffer pool(s) dump completed at 200828 7:38:51
Aug 28 07:38:53 9ac22bf8d797 mysqld: 2020-08-28 7:38:53 0 [Note] InnoDB: Shutdown completed; log sequence number 5767295; transaction id 5202
Aug 28 07:38:53 9ac22bf8d797 mysqld: 2020-08-28 7:38:53 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1"
Aug 28 07:38:53 9ac22bf8d797 mysqld: 2020-08-28 7:38:53 0 [Note] /usr/sbin/mariadbd: Shutdown complete
Aug 28 07:38:53 9ac22bf8d797 mysqld:
Aug 28 07:38:53 9ac22bf8d797 mysqld_safe: mysqld from pid file /run/mysqld/mysqld.pid ended
Aug 28 07:38:53 9ac22bf8d797 mysqld: 2020-08-28 7:38:53 0 [Note] InnoDB: Shutdown completed; log sequence number 5767295; transaction id 5202
Aug 28 07:38:53 9ac22bf8d797 mysqld: 2020-08-28 7:38:53 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1"
Aug 28 07:38:53 9ac22bf8d797 mysqld: 2020-08-28 7:38:53 0 [Note] /usr/sbin/mariadbd: Shutdown complete
Aug 28 07:38:53 9ac22bf8d797 mysqld:
Aug 28 07:38:53 9ac22bf8d797 mysqld_safe: mysqld from pid file /run/mysqld/mysqld.pid ended
chown time
Initialization complete.
Starting MariaDB...
200828 07:38:57 mysqld_safe Logging to '/config/databases/9ac22bf8d797.err'.
200828 07:38:57 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.
Starting MariaDB...
200828 07:38:58 mysqld_safe Logging to '/config/databases/9ac22bf8d797.err'.
200828 07:38:58 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.
Starting MariaDB...
200828 07:38:59 mysqld_safe Logging to '/config/databases/9ac22bf8d797.err'.
200828 07:38:59 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.
Starting MariaDB...
200828 07:38:59 mysqld_safe Logging to '/config/databases/9ac22bf8d797.err'.
200828 07:38:59 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.
Starting MariaDB...
200828 07:39:00 mysqld_safe Logging to '/config/databases/9ac22bf8d797.err'.
200828 07:39:00 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.
Starting MariaDB...
200828 07:39:01 mysqld_safe Logging to '/config/databases/9ac22bf8d797.err'.
200828 07:39:01 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Aug 28 07:39:02 9ac22bf8d797 CRON[906]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Aug 28 07:39:02 9ac22bf8d797 CRON[906]: (root) CMD ( [ -x /usr/lib/php/sessionclean ] && if [ ! -d /run/systemd/system ]; then /usr/lib/php/sessionclean; fi)
Database exists.
Starting MariaDB...
200828 07:39:03 mysqld_safe Logging to '/config/databases/9ac22bf8d797.err'.
200828 07:39:03 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.
Starting MariaDB...
200828 07:39:04 mysqld_safe Logging to '/config/databases/9ac22bf8d797.err'.
200828 07:39:04 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.
Starting MariaDB...
200828 07:39:04 mysqld_safe Logging to '/config/databases/9ac22bf8d797.err'.
200828 07:39:04 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.
Starting MariaDB...
200828 07:39:05 mysqld_safe Logging to '/config/databases/9ac22bf8d797.err'.
200828 07:39:05 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.
Starting MariaDB...
200828 07:39:06 mysqld_safe Logging to '/config/databases/9ac22bf8d797.err'.
200828 07:39:06 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.
Starting MariaDB...
200828 07:39:06 mysqld_safe Logging to '/config/databases/9ac22bf8d797.err'.
200828 07:39:06 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.
Starting MariaDB...
200828 07:39:08 mysqld_safe Logging to '/config/databases/9ac22bf8d797.err'.
200828 07:39:08 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.
Starting MariaDB...


Any ideas?

I hate to be the one to say "me too", but...  Seems like a couple of people have received this error here in the support thread.  Not seeing a solution yet.  The above Quote is pretty much exactly what I am seeing. 

I am also running unRaid 6.8.3.

Errors from the logfile mentioned in the unRaid log.


2020-09-20  8:28:02 0 [Note] InnoDB: Using Linux native AIO
2020-09-20  8:28:02 0 [Note] InnoDB: Uses event mutexes
2020-09-20  8:28:02 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
2020-09-20  8:28:02 0 [Note] InnoDB: Number of pools: 1
2020-09-20  8:28:02 0 [Note] InnoDB: Using SSE4.2 crc32 instructions
2020-09-20  8:28:02 0 [Note] mariadbd: O_TMPFILE is not supported on /tmp (disabling future attempts)
2020-09-20  8:28:02 0 [Note] InnoDB: Initializing buffer pool, total size = 134217728, chunk size = 134217728
2020-09-20  8:28:02 0 [Note] InnoDB: Completed initialization of buffer pool
2020-09-20  8:28:02 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. S
ee the man page of setpriority().
2020-09-20  8:28:02 0 [ERROR] InnoDB: Upgrade after a crash is not supported. The redo log was created with MariaDB 10.4.12.
2020-09-20  8:28:02 0 [ERROR] InnoDB: Plugin initialization aborted with error Generic error
2020-09-20  8:28:02 0 [Note] InnoDB: Starting shutdown...
2020-09-20  8:28:02 0 [ERROR] Plugin 'InnoDB' init function returned error.
2020-09-20  8:28:02 0 [ERROR] Plugin 'InnoDB' registration as a STORAGE ENGINE failed.
2020-09-20  8:28:02 0 [Note] Plugin 'FEEDBACK' is disabled.
2020-09-20  8:28:02 0 [ERROR] Unknown/unsupported storage engine: InnoDB
2020-09-20  8:28:02 0 [ERROR] Aborting

 

-Craig 

Link to comment
24 minutes ago, albion01 said:

2020-09-20  8:28:02 0 [ERROR] InnoDB: Upgrade after a crash is not supported. The redo log was created with MariaDB 10.4.12.
2020-09-20  8:28:02 0 [ERROR] InnoDB: Plugin initialization aborted with error Generic error
2020-09-20  8:28:02 0 [Note] InnoDB: Starting shutdown...
2020-09-20  8:28:02 0 [ERROR] Plugin 'InnoDB' init function returned error.
2020-09-20  8:28:02 0 [ERROR] Plugin 'InnoDB' registration as a STORAGE ENGINE failed.
2020-09-20  8:28:02 0 [Note] Plugin 'FEEDBACK' is disabled.
2020-09-20  8:28:02 0 [ERROR] Unknown/unsupported storage engine: InnoDB
2020-09-20  8:28:02 0 [ERROR] Aborting

Having the MariaDB log file is useful. I'm not sure if the problem is the same as the others are having but the symptoms are the same where MariaDB is not starting.

 

The problem here is the redo log is preventing the MariaDB to upgrade from 10.4 to 10.5.

 

You can try reverting to image tag 2.0.2, shutdown and see if the redo gets processed properly then move the latest again.

 

The other thing you can try is to just delete the /config/databases/ib_logfile* before trying to start the container. You may potentially lose transactions that were not committed but that's probably fine.

Link to comment
13 hours ago, uberchuckie said:

Having the MariaDB log file is useful. I'm not sure if the problem is the same as the others are having but the symptoms are the same where MariaDB is not starting.

 

The problem here is the redo log is preventing the MariaDB to upgrade from 10.4 to 10.5.

 

You can try reverting to image tag 2.0.2, shutdown and see if the redo gets processed properly then move the latest again.

 

The other thing you can try is to just delete the /config/databases/ib_logfile* before trying to start the container. You may potentially lose transactions that were not committed but that's probably fine.

I've tried removing ib_logfile (renamed it to old_ib_logfile0).  No change, the web UI still gives me "DB Error 2002: No such file or directory".  I'm not sure I understand what you mean by "reverting to image tag 2.0.2." 

Link to comment

I'm getting the same errors as others here -

"DB Error 2002: No such file or directory"

 

Log just continues with this -

Database exists.

Starting MariaDB...
Sep 23 11:49:34 8ffb5f7097ea cron[38]: (CRON) INFO (pidfile fd = 3)
Sep 23 11:49:34 8ffb5f7097ea cron[38]: (CRON) INFO (Running @reboot jobs)
200923 11:49:34 mysqld_safe Logging to '/config/databases/8ffb5f7097ea.err'.
200923 11:49:34 mysqld_safe Starting mariadbd daemon with databases from /config/databases
Database exists.
Starting MariaDB...
200923 11:49:35 mysqld_safe Logging to '/config/databases/8ffb5f7097ea.err'.
200923 11:49:35 mysqld_safe Starting mariadbd daemon with databases from /config/databases

Anyone figure out this issue yet?

 

If I run this from the command line.

mysqld
2020-09-23 15:28:02 0 [Note] mysqld (mysqld 10.5.4-MariaDB-1:10.5.4+maria~bionic) starting as process 1651 ...
2020-09-23 15:28:02 0 [ERROR] mysqld: Can't create/write to file '/var/lib/mysql/aria_log_control' (Errcode: 13 "Permission denied")
2020-09-23 15:28:02 0 [ERROR] mysqld: Got error 'Can't create file' when trying to use aria control file '/var/lib/mysql/aria_log_control'
2020-09-23 15:28:02 0 [ERROR] Plugin 'Aria' init function returned error.
2020-09-23 15:28:02 0 [ERROR] Plugin 'Aria' registration as a STORAGE ENGINE failed.
2020-09-23 15:28:02 0 [Note] InnoDB: Using Linux native AIO
2020-09-23 15:28:02 0 [ERROR] InnoDB: The innodb_system data file 'ibdata1' must be writable
2020-09-23 15:28:02 0 [ERROR] InnoDB: The innodb_system data file 'ibdata1' must be writable
2020-09-23 15:28:02 0 [ERROR] Plugin 'InnoDB' init function returned error.
2020-09-23 15:28:02 0 [ERROR] Plugin 'InnoDB' registration as a STORAGE ENGINE failed.
2020-09-23 15:28:02 0 [Note] Plugin 'FEEDBACK' is disabled.
2020-09-23 15:28:02 0 [ERROR] Could not open mysql.plugin table: "Table 'mysql.plugin' doesn't exist". Some plugins may be not loaded
2020-09-23 15:28:02 0 [ERROR] Failed to initialize plugins.
2020-09-23 15:28:02 0 [ERROR] Aborting

Edited by chip
Link to comment

Quick update from above -

Ran the following -

chown -R mysql:mysql /var/lib/mysql

 

Then ran mysqld
2020-09-23 15:34:59 0 [Note] mysqld (mysqld 10.5.4-MariaDB-1:10.5.4+maria~bionic) starting as process 2139 ...
2020-09-23 15:34:59 0 [Note] mysqld: Aria engine: starting recovery
recovered pages: 0% 25% 82% 93% 100% (0.0 seconds); tables to flush: 4 3 2 1 0
 (0.0 seconds);
2020-09-23 15:34:59 0 [Note] mysqld: Aria engine: recovery done
2020-09-23 15:34:59 0 [Note] InnoDB: Using Linux native AIO
2020-09-23 15:34:59 0 [Note] InnoDB: Uses event mutexes
2020-09-23 15:34:59 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
2020-09-23 15:34:59 0 [Note] InnoDB: Number of pools: 1
2020-09-23 15:34:59 0 [Note] InnoDB: Using SSE4.2 crc32 instructions
2020-09-23 15:34:59 0 [Note] mysqld: O_TMPFILE is not supported on /tmp (disabling future attempts)
2020-09-23 15:34:59 0 [Note] InnoDB: Initializing buffer pool, total size = 134217728, chunk size = 134217728
2020-09-23 15:34:59 0 [Note] InnoDB: Completed initialization of buffer pool
2020-09-23 15:34:59 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority().
2020-09-23 15:34:59 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=45069
2020-09-23 15:34:59 0 [Note] InnoDB: 128 rollback segments are active.
2020-09-23 15:34:59 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1"
2020-09-23 15:34:59 0 [Note] InnoDB: Creating shared tablespace for temporary tables
2020-09-23 15:34:59 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
2020-09-23 15:34:59 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
2020-09-23 15:34:59 0 [Note] InnoDB: 10.5.4 started; log sequence number 45081; transaction id 21
2020-09-23 15:34:59 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool
2020-09-23 15:34:59 0 [Note] Plugin 'FEEDBACK' is disabled.
2020-09-23 15:34:59 0 [Note] InnoDB: Buffer pool(s) load completed at 200923 15:34:59
2020-09-23 15:34:59 0 [Note] Server socket created on IP: '127.0.0.1'.
2020-09-23 15:34:59 0 [Note] Reading of all Master_info entries succeeded
2020-09-23 15:34:59 0 [Note] Added new Master_info '' to hash table
2020-09-23 15:34:59 0 [Note] mysqld: ready for connections.
Version: '10.5.4-MariaDB-1:10.5.4+maria~bionic'  socket: '/run/mysqld/mysqld.sock'  port: 3306  mariadb.org binary distribution
2020-09-23 15:35:00 7 [Warning] Access denied for user 'observium'@'localhost'
2020-09-23 15:35:01 11 [Warning] Access denied for user 'observium'@'localhost'
2020-09-23 15:35:01 12 [Warning] Access denied for user 'observium'@'localhost'
^C2020-09-23 15:37:45 13 [Warning] Access denied for user 'observium'@'localhost'

 

Click on the Docker I get this -

DB Error 1698: Access denied for user 'observium'@'localhost'

 

Even after running chown -R mysql:mysql /var/lib/mysql and restarting the docker mariadb won't autostart. I have to go into it and start by -

service mariadb status

 

and still see this going on when you click on the far right log file after you get it started.


Database exists.
Starting MariaDB...
200923 16:19:52 mysqld_safe Logging to '/config/databases/2e96f60615f2.err'.
200923 16:19:52 mysqld_safe A mysqld process already exists
Database exists.
Starting MariaDB...
200923 16:19:53 mysqld_safe Logging to '/config/databases/2e96f60615f2.err'.
200923 16:19:53 mysqld_safe A mysqld process already exists
 

Edited by chip
Link to comment
On 9/20/2020 at 11:56 PM, albion01 said:

I've tried removing ib_logfile (renamed it to old_ib_logfile0).  No change, the web UI still gives me "DB Error 2002: No such file or directory".  I'm not sure I understand what you mean by "reverting to image tag 2.0.2." 

If you have deleted the log files, I'm not sure if reverting to MariaDB 10.4 would help. What are the MariaDB errors now? Can you post the log file to show why it's not starting?

Link to comment

@chip Is this an upgrade from a previous image or are you trying to get it to run from scratch?

 

Running it manually without the "--datadir='/config/databases'" flag doesn't use the same data location and thus the user "observium" wouldn't be created. It's interesting that running it manually does seem to start which could point to a permission issue with the /config volume mount.

Link to comment

@chip

 

OK, I missed this earlier:

2020-09-23 15:28:02 0 [ERROR] mysqld: Can't create/write to file '/var/lib/mysql/aria_log_control' (Errcode: 13 "Permission denied")
2020-09-23 15:28:02 0 [ERROR] mysqld: Got error 'Can't create file' when trying to use aria control file '/var/lib/mysql/aria_log_control'

 

I'll take a look as to why it works on my server but not on yours.

Link to comment

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Restore formatting

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.