Then, using the web API import/export, populated it with centreon 2.6 hosts, services etc..
In the broker configuration I changed the conf file from “central-module.xml” to “poller-module.json” and the central was up.
I then changed the conf files of central-broker-master to “central-broker.json” and central-rrd-master to “central-rrd.json”. Following these changes the central went down as such.
I have found errors in /var/log/centreon-broker/central-module-master.log :
.2023-05-30T16:28:58.259+02:00] 3core] 8info] multiplexing: engine started g2023-05-30T16:28:58.261+02:00] 3core] 8info] Poller '' with id 0 connected t2023-05-30T16:29:11.051+02:00] 3core] 9info] bbdo stream stopped with 0 events acknowledged e2023-05-30T16:29:11.051+02:00] 3core] 9info] Poller '' with id 0 just disconnected j2023-05-30T16:29:11.051+02:00] 3tcp] 2error] Error while reading on socket: Operation aborted. p2023-05-30T16:29:11.051+02:00] 3core] 9info] multiplexing: stopping engine :2023-05-30T16:29:11.051+02:00] 3core] 9info] multiplexing: sending events to muxers for the last time 0 events to send
The same error was found in /var/log/centreon-broker/central-broker-master.log
Also, in /var/log/centreon-gorgone/gorgoned.log I get :
2023-05-30 16:29:17 - ERROR - 3proxy] Cannot create child, need a core id 2023-05-30 16:29:17 - ERROR - 3proxy] Cannot create child, need a core id 2023-05-30 16:29:17 - ERROR - 3proxy] Cannot create child, need a core id 2023-05-30 16:29:17 - ERROR - 3proxy] Cannot create child, need a core id 2023-05-30 16:29:17 - ERROR - 3proxy] Cannot create child, need a core id
If someone has any idea I would be happy to give more details.
Page 1 / 1
I have found another problem, the cbd service seems to be restarting in a loop.
watchdog.log →
Maybe this has to do with the brokers configuration ? I have replaced “Broker SQL Database” with “Unified SQL” but nothing has changed.
@Chenry
how about
systemctl status cbd centreon centengine gorgoned mysql
and
rpm -qa centreon\* | sort
All are running except centreon that is marked as exited.
systemctl status cbd centreon centengine gorgoned mysql
● centreon.service - One Service to rule them all. Loaded: loaded (/usr/lib/systemd/system/centreon.service; enabled; vendor preset: disabled) Active: active (exited) since Wed 2023-05-31 15:10:04 CEST; 1min 16s ago Process: 2445 ExecStart=/bin/true (code=exited, status=0/SUCCESS) Main PID: 2445 (code=exited, status=0/SUCCESS) Tasks: 0 (limit: 11144) Memory: 0B CGroup: /system.slice/centreon.service
May 31 15:10:04 centreon-central systemde1]: centreon.service: Succeeded. May 31 15:10:04 centreon-central systemde1]: Stopped One Service to rule them all.. May 31 15:10:04 centreon-central systemde1]: Stopping One Service to rule them all.... May 31 15:10:04 centreon-central systemde1]: Starting One Service to rule them all.... May 31 15:10:04 centreon-central systemde1]: Started One Service to rule them all..
● centengine.service - Centreon Engine Loaded: loaded (/usr/lib/systemd/system/centengine.service; enabled; vendor preset: disabled) Active: active (running) since Wed 2023-05-31 15:10:04 CEST; 1min 16s ago Main PID: 2450 (centengine) Tasks: 11 (limit: 11144) Memory: 7.0M CGroup: /system.slice/centengine.service └─2450 /usr/sbin/centengine /etc/centreon-engine/centengine.cfg
May 31 15:11:14 centreon-central cbwdr2595]: n2023-05-31 15:11:14.621] Mcore] 1error] Error during cbd exit: config parser: unified_sql output is incompatible with storage/sql outputs May 31 15:11:14 centreon-central cbwdb2595]: 2023-05-31 15:11:14.621] Mcore] 1info] main: process /usr/sbin/cbd pid:2595 end exit_code:1 May 31 15:11:14 centreon-central cbwdc2595]: 22023-05-31 15:11:14.621] Mcore] 1info] log finished May 31 15:11:19 centreon-central cbwd]2448]: 2023-05-31T15:11:19.619+02:00] cbwd] 1error] cbd instance with PID 2595 has stopped, attempt to restart it May 31 15:11:19 centreon-central cbwdo2596]: t2023-05-31 15:11:19.621] Mcore] 1info] Centreon Broker 23.04.0 May 31 15:11:19 centreon-central cbwdn2596]: t2023-05-31 15:11:19.621] Mcore] 1info] Copyright 2009-2021 Centreon May 31 15:11:19 centreon-central cbwdC2596]: t2023-05-31 15:11:19.621] Mcore] 1info] License ASL 2.0 <http://www.apache.org/licenses/LICENSE-2.0> May 31 15:11:19 centreon-central cbwdo2596]: n2023-05-31 15:11:19.621] Mcore] 1error] Error during cbd exit: config parser: unified_sql output is incompatible with storage/sql outputs May 31 15:11:19 centreon-central cbwdb2596]: 2023-05-31 15:11:19.621] Mcore] 1info] main: process /usr/sbin/cbd pid:2596 end exit_code:1 May 31 15:11:19 centreon-central cbwdc2596]: 22023-05-31 15:11:19.621] Mcore] 1info] log finished
● centreon.service - One Service to rule them all. Loaded: loaded (/usr/lib/systemd/system/centreon.service; enabled; vendor preset: disabled) Active: active (exited) since Wed 2023-05-31 15:10:04 CEST; 1min 16s ago Process: 2445 ExecStart=/bin/true (code=exited, status=0/SUCCESS) Main PID: 2445 (code=exited, status=0/SUCCESS) Tasks: 0 (limit: 11144) Memory: 0B CGroup: /system.slice/centreon.service
May 31 15:10:04 centreon-central systemdp1]: centreon.service: Succeeded. May 31 15:10:04 centreon-central systemdy1]: Stopped One Service to rule them all.. May 31 15:10:04 centreon-central systemd 1]: Stopping One Service to rule them all.... May 31 15:10:04 centreon-central systemdo1]: Starting One Service to rule them all.... May 31 15:10:04 centreon-central systemda1]: Started One Service to rule them all..
● centengine.service - Centreon Engine Loaded: loaded (/usr/lib/systemd/system/centengine.service; enabled; vendor preset: disabled) Active: active (running) since Wed 2023-05-31 15:10:04 CEST; 1min 16s ago Main PID: 2450 (centengine) Tasks: 11 (limit: 11144) Memory: 7.0M CGroup: /system.slice/centengine.service └─2450 /usr/sbin/centengine /etc/centreon-engine/centengine.cfg
May 31 15:31:28 centreon-central cbwdy3870]: 32023-05-31 15:31:28.769] dcore] :error] Error during cbd exit: config parser: unified_sql output is incompatible with storage/sql outputs May 31 15:31:28 centreon-central cbwdy3870]: 32023-05-31 15:31:28.769] dcore] :info] main: process /usr/sbin/cbd pid:3870 end exit_code:1 May 31 15:31:28 centreon-central cbwdy3870]: 32023-05-31 15:31:28.769] dcore] :info] log finished May 31 15:31:33 centreon-central cbwdy3804]: 32023-05-31T15:31:33.767+02:00] ]cbwd] 3error] cbd instance with PID 3870 has stopped, attempt to restart it May 31 15:31:33 centreon-central cbwdy3871]: 32023-05-31 15:31:33.770] dcore] :info] Centreon Broker 23.04.0 May 31 15:31:33 centreon-central cbwdy3871]: 32023-05-31 15:31:33.770] dcore] :info] Copyright 2009-2021 Centreon May 31 15:31:33 centreon-central cbwdy3871]: 32023-05-31 15:31:33.770] dcore] :info] License ASL 2.0 <http://www.apache.org/licenses/LICENSE-2.0> May 31 15:31:33 centreon-central cbwdy3871]: 32023-05-31 15:31:33.770] dcore] :error] Error during cbd exit: config parser: unified_sql output is incompatible with storage/sql outputs May 31 15:31:33 centreon-central cbwdy3871]: 32023-05-31 15:31:33.770] dcore] :info] main: process /usr/sbin/cbd pid:3871 end exit_code:1 May 31 15:31:33 centreon-central cbwdy3871]: 32023-05-31 15:31:33.770] dcore] :info] log finished
● centreon.service - One Service to rule them all. Loaded: loaded (/usr/lib/systemd/system/centreon.service; enabled; vendor preset: disabled) Active: active (exited) since Wed 2023-05-31 15:10:04 CEST; 21min ago Process: 2445 ExecStart=/bin/true (code=exited, status=0/SUCCESS) Main PID: 2445 (code=exited, status=0/SUCCESS) Tasks: 0 (limit: 11144) Memory: 0B CGroup: /system.slice/centreon.service
May 31 15:10:04 centreon-central systemd 1]: centreon.service: Succeeded. May 31 15:10:04 centreon-central systemde1]: Stopped One Service to rule them all.. May 31 15:10:04 centreon-central systemdl1]: Stopping One Service to rule them all.... May 31 15:10:04 centreon-central systemd.1]: Starting One Service to rule them all.... May 31 15:10:04 centreon-central systemd.1]: Started One Service to rule them all..
● centengine.service - Centreon Engine Loaded: loaded (/usr/lib/systemd/system/centengine.service; enabled; vendor preset: disabled) Active: active (running) since Wed 2023-05-31 15:31:20 CEST; 15s ago Main PID: 3818 (centengine) Tasks: 11 (limit: 11144) Memory: 3.0M CGroup: /system.slice/centengine.service └─3818 /usr/sbin/centengine /etc/centreon-engine/centengine.cfg
May 31 15:07:58 centreon-central mariadbda1259]: 2023-05-31 15:07:58 0 "Note] InnoDB: 10.5.20 started; log sequence number 314803827; transaction id 916217 May 31 15:07:58 centreon-central mariadbd1259]: 2023-05-31 15:07:58 0 dNote] Plugin 'FEEDBACK' is disabled. May 31 15:07:58 centreon-central mariadbd[1259]: 2023-05-31 15:07:58 0 ;Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool May 31 15:07:58 centreon-central mariadbd 1259]: 2023-05-31 15:07:58 0 DNote] Server socket created on IP: '::'. May 31 15:07:58 centreon-central mariadbd01259]: 2023-05-31 15:07:58 0 Note] Reading of all Master_info entries succeeded May 31 15:07:58 centreon-central mariadbd11259]: 2023-05-31 15:07:58 0 NNote] Added new Master_info '' to hash table May 31 15:07:58 centreon-central mariadbd]1259]: 2023-05-31 15:07:58 0 ]Note] /usr/sbin/mariadbd: ready for connections. May 31 15:07:58 centreon-central mariadbd51259]: Version: '10.5.20-MariaDB' socket: '/var/lib/mysql/mysql.sock' port: 3306 MariaDB Server May 31 15:07:58 centreon-central systemd81]: Started MariaDB 10.5.20 database server. May 31 15:07:59 centreon-central mariadbdm1259]: 2023-05-31 15:07:59 0 .Note] InnoDB: Buffer pool(s) load completed at 230531 15:07:59
When looking in the Centreon logs, I found multiple errors the day the container went down.
Unfortunately, I’m really bad with databases so if anyone knows how to fix or troubleshoot this sort of error, it would be really appreciated !
I had the error “Error during cbd exit: config parser: unified_sql output is incompatible with storage/sql outputs”. Similar issue
So the solution was to edit central-broker outputs to use “broker SQL database” instead of “unified SQL”
edit “/etc/centreon-broker/central-broker.json” to delete the unified SQL section before anything else. Export configuration and then restart.
systemctl restart cbd centengine gorgoned
Now this error is fixed.
Anyway, this doesnt seem to help much in my original problem.
in logs in still get :
Here is my /etc/centreon-broker
I can provide further details so if anyone has a clue feel free to reply !
/var/logs/centreib-broker
==> central-broker-master.log <== r2023-06-07T11:15:43.019+02:00] :sql] .error] storage stream instanciation failed a2023-06-07T11:15:43.019+02:00] :core] 0error] failover: global error: storage: Unable to initialize the storage connection to the database t2023-06-07T11:15:58.039+02:00] :sql] .error] Conflict manager: storage and sql streams do not have the same database configuration o2023-06-07T11:15:58.039+02:00] :sql] .error] storage stream instanciation failed a2023-06-07T11:15:58.039+02:00] :core] 0error] failover: global error: storage: Unable to initialize the storage connection to the database t2023-06-07T11:16:13.057+02:00] :sql] .error] Conflict manager: storage and sql streams do not have the same database configuration o2023-06-07T11:16:13.057+02:00] :sql] .error] storage stream instanciation failed a2023-06-07T11:16:13.057+02:00] :core] 0error] failover: global error: storage: Unable to initialize the storage connection to the database t2023-06-07T11:16:28.067+02:00] :sql] .error] Conflict manager: storage and sql streams do not have the same database configuration o2023-06-07T11:16:28.067+02:00] :sql] .error] storage stream instanciation failed a2023-06-07T11:16:28.067+02:00] :core] 0error] failover: global error: storage: Unable to initialize the storage connection to the database t2023-06-07T11:16:43.079+02:00] :sql] .error] Conflict manager: storage and sql streams do not have the same database configuration o2023-06-07T11:16:43.079+02:00] :sql] .error] storage stream instanciation failed a2023-06-07T11:16:43.079+02:00] :core] 0error] failover: global error: storage: Unable to initialize the storage connection to the database t2023-06-07T11:16:58.100+02:00] :sql] .error] Conflict manager: storage and sql streams do not have the same database configuration o2023-06-07T11:16:58.100+02:00] :sql] .error] storage stream instanciation failed a2023-06-07T11:16:58.101+02:00] :core] 1error] failover: global error: storage: Unable to initialize the storage connection to the database t2023-06-07T11:17:13.107+02:00] :sql] .error] Conflict manager: storage and sql streams do not have the same database configuration o2023-06-07T11:17:13.107+02:00] :sql] .error] storage stream instanciation failed a2023-06-07T11:17:13.107+02:00] :core] 1error] failover: global error: storage: Unable to initialize the storage connection to the database t2023-06-07T11:17:28.113+02:00] :sql] .error] Conflict manager: storage and sql streams do not have the same database configuration o2023-06-07T11:17:28.113+02:00] :sql] .error] storage stream instanciation failed a2023-06-07T11:17:28.113+02:00] :core] 1error] failover: global error: storage: Unable to initialize the storage connection to the database t2023-06-07T11:17:43.134+02:00] :sql] .error] Conflict manager: storage and sql streams do not have the same database configuration o2023-06-07T11:17:43.134+02:00] :sql] .error] storage stream instanciation failed a2023-06-07T11:17:43.134+02:00] :core] 1error] failover: global error: storage: Unable to initialize the storage connection to the database t2023-06-07T11:17:58.138+02:00] :sql] .error] Conflict manager: storage and sql streams do not have the same database configuration o2023-06-07T11:17:58.138+02:00] :sql] .error] storage stream instanciation failed a2023-06-07T11:17:58.138+02:00] :core] 1error] failover: global error: storage: Unable to initialize the storage connection to the database t2023-06-07T11:18:13.141+02:00] :sql] .error] Conflict manager: storage and sql streams do not have the same database configuration o2023-06-07T11:18:13.141+02:00] :sql] .error] storage stream instanciation failed a2023-06-07T11:18:13.141+02:00] :core] 1error] failover: global error: storage: Unable to initialize the storage connection to the database t2023-06-07T11:18:28.159+02:00] :sql] .error] Conflict manager: storage and sql streams do not have the same database configuration o2023-06-07T11:18:28.159+02:00] :sql] .error] storage stream instanciation failed a2023-06-07T11:18:28.159+02:00] :core] 1error] failover: global error: storage: Unable to initialize the storage connection to the database t2023-06-07T11:18:43.177+02:00] :sql] .error] Conflict manager: storage and sql streams do not have the same database configuration o2023-06-07T11:18:43.177+02:00] :sql] .error] storage stream instanciation failed a2023-06-07T11:18:43.177+02:00] :core] 1error] failover: global error: storage: Unable to initialize the storage connection to the database t2023-06-07T11:18:58.193+02:00] :sql] .error] Conflict manager: storage and sql streams do not have the same database configuration o2023-06-07T11:18:58.193+02:00] :sql] .error] storage stream instanciation failed a2023-06-07T11:18:58.193+02:00] :core] 1error] failover: global error: storage: Unable to initialize the storage connection to the database t2023-06-07T11:19:13.222+02:00] :sql] .error] Conflict manager: storage and sql streams do not have the same database configuration o2023-06-07T11:19:13.222+02:00] :sql] .error] storage stream instanciation failed a2023-06-07T11:19:13.222+02:00] :core] 2error] failover: global error: storage: Unable to initialize the storage connection to the database t2023-06-07T11:19:28.266+02:00] :sql] .error] Conflict manager: storage and sql streams do not have the same database configuration o2023-06-07T11:19:28.266+02:00] :sql] .error] storage stream instanciation failed a2023-06-07T11:19:28.266+02:00] :core] 2error] failover: global error: storage: Unable to initialize the storage connection to the database t2023-06-07T11:19:43.290+02:00] :sql] .error] Conflict manager: storage and sql streams do not have the same database configuration o2023-06-07T11:19:43.290+02:00] :sql] .error] storage stream instanciation failed a2023-06-07T11:19:43.290+02:00] :core] 2error] failover: global error: storage: Unable to initialize the storage connection to the database
==> central-module-master.log <== r2023-06-07T11:06:02.032+02:00] :core] 0info] protocols: unregistering protocol 'BBDO' t2023-06-07T11:06:02.032+02:00] :core] 0info] protocols: unregistering protocol 'compression' c2023-06-07T11:06:02.032+02:00] :core] 0info] protocols: unregistering protocol 'file' t2023-06-07T11:06:02.032+02:00] :core] 0info] protocols: destruction (0 protocols still registered) 2023-06-07T11:06:02.032+02:00] :core] 0info] pool: the latency check encountered an error: Operation aborted. i2023-06-07T11:06:02.032+02:00] :core] 0info] log finished l2023-06-07T11:06:02.221+02:00] :core] 2info] modules: attempt to load module '/usr/share/centreon/lib/centreon-broker/50-tcp.so' r2023-06-07T11:06:02.221+02:00] :core] 2info] modules: attempt to load module '/usr/share/centreon/lib/centreon-broker/10-neb.so' r2023-06-07T11:06:02.222+02:00] :core] 2info] NEB: module for Centreon Broker 23.04.0 o2023-06-07T11:06:02.222+02:00] :core] 2info] modules: attempt to load module '/usr/share/centreon/lib/centreon-broker/60-tls.so' r2023-06-07T11:06:02.224+02:00] :core] 2info] protocols: registering protocol ('TLS' (layers 5-5) (2023-06-07T11:06:02.224+02:00] :core] 2info] protocols: registering protocol ('TCP' (layers 1-4) (2023-06-07T11:06:02.224+02:00] :core] 2info] modules: attempt to load module '/usr/share/centreon/lib/centreon-broker/15-stats.so' 12023-06-07T11:06:02.225+02:00] :core] 2info] multiplexing: 'central-module-master-output' starts with 0 in queue and the queue file is disable e2023-06-07T11:06:02.226+02:00] :core] 2info] start of asio thread 7fc249576700 72023-06-07T11:06:02.226+02:00] :core] 2info] start of asio thread 7fc248d75700 72023-06-07T11:06:02.226+02:00] :core] 2info] start of asio thread 7fc233fff700 72023-06-07T11:06:02.226+02:00] :core] 2info] multiplexing: engine started g2023-06-07T11:06:02.228+02:00] :core] 2info] Poller '' with id 0 connected 2023-06-07T11:06:10.058+02:00] :core] 0info] bbdo stream stopped with 0 events acknowledged a2023-06-07T11:06:10.058+02:00] :core] 0info] Poller '' with id 0 just disconnected d2023-06-07T11:06:10.058+02:00] :tcp] .error] Error while reading on socket: Operation aborted. i2023-06-07T11:06:10.058+02:00] :core] 0info] multiplexing: stopping engine p2023-06-07T11:06:10.058+02:00] :core] 0info] multiplexing: sending events to muxers for the last time 0 events to send e2023-06-07T11:06:10.058+02:00] :core] 0info] Destroying muxer central-module-master-output: number of events in the queue: 0 t2023-06-07T11:06:10.058+02:00] :core] 0info] modules: closing '/usr/share/centreon/lib/centreon-broker/60-tls.so' r2023-06-07T11:06:10.059+02:00] :core] 0info] protocols: unregistering protocol 'TLS' o2023-06-07T11:06:10.059+02:00] :core] 0info] modules: closing '/usr/share/centreon/lib/centreon-broker/50-tcp.so' r2023-06-07T11:06:10.059+02:00] :core] 0info] protocols: unregistering protocol 'TCP' o2023-06-07T11:06:10.059+02:00] :core] 0info] modules: closing '/usr/share/centreon/lib/centreon-broker/15-stats.so' 12023-06-07T11:06:10.146+02:00] :core] 1info] modules: closing '/usr/share/centreon/lib/centreon-broker/10-neb.so' r2023-06-07T11:06:10.146+02:00] :core] 1info] protocols: unregistering protocol 'BBDO' t2023-06-07T11:06:10.146+02:00] :core] 1info] protocols: unregistering protocol 'compression' c2023-06-07T11:06:10.146+02:00] :core] 1info] protocols: unregistering protocol 'file' t2023-06-07T11:06:10.146+02:00] :core] 1info] protocols: destruction (0 protocols still registered) 2023-06-07T11:06:10.146+02:00] :core] 1info] pool: the latency check encountered an error: Operation aborted. i2023-06-07T11:06:10.147+02:00] :core] 1info] log finished l2023-06-07T11:06:12.389+02:00] :core] 3info] modules: attempt to load module '/usr/share/centreon/lib/centreon-broker/50-tcp.so' r2023-06-07T11:06:12.389+02:00] :core] 3info] modules: attempt to load module '/usr/share/centreon/lib/centreon-broker/10-neb.so' r2023-06-07T11:06:12.397+02:00] :core] 3info] start of asio thread 7f7292c37700 72023-06-07T11:06:12.397+02:00] :core] 3info] start of asio thread 7f7292436700 72023-06-07T11:06:12.397+02:00] :core] 3info] start of asio thread 7f7291c35700 72023-06-07T11:06:12.412+02:00] :core] 4info] NEB: module for Centreon Broker 23.04.0 o2023-06-07T11:06:12.412+02:00] :core] 4info] modules: attempt to load module '/usr/share/centreon/lib/centreon-broker/60-tls.so' r2023-06-07T11:06:12.414+02:00] :core] 4info] protocols: registering protocol ('TLS' (layers 5-5) (2023-06-07T11:06:12.414+02:00] :core] 4info] protocols: registering protocol ('TCP' (layers 1-4) (2023-06-07T11:06:12.414+02:00] :core] 4info] modules: attempt to load module '/usr/share/centreon/lib/centreon-broker/15-stats.so' 12023-06-07T11:06:12.415+02:00] :core] 4info] multiplexing: 'central-module-master-output' starts with 0 in queue and the queue file is disable e2023-06-07T11:06:12.423+02:00] :core] 4info] multiplexing: engine started g2023-06-07T11:06:12.425+02:00] :core] 4info] Poller '' with id 0 connected
==> central-rrd-master.log <== r2023-06-07T11:07:27.562+02:00] :core] 5error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:07:42.578+02:00] :core] 5error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:07:57.619+02:00] :core] 6error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:08:12.637+02:00] :core] 6error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:08:27.644+02:00] :core] 6error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:08:42.673+02:00] :core] 6error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:08:57.677+02:00] :core] 6error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:09:12.678+02:00] :core] 6error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:09:27.680+02:00] :core] 6error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:09:42.690+02:00] :core] 6error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:09:57.691+02:00] :core] 6error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:10:12.703+02:00] :core] 7error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:10:27.704+02:00] :core] 7error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:10:42.720+02:00] :core] 7error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:10:57.729+02:00] :core] 7error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:11:12.732+02:00] :core] 7error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:11:27.742+02:00] :core] 7error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:11:42.755+02:00] :core] 7error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:11:57.762+02:00] :core] 7error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:12:12.785+02:00] :core] 7error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:12:27.814+02:00] :core] 8error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:12:42.828+02:00] :core] 8error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:12:57.833+02:00] :core] 8error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:13:12.848+02:00] :core] 8error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:13:27.861+02:00] :core] 8error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:13:42.868+02:00] :core] 8error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:13:57.880+02:00] :core] 8error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:14:12.893+02:00] :core] 8error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:14:27.916+02:00] :core] 9error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:14:42.929+02:00] :core] 9error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:14:57.933+02:00] :core] 9error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:15:12.990+02:00] :core] 9error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:15:28.018+02:00] :core] 0error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:15:43.019+02:00] :core] 0error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:15:58.039+02:00] :core] 0error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:16:13.057+02:00] :core] 0error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:16:28.067+02:00] :core] 0error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:16:43.079+02:00] :core] 0error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:16:58.100+02:00] :core] 1error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:17:13.107+02:00] :core] 1error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:17:28.113+02:00] :core] 1error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:17:43.134+02:00] :core] 1error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:17:58.138+02:00] :core] 1error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:18:13.141+02:00] :core] 1error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:18:28.159+02:00] :core] 1error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:18:43.177+02:00] :core] 1error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:18:58.193+02:00] :core] 1error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:19:13.212+02:00] :core] 2error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:19:28.220+02:00] :core] 2error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use r2023-06-07T11:19:43.229+02:00] :core] 2error] acceptor: endpoint 'central-rrd-master-input' could not accept client: bind: Address already in use
==> watchdog.log <== g2023-06-07T11:04:29.482+02:00] :cbwd] 4error] cbd instance with PID 3194 has stopped, attempt to restart it o2023-06-07T11:04:29.482+02:00] :cbwd] 4info] Starting progress 'central-broker-master' o2023-06-07T11:04:29.482+02:00] :cbwd] 4info] Process 'central-broker-master' started (PID 3195) d2023-06-07T11:04:34.132+02:00] :cbwd] 1error] cbd instance with PID 3195 has stopped, attempt to restart it o2023-06-07T11:04:34.132+02:00] :cbwd] 1info] Starting progress 'central-broker-master' o2023-06-07T11:04:34.132+02:00] :cbwd] 1info] Process 'central-broker-master' started (PID 3212) d2023-06-07T11:04:40.505+02:00] :cbwd] 5info] Starting progress 'central-broker-master' o2023-06-07T11:04:40.505+02:00] :cbwd] 5info] Process 'central-broker-master' started (PID 3262) d2023-06-07T11:04:40.505+02:00] :cbwd] 5info] Starting progress 'central-rrd-master' -2023-06-07T11:04:40.505+02:00] :cbwd] 5info] Process 'central-rrd-master' started (PID 3263) d2023-06-07T11:04:45.512+02:00] :cbwd] 5error] cbd instance with PID 3262 has stopped, attempt to restart it o2023-06-07T11:04:45.512+02:00] :cbwd] 5info] Starting progress 'central-broker-master' o2023-06-07T11:04:45.513+02:00] :cbwd] 5info] Process 'central-broker-master' started (PID 3281) d2023-06-07T11:04:50.522+02:00] :cbwd] 5error] cbd instance with PID 3281 has stopped, attempt to restart it o2023-06-07T11:04:50.522+02:00] :cbwd] 5info] Starting progress 'central-broker-master' o2023-06-07T11:04:50.523+02:00] :cbwd] 5info] Process 'central-broker-master' started (PID 3331) d2023-06-07T11:04:55.523+02:00] :cbwd] 5error] cbd instance with PID 3331 has stopped, attempt to restart it o2023-06-07T11:04:55.523+02:00] :cbwd] 5info] Starting progress 'central-broker-master' o2023-06-07T11:04:55.523+02:00] :cbwd] 5info] Process 'central-broker-master' started (PID 3332) d2023-06-07T11:05:00.525+02:00] :cbwd] 5error] cbd instance with PID 3332 has stopped, attempt to restart it o2023-06-07T11:05:00.525+02:00] :cbwd] 5info] Starting progress 'central-broker-master' o2023-06-07T11:05:00.525+02:00] :cbwd] 5info] Process 'central-broker-master' started (PID 3333) d2023-06-07T11:05:05.534+02:00] :cbwd] 5error] cbd instance with PID 3333 has stopped, attempt to restart it o2023-06-07T11:05:05.535+02:00] :cbwd] 5info] Starting progress 'central-broker-master' o2023-06-07T11:05:05.535+02:00] :cbwd] 5info] Process 'central-broker-master' started (PID 3385) d2023-06-07T11:05:10.535+02:00] :cbwd] 5error] cbd instance with PID 3385 has stopped, attempt to restart it o2023-06-07T11:05:10.535+02:00] :cbwd] 5info] Starting progress 'central-broker-master' o2023-06-07T11:05:10.535+02:00] :cbwd] 5info] Process 'central-broker-master' started (PID 3390) d2023-06-07T11:05:15.536+02:00] :cbwd] 5error] cbd instance with PID 3390 has stopped, attempt to restart it o2023-06-07T11:05:15.536+02:00] :cbwd] 5info] Starting progress 'central-broker-master' o2023-06-07T11:05:15.536+02:00] :cbwd] 5info] Process 'central-broker-master' started (PID 3401) d2023-06-07T11:05:20.537+02:00] :cbwd] 5error] cbd instance with PID 3401 has stopped, attempt to restart it o2023-06-07T11:05:20.537+02:00] :cbwd] 5info] Starting progress 'central-broker-master' o2023-06-07T11:05:20.537+02:00] :cbwd] 5info] Process 'central-broker-master' started (PID 3407) d2023-06-07T11:05:25.537+02:00] :cbwd] 5error] cbd instance with PID 3407 has stopped, attempt to restart it o2023-06-07T11:05:25.537+02:00] :cbwd] 5info] Starting progress 'central-broker-master' o2023-06-07T11:05:25.537+02:00] :cbwd] 5info] Process 'central-broker-master' started (PID 3408) d2023-06-07T11:05:30.538+02:00] :cbwd] 5error] cbd instance with PID 3408 has stopped, attempt to restart it o2023-06-07T11:05:30.538+02:00] :cbwd] 5info] Starting progress 'central-broker-master' o2023-06-07T11:05:30.538+02:00] :cbwd] 5info] Process 'central-broker-master' started (PID 3409) d2023-06-07T11:05:35.543+02:00] :cbwd] 5error] cbd instance with PID 3409 has stopped, attempt to restart it o2023-06-07T11:05:35.543+02:00] :cbwd] 5info] Starting progress 'central-broker-master' o2023-06-07T11:05:35.544+02:00] :cbwd] 5info] Process 'central-broker-master' started (PID 3418) d2023-06-07T11:05:40.544+02:00] :cbwd] 5error] cbd instance with PID 3418 has stopped, attempt to restart it o2023-06-07T11:05:40.544+02:00] :cbwd] 5info] Starting progress 'central-broker-master' o2023-06-07T11:05:40.544+02:00] :cbwd] 5info] Process 'central-broker-master' started (PID 3419) d2023-06-07T11:06:12.396+02:00] :cbwd] 3info] Starting progress 'central-broker-master' o2023-06-07T11:06:12.396+02:00] :cbwd] 3info] Process 'central-broker-master' started (PID 3533) d2023-06-07T11:06:12.396+02:00] :cbwd] 3info] Starting progress 'central-rrd-master' -2023-06-07T11:06:12.396+02:00] :cbwd] 3info] Process 'central-rrd-master' started (PID 3534)
Looks like I have created more errors while fixing the unified SQL issue... I can’t seem to wrap my head around this...
Some progress, changed a few things in broker configuration, also turns out I was out of space in /var/lib/centreon-broker so I did this step once more :
Stop the Centreon Broker process:
systemctl stop cbd
Delete existing retention files:
rm /var/lib/centreon-broker/* -f
and restart
systemctl restart cbd centengine gorgoned
Now the problem is it doesnt stop fiiling up the disk space and I don’t know why. I have 5Gb on /var/lib/centreon-brocker is that enough ? Is it the “Link to cbd service” option ? Looks like it I have disabled it and now its okay. Maybe because the process keeps restarting. Also I have lost connection to hosts.
I don’t understand, everything else seems good. But the sql database is not working as it should.
But why does “central-broker-sql -” have so many events ? Is that normal ?
Found a fix, this doesnt get rid of the initial probelm “error while reading on socket” but it does make my central work.
The problem was that I was using output SQL and Storage which were deprecated. Just replace the two by one “unified SQL”. This did the trick for me. If anyone has a proper solution for the original problem feel free to respond.