I’ve installed two like-hosts with XCP 1.6, created a pool, and after telling my second host to join the pool the whole thing gets into a very odd state. The pool master knows about some of the storage repos of the second host, but cannot
communicate with it, and isn’t listed in xencenter. The second host cannot be reached by xencenter anymore, and doesn’t think it is a member of the pool, even after a reboot.
I get into this state when I have a server join the pool, and each server has a locally defined default ‘Local storage’ SR, or when neither have a default storage repository. When ONLY one host doesn’t have a ‘default’ marker on the SR
‘Local storage’ it joins fine, and is a member.
NOTE: I know this will be tagged as the “reason”, but I do have to perform a forced pool join due to a mismatch in the ‘stepping’ between my cpus. I feel this is extremely minor, they’re both the same model, just different stepping numbers
(6 vs 10). This shouldn’t be the reason why.
If you’d like logs, then I’ll have to rebuild a new cluster, but the only way I’ve seen to resolve this is not define a default on more than one intended pool member, and join them. Also once I get into this state, I have to re-format/install
because the master won’t destroy/leave the pool, and the other server won’t join because of an error message: (“’NoneType’ object has no attribute ‘xenapi’”,)
Let me know what might be useful, here’s an example of it unable to communicate in the logs:
---
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Reading config file]
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Reading config file D:bcd08e8573be created by task D:d790ab93e94f
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Reading config file D:bcd08e8573be|config_shared] Disabling logging for: http
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Reading config file D:bcd08e8573be|config_shared] Disabling logging for: db_write
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Reading config file D:bcd08e8573be|config_shared] Disabling logging for: redo_log
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Reading external global variables definition]
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Reading external global variables definition D:e04155f8aa81 created
by task D:d790ab93e94f
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [XAPI SERVER STARTING]
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task XAPI SERVER STARTING D:ed55d35743b8 created by task D:d790ab93e94f
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|XAPI SERVER STARTING D:ed55d35743b8|xapi] pool_role=slave:192.168.2.26
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Parsing inventory file]
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Parsing inventory file D:d98a4de00be2 created by task D:d790ab93e94f
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Initialising local database]
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Initialising local database D:246722c23497 created by task D:d790ab93e94f
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Initialising local database D:246722c23497|hashtbl_xml] Converting dtd
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Initialising local database D:246722c23497|localdb] host_disabled_until_reboot = false
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Initialising local database D:246722c23497|localdb] this_node_just_became_master = false
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Initialising local database D:246722c23497|localdb] host_restarted_cleanly = false
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Initialising local database D:246722c23497|localdb] master_scripts = false
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Initialising local database D:246722c23497|localdb] ha.armed = false
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Loading DHCP leases]
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Loading DHCP leases D:a579dfaf8357 created by task D:d790ab93e94f
Oct 18 09:15:33 xs-02 xapi: [ info|xs-02.dde.gogrid.net|0 thread_zero|Loading DHCP leases D:a579dfaf8357|xapi_udhcpd] Caught exception Unix.Unix_error(20, "open", "/var/xapi/dhcp-leases.db")
loading /var/xapi/dhcp-leases.db: creating new empty leases database
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Reading pool secret]
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Reading pool secret D:bf33756caa9b created by task D:d790ab93e94f
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Logging xapi version info]
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Logging xapi version info D:71038c9b733c created by task D:d790ab93e94f
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Logging xapi version info D:71038c9b733c|xapi] Server configuration:
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Logging xapi version info D:71038c9b733c|xapi] platform_version: 1.6.06
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Logging xapi version info D:71038c9b733c|xapi] platform_name: XCP
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Logging xapi version info D:71038c9b733c|xapi] build_number: 61002c
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Logging xapi version info D:71038c9b733c|xapi] git changeset:
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Logging xapi version info D:71038c9b733c|xapi] version: 1.3
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Logging xapi version info D:71038c9b733c|xapi] use-xenopsd: true
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Setting signal handlers]
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Setting signal handlers D:b9e514546ef6 created by task D:d790ab93e94f
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Initialising random number generator]
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Initialising random number generator D:b754cadd6b4f created by
task D:d790ab93e94f
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Running startup check]
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Running startup check D:3c90a6ab7aa7 created by task D:d790ab93e94f
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Running startup check D:3c90a6ab7aa7|xapi] Binary appears to be correctly linked
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Initialising SM state]
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Initialising SM state D:17b7be421e02 created by task D:d790ab93e94f
Oct 18 09:15:33 xs-02 xapi: [ info|xs-02.dde.gogrid.net|0 thread_zero|Initialising SM state D:17b7be421e02|storage_impl] No storage state is persisted in /var/run/nonpersistent/xapi/storage.db;
creating blank database
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Starting SM internal event service]
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Starting SM internal event service D:d0aef07a81d6 created by
task D:d790ab93e94f
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Starting SM service]
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|1||storage] Scheduler sleep until 1350580534 (another 3600 seconds)
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Starting SM service D:0f6f55e6132f created by task D:d790ab93e94f
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Starting SM xapi event service]
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Starting SM xapi event service D:0c269e2f8574 created by task
D:d790ab93e94f
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Registering http handlers]
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Registering http handlers D:0d6e49963c6d created by task D:d790ab93e94f
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Listening unix socket]
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Listening unix socket D:70e8ca2e9195 created by task D:d790ab93e94f
Oct 18 09:15:33 xs-02 xapi: [ info|xs-02.dde.gogrid.net|0 thread_zero|Listening unix socket D:70e8ca2e9195|xapi] Successfully bound socket to: UNIX /var/xapi/xapi
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Checking HA configuration]
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Checking HA configuration D:b14fa653a0c2 created by task D:d790ab93e94f
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Checking for non-HA redo-log]
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Checking for non-HA redo-log D:33225a1d0e58 created by task D:d790ab93e94f
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Setup DB configuration]
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Setup DB configuration D:d0df4dadff1f created by task D:d790ab93e94f
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Setup DB configuration D:d0df4dadff1f|xapi] parsing db config file
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Setup DB configuration D:d0df4dadff1f|xapi] [/var/xapi/state.db]
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Setup DB configuration D:d0df4dadff1f|xapi] mode:no_limit
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Setup DB configuration D:d0df4dadff1f|xapi] format:xml
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Setup DB configuration D:d0df4dadff1f|xapi] compress:false
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Setup DB configuration D:d0df4dadff1f|xapi] is_on_remote_storage:false
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Setup DB configuration D:d0df4dadff1f|xapi] available_this_boot:true
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Setup DB configuration D:d0df4dadff1f|xapi] format:xml
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Setup DB configuration D:d0df4dadff1f|xapi]
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [bringing up management interface]
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task bringing up management interface D:2c0efe3501de created by task
D:d790ab93e94f
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|bringing up management interface D:2c0efe3501de|xapi] Starting new server
Oct 18 09:15:33 xs-02 xapi: [error|xs-02.dde.gogrid.net|0 thread_zero|bringing up management interface D:2c0efe3501de|master_connection] Caught Master_connection.Goto_handler
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|bringing up management interface D:2c0efe3501de|master_connection] Connection to master died. I will continue
to retry indefinitely (supressing future logging of this message).
Oct 18 09:15:33 xs-02 xapi: [error|xs-02.dde.gogrid.net|0 thread_zero|bringing up management interface D:2c0efe3501de|master_connection] Connection to master died. I will continue
to retry indefinitely (supressing future logging of this message).
Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|bringing up management interface D:2c0efe3501de|master_connection] Sleeping 2.000000 seconds before retrying master
connection...
Oct 18 09:15:33 xs-02 /opt/xensource/libexec/xcp-rrdd: [debug|xs-02.dde.gogrid.net|0 monitor|main|rrdd_monitor] Creating fresh RRD for VM uuid=afbbf737-5e8c-4bf4-91ab-8408f910fdc3
Oct 18 09:15:33 xs-02 /opt/xensource/libexec/xcp-rrdd: [debug|xs-02.dde.gogrid.net|0 monitor|main|rrdd_monitor] Sending back RRD for VM uuid=00000000-0000-0000-0000-000000000000
Oct 18 09:15:33 xs-02 /opt/xensource/libexec/xcp-rrdd: [debug|xs-02.dde.gogrid.net|0 monitor|main|rrdd_shared] Archiving RRD for object uuid=00000000-0000-0000-0000-000000000000 to
remote master
Oct 18 09:15:33 xs-02 /opt/xensource/libexec/xcp-rrdd: [debug|xs-02.dde.gogrid.net|0 monitor|main|rrdd_shared] About to send to master.
Oct 18 09:15:33 xs-02 /opt/xensource/libexec/xcp-rrdd: [debug|xs-02.dde.gogrid.net|0 monitor|main|rrdd_shared] Sending RRD for object uuid=00000000-0000-0000-0000-000000000000 archiving=true
to address: 192.168.2.26
Oct 18 09:15:33 xs-02 /opt/xensource/libexec/xcp-rrdd: [debug|xs-02.dde.gogrid.net|0 monitor|main|stunnel] Using commandline: /usr/sbin/stunnel -fd 355c3b40-cdf1-aca3-93b9-1a09f49dbee1
Oct 18 09:15:33 xs-02 /opt/xensource/libexec/xcp-rrdd: [debug|xs-02.dde.gogrid.net|0 monitor|main|stunnel] stunnel has pidty: (FEFork (15,7050))
Oct 18 09:15:33 xs-02 /opt/xensource/libexec/xcp-rrdd: [debug|xs-02.dde.gogrid.net|0 monitor|main|stunnel] stunnel start
Oct 18 09:15:33 xs-02 /opt/xensource/libexec/xcp-rrdd: [debug|xs-02.dde.gogrid.net|0 monitor|main|xmlrpc_client] stunnel pid: 7050 (cached = false) connected to 192.168.2.26:443
Oct 18 09:15:33 xs-02 /opt/xensource/libexec/xcp-rrdd: [debug|xs-02.dde.gogrid.net|0 monitor|main|xmlrpc_client] with_recorded_stunnelpid task_opt=None s_pid=7050
Oct 18 09:15:34 xs-02 /opt/xensource/libexec/xcp-rrdd: [ warn|xs-02.dde.gogrid.net|0 monitor|main|xmlrpc_client] stunnel pid: 7050 caught Http_client.Http_request_rejected("404: {
frame = false; method = PUT; uri = /rrd; query = [ archive=true; uuid=00000000-0000-0000-0000-000000000000 ]; content_length = [ ]; transfer encoding = ; version = 1.0; cookie = [ pool_secret=b7ab33f3-8864-a7fc-4c68-ea3d4741e37c/d8392808-edbf-9d6e-573a-993a12570e3b/d3227802-ec5c-6eeb-80d8-e1bac35c20ac
]; task = ; subtask_of = ; content-type = ; host = ; user_agent = xapi/1.3 }")
Oct 18 09:15:34 xs-02 /opt/xensource/libexec/xcp-rrdd: [debug|xs-02.dde.gogrid.net|0 monitor|main|rrdd_main] Monitor thread caught an exception. Pausing for 10s, then restarting.
Oct 18 09:15:34 xs-02 /opt/xensource/libexec/xcp-rrdd: [debug|xs-02.dde.gogrid.net|0 monitor|main|rrdd_main] Raised at http_client.ml:166.21-83 -> http_client.ml:175.4-75 -> xmlrpc_client.ml:258.2-63
-> xmlrpc_client.ml:237.7-10 -> xmlrpc_client.ml:242.13-14 -> pervasiveext.ml:22.2-9 -> pervasiveext.ml:26.22-25 -> pervasiveext.ml:22.2-9 -> pervasiveext.ml:26.22-25 -> rrdd_shared.ml:120.1-131 -> list.ml:69.12-15 -> pervasiveext.ml:22.2-9 -> pervasiveext.ml:26.22-25
-> rrdd_main.ml:591.4-17
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|bringing up management interface D:2c0efe3501de|master_connection] stunnel: Using commandline: /usr/sbin/stunnel
-fd ce4b99ec-9f06-9d25-c3df-993f25a295af
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|bringing up management interface D:2c0efe3501de|master_connection] stunnel: stunnel has pidty: (FEFork (19,7242))
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|bringing up management interface D:2c0efe3501de|master_connection] stunnel: stunnel start
Oct 18 09:15:35 xs-02 xapi: [ info|xs-02.dde.gogrid.net|0 thread_zero|bringing up management interface D:2c0efe3501de|master_connection] stunnel connected pid=7242 fd=16
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|bringing up management interface D:2c0efe3501de|backtrace] Raised at db_rpc_client_v1.ml:39.14-41 -> db_actions.ml:7192.28-63
-> xapi_mgmt_iface.ml:52.17-49 -> threadext.ml:20.20-24 -> threadext.ml:20.62-65 -> xapi.ml:310.3-71
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|bringing up management interface D:2c0efe3501de|xapi] Caught exception bringing up management interface: UUID_INVALID:
[ host; e32c5aa1-b129-4e0c-92ca-089268dc0ee9 ]
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [starting thread Starting periodic scheduler]
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [starting thread Remote requests]
Oct 18 09:15:35 xs-02 xapi: [ info|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|xapi] Running in 'Pool Slave' mode
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|xapi] Running in 'Pool Slave' mode
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|5 UNIX /var/xapi/xapi|session.login_with_password D:b00f1a1b3a11|backtrace] Raised at db_rpc_client_v1.ml:39.14-41 -> db_actions.ml:7192.28-63
-> xapi_session.ml:363.57-91 -> xapi_session.ml:36.12-17 -> xapi_session.ml:36.67-68 -> server_helpers.ml:72.10-22
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|5 UNIX /var/xapi/xapi|session.login_with_password D:b00f1a1b3a11|dispatcher] Server_helpers.exec exception_handler: Got exception
UUID_INVALID: [ host; e32c5aa1-b129-4e0c-92ca-089268dc0ee9 ]
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|7||dummytaskhelper] task Starting periodic scheduler D:5a6404e4d45b created by task D:d790ab93e94f
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|5 UNIX /var/xapi/xapi|session.login_with_password D:b00f1a1b3a11|dispatcher] Raised at string.ml:150.25-34 -> stringext.ml:108.13-29
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|5 UNIX /var/xapi/xapi|session.login_with_password D:b00f1a1b3a11|backtrace] Raised at string.ml:150.25-34 -> stringext.ml:108.13-29
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|5 UNIX /var/xapi/xapi|session.login_with_password D:b00f1a1b3a11|xapi] Raised at server_helpers.ml:94.14-15 -> pervasiveext.ml:22.2-9
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|5 UNIX /var/xapi/xapi|session.login_with_password D:b00f1a1b3a11|xapi] Raised at pervasiveext.ml:26.22-25 -> pervasiveext.ml:22.2-9
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|5 UNIX /var/xapi/xapi|dispatch:session.login_with_password D:0ae69a1a4b95|xapi] Raised at pervasiveext.ml:26.22-25 -> pervasiveext.ml:22.2-9
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|5 UNIX /var/xapi/xapi|dispatch:session.login_with_password D:0ae69a1a4b95|backtrace] Raised at pervasiveext.ml:26.22-25 -> server_helpers.ml:140.10-106
-> server.ml:501.19-183 -> server_helpers.ml:119.4-7
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|7|Starting periodic scheduler D:5a6404e4d45b|backgroundscheduler] Periodic scheduler started
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|8||dummytaskhelper] task Remote requests D:f9d74e761ad1 created by task D:d790ab93e94f
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|6 UNIX /var/xapi/xapi|session.login_with_password D:49aa80495cc6|backtrace] Raised at db_rpc_client_v1.ml:39.14-41 -> db_actions.ml:7192.28-63
-> xapi_session.ml:363.57-91 -> xapi_session.ml:36.12-17 -> xapi_session.ml:36.67-68 -> server_helpers.ml:72.10-22
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|6 UNIX /var/xapi/xapi|session.login_with_password D:49aa80495cc6|dispatcher] Server_helpers.exec exception_handler: Got exception
UUID_INVALID: [ host; e32c5aa1-b129-4e0c-92ca-089268dc0ee9 ]
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|6 UNIX /var/xapi/xapi|session.login_with_password D:49aa80495cc6|dispatcher] Raised at string.ml:150.25-34 -> stringext.ml:108.13-29
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|6 UNIX /var/xapi/xapi|session.login_with_password D:49aa80495cc6|backtrace] Raised at string.ml:150.25-34 -> stringext.ml:108.13-29
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|6 UNIX /var/xapi/xapi|session.login_with_password D:49aa80495cc6|xapi] Raised at server_helpers.ml:94.14-15 -> pervasiveext.ml:22.2-9
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|6 UNIX /var/xapi/xapi|session.login_with_password D:49aa80495cc6|xapi] Raised at pervasiveext.ml:26.22-25 -> pervasiveext.ml:22.2-9
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|6 UNIX /var/xapi/xapi|dispatch:session.login_with_password D:f5474e285cad|xapi] Raised at pervasiveext.ml:26.22-25 -> pervasiveext.ml:22.2-9
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|6 UNIX /var/xapi/xapi|dispatch:session.login_with_password D:f5474e285cad|backtrace] Raised at pervasiveext.ml:26.22-25 -> server_helpers.ml:140.10-106
-> server.ml:501.19-183 -> server_helpers.ml:119.4-7
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|xapi] Attempting to acquire a management IP address
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|mscgen] xapi=>networkd [label="Interface.get_ipv4_addr"];
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|xapi] Acquired management IP address: 192.168.2.27
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|xapi] Attempting to communicate with master
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|mscgen] xapi=>xapi [label="<methodCall><methodName>session.slave_local_login</methodName><params><param><value>b7ab33f3-8864-a7fc-4c68-ea3d4741e37c/d8392808-edbf-9d6e-573a-993a12570e3b/d3227802-ec5c-6eeb-80d8-e1bac35c20ac</value></param></params></methodCall>"];
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|stunnel] Using commandline: /usr/sbin/stunnel -fd 3b0e7995-8114-e0e7-2d1b-bdea55aae31e
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|stunnel] stunnel has pidty: (FEFork (18,7253))
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|stunnel] stunnel start
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|xmlrpc_client] stunnel pid: 7253 (cached = false) connected to 192.168.2.26:443
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|xmlrpc_client] with_recorded_stunnelpid task_opt=None s_pid=7253
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|mscgen] xapi=>xapi [label="<methodCall><methodName>pool.hello</methodName><params><param><value>OpaqueRef:310d373c-0430-04be-8f3f-fbf9009a4879</value></param><param><value>e32c5aa1-b129-4e0c-92ca-089268dc0ee9</value></param><param><value>192.168.2.27</value></param></params></methodCall>"];
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|stunnel] Using commandline: /usr/sbin/stunnel -fd 06d7eda5-2a57-d147-2dae-ec097936e8c3
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|stunnel] stunnel has pidty: (FEFork (18,7257))
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|stunnel] stunnel start
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|xmlrpc_client] stunnel pid: 7257 (cached = false) connected to 192.168.2.26:443
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|xmlrpc_client] with_recorded_stunnelpid task_opt=None s_pid=7257
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|xapi] Master claims he has no record of us being a slave
Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|mscgen] xapi=>xapi [label="<methodCall><methodName>session.local_logout</methodName><params><param><value>OpaqueRef:310d373c-0430-04be-8f3f-fbf9009a4879</value></param></params></methodCall>"];---
---
UPDATE: did this a second time without defining a default local storage repo (but changed my storage repos from EXT to LVM), and I got the same result. This time I’ve saved the logs (all of /var/log)… let me know which might be useful.
- Brian Menges
Principal Engineer, DevOps
GoGrid | ServePath | ColoServe | UpStream Networks
