[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Xen-API] Odd state when joining pool with two default local storage repositories


  • To: "xen-api@xxxxxxxxxxxxx" <xen-api@xxxxxxxxxxxxx>
  • From: Brian Menges <bmenges@xxxxxxxxxx>
  • Date: Thu, 18 Oct 2012 11:24:55 -0700
  • Accept-language: en-US
  • Acceptlanguage: en-US
  • Delivery-date: Thu, 18 Oct 2012 18:25:12 +0000
  • Domainkey-signature: a=rsa-sha1; q=dns; c=nofws; s=january; d=gogrid.com; h=Received:Received:From:To:Date:Subject:Thread-Topic:Thread-Index:Message-ID:Accept-Language:Content-Language:X-MS-Has-Attach:X-MS-TNEF-Correlator:acceptlanguage:Content-Type:MIME-Version; b=LzgMXUQVJvZKlvI/hXhujd/inIAbU8Q/ETjCrTau5hZ1zf5NS6DfSwNHJSB1knj9qXdp/je1yP9gtC5LAT621rffFMiEkYaq3UEXMceiOOlf/SE22P1gIHPB3WpmwL5S;
  • List-id: User and development list for XCP and XAPI <xen-api.lists.xen.org>
  • Thread-index: Ac2tXd80NYNNRKI9TxiyeQAgm0E0VA==
  • Thread-topic: Odd state when joining pool with two default local storage repositories

I’ve installed two like-hosts with XCP 1.6, created a pool, and after telling my second host to join the pool the whole thing gets into a very odd state. The pool master knows about some of the storage repos of the second host, but cannot communicate with it, and isn’t listed in xencenter. The second host cannot be reached by xencenter anymore, and doesn’t think it is a member of the pool, even after a reboot.

 

I get into this state when I have a server join the pool, and each server has a locally defined default ‘Local storage’ SR, or when neither have a default storage repository. When ONLY one host doesn’t have a ‘default’ marker on the SR ‘Local storage’ it joins fine, and is a member.

 

NOTE: I know this will be tagged as the “reason”, but I do have to perform a forced pool join due to a mismatch in the ‘stepping’ between my cpus. I feel this is extremely minor, they’re both the same model, just different stepping numbers (6 vs 10). This shouldn’t be the reason why.

 

If you’d like logs, then I’ll have to rebuild a new cluster, but the only way I’ve seen to resolve this is not define a default on more than one intended pool member, and join them. Also once I get into this state, I have to re-format/install because the master won’t destroy/leave the pool, and the other server won’t join because of an error message: (“’NoneType’ object has no attribute ‘xenapi’”,)

 

Let me know what might be useful, here’s an example of it unable to communicate in the logs:

 

---

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Reading config file]

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Reading config file D:bcd08e8573be created by task D:d790ab93e94f

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Reading config file D:bcd08e8573be|config_shared] Disabling logging for: http

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Reading config file D:bcd08e8573be|config_shared] Disabling logging for: db_write

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Reading config file D:bcd08e8573be|config_shared] Disabling logging for: redo_log

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Reading external global variables definition]

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Reading external global variables definition D:e04155f8aa81 created by task D:d790ab93e94f

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [XAPI SERVER STARTING]

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task XAPI SERVER STARTING D:ed55d35743b8 created by task D:d790ab93e94f

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|XAPI SERVER STARTING D:ed55d35743b8|xapi] pool_role=slave:192.168.2.26

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Parsing inventory file]

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Parsing inventory file D:d98a4de00be2 created by task D:d790ab93e94f

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Initialising local database]

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Initialising local database D:246722c23497 created by task D:d790ab93e94f

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Initialising local database D:246722c23497|hashtbl_xml] Converting dtd

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Initialising local database D:246722c23497|localdb] host_disabled_until_reboot = false

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Initialising local database D:246722c23497|localdb] this_node_just_became_master = false

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Initialising local database D:246722c23497|localdb] host_restarted_cleanly = false

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Initialising local database D:246722c23497|localdb] master_scripts = false

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Initialising local database D:246722c23497|localdb] ha.armed = false

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Loading DHCP leases]

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Loading DHCP leases D:a579dfaf8357 created by task D:d790ab93e94f

Oct 18 09:15:33 xs-02 xapi: [ info|xs-02.dde.gogrid.net|0 thread_zero|Loading DHCP leases D:a579dfaf8357|xapi_udhcpd] Caught exception Unix.Unix_error(20, "open", "/var/xapi/dhcp-leases.db") loading /var/xapi/dhcp-leases.db: creating new empty leases database

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Reading pool secret]

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Reading pool secret D:bf33756caa9b created by task D:d790ab93e94f

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Logging xapi version info]

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Logging xapi version info D:71038c9b733c created by task D:d790ab93e94f

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Logging xapi version info D:71038c9b733c|xapi] Server configuration:

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Logging xapi version info D:71038c9b733c|xapi] platform_version: 1.6.06

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Logging xapi version info D:71038c9b733c|xapi] platform_name: XCP

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Logging xapi version info D:71038c9b733c|xapi] build_number: 61002c

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Logging xapi version info D:71038c9b733c|xapi] git changeset:

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Logging xapi version info D:71038c9b733c|xapi] version: 1.3

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Logging xapi version info D:71038c9b733c|xapi] use-xenopsd: true

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Setting signal handlers]

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Setting signal handlers D:b9e514546ef6 created by task D:d790ab93e94f

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Initialising random number generator]

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Initialising random number generator D:b754cadd6b4f created by task D:d790ab93e94f

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Running startup check]

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Running startup check D:3c90a6ab7aa7 created by task D:d790ab93e94f

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Running startup check D:3c90a6ab7aa7|xapi] Binary appears to be correctly linked

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Initialising SM state]

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Initialising SM state D:17b7be421e02 created by task D:d790ab93e94f

Oct 18 09:15:33 xs-02 xapi: [ info|xs-02.dde.gogrid.net|0 thread_zero|Initialising SM state D:17b7be421e02|storage_impl] No storage state is persisted in /var/run/nonpersistent/xapi/storage.db; creating blank database

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Starting SM internal event service]

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Starting SM internal event service D:d0aef07a81d6 created by task D:d790ab93e94f

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Starting SM service]

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|1||storage] Scheduler sleep until 1350580534 (another 3600 seconds)

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Starting SM service D:0f6f55e6132f created by task D:d790ab93e94f

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Starting SM xapi event service]

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Starting SM xapi event service D:0c269e2f8574 created by task D:d790ab93e94f

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Registering http handlers]

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Registering http handlers D:0d6e49963c6d created by task D:d790ab93e94f

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Listening unix socket]

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Listening unix socket D:70e8ca2e9195 created by task D:d790ab93e94f

Oct 18 09:15:33 xs-02 xapi: [ info|xs-02.dde.gogrid.net|0 thread_zero|Listening unix socket D:70e8ca2e9195|xapi] Successfully bound socket to: UNIX /var/xapi/xapi

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Checking HA configuration]

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Checking HA configuration D:b14fa653a0c2 created by task D:d790ab93e94f

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Checking for non-HA redo-log]

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Checking for non-HA redo-log D:33225a1d0e58 created by task D:d790ab93e94f

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [Setup DB configuration]

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task Setup DB configuration D:d0df4dadff1f created by task D:d790ab93e94f

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Setup DB configuration D:d0df4dadff1f|xapi] parsing db config file

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Setup DB configuration D:d0df4dadff1f|xapi] [/var/xapi/state.db]

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Setup DB configuration D:d0df4dadff1f|xapi] mode:no_limit

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Setup DB configuration D:d0df4dadff1f|xapi] format:xml

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Setup DB configuration D:d0df4dadff1f|xapi] compress:false

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Setup DB configuration D:d0df4dadff1f|xapi] is_on_remote_storage:false

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Setup DB configuration D:d0df4dadff1f|xapi] available_this_boot:true

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Setup DB configuration D:d0df4dadff1f|xapi] format:xml

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|Setup DB configuration D:d0df4dadff1f|xapi]

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [bringing up management interface]

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|dummytaskhelper] task bringing up management interface D:2c0efe3501de created by task D:d790ab93e94f

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|bringing up management interface D:2c0efe3501de|xapi] Starting new server

Oct 18 09:15:33 xs-02 xapi: [error|xs-02.dde.gogrid.net|0 thread_zero|bringing up management interface D:2c0efe3501de|master_connection] Caught Master_connection.Goto_handler

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|bringing up management interface D:2c0efe3501de|master_connection] Connection to master died. I will continue to retry indefinitely (supressing future logging of this message).

Oct 18 09:15:33 xs-02 xapi: [error|xs-02.dde.gogrid.net|0 thread_zero|bringing up management interface D:2c0efe3501de|master_connection] Connection to master died. I will continue to retry indefinitely (supressing future logging of this message).

Oct 18 09:15:33 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|bringing up management interface D:2c0efe3501de|master_connection] Sleeping 2.000000 seconds before retrying master connection...

Oct 18 09:15:33 xs-02 /opt/xensource/libexec/xcp-rrdd: [debug|xs-02.dde.gogrid.net|0 monitor|main|rrdd_monitor] Creating fresh RRD for VM uuid=afbbf737-5e8c-4bf4-91ab-8408f910fdc3

Oct 18 09:15:33 xs-02 /opt/xensource/libexec/xcp-rrdd: [debug|xs-02.dde.gogrid.net|0 monitor|main|rrdd_monitor] Sending back RRD for VM uuid=00000000-0000-0000-0000-000000000000

Oct 18 09:15:33 xs-02 /opt/xensource/libexec/xcp-rrdd: [debug|xs-02.dde.gogrid.net|0 monitor|main|rrdd_shared] Archiving RRD for object uuid=00000000-0000-0000-0000-000000000000 to remote master

Oct 18 09:15:33 xs-02 /opt/xensource/libexec/xcp-rrdd: [debug|xs-02.dde.gogrid.net|0 monitor|main|rrdd_shared] About to send to master.

Oct 18 09:15:33 xs-02 /opt/xensource/libexec/xcp-rrdd: [debug|xs-02.dde.gogrid.net|0 monitor|main|rrdd_shared] Sending RRD for object uuid=00000000-0000-0000-0000-000000000000 archiving=true to address: 192.168.2.26

Oct 18 09:15:33 xs-02 /opt/xensource/libexec/xcp-rrdd: [debug|xs-02.dde.gogrid.net|0 monitor|main|stunnel] Using commandline: /usr/sbin/stunnel -fd 355c3b40-cdf1-aca3-93b9-1a09f49dbee1

Oct 18 09:15:33 xs-02 /opt/xensource/libexec/xcp-rrdd: [debug|xs-02.dde.gogrid.net|0 monitor|main|stunnel] stunnel has pidty: (FEFork (15,7050))

Oct 18 09:15:33 xs-02 /opt/xensource/libexec/xcp-rrdd: [debug|xs-02.dde.gogrid.net|0 monitor|main|stunnel] stunnel start

Oct 18 09:15:33 xs-02 /opt/xensource/libexec/xcp-rrdd: [debug|xs-02.dde.gogrid.net|0 monitor|main|xmlrpc_client] stunnel pid: 7050 (cached = false) connected to 192.168.2.26:443

Oct 18 09:15:33 xs-02 /opt/xensource/libexec/xcp-rrdd: [debug|xs-02.dde.gogrid.net|0 monitor|main|xmlrpc_client] with_recorded_stunnelpid task_opt=None s_pid=7050

Oct 18 09:15:34 xs-02 /opt/xensource/libexec/xcp-rrdd: [ warn|xs-02.dde.gogrid.net|0 monitor|main|xmlrpc_client] stunnel pid: 7050 caught Http_client.Http_request_rejected("404: { frame = false; method = PUT; uri = /rrd; query = [ archive=true; uuid=00000000-0000-0000-0000-000000000000 ]; content_length = [  ]; transfer encoding = ; version = 1.0; cookie = [ pool_secret=b7ab33f3-8864-a7fc-4c68-ea3d4741e37c/d8392808-edbf-9d6e-573a-993a12570e3b/d3227802-ec5c-6eeb-80d8-e1bac35c20ac ]; task = ; subtask_of = ; content-type = ; host = ; user_agent = xapi/1.3 }")

Oct 18 09:15:34 xs-02 /opt/xensource/libexec/xcp-rrdd: [debug|xs-02.dde.gogrid.net|0 monitor|main|rrdd_main] Monitor thread caught an exception. Pausing for 10s, then restarting.

Oct 18 09:15:34 xs-02 /opt/xensource/libexec/xcp-rrdd: [debug|xs-02.dde.gogrid.net|0 monitor|main|rrdd_main] Raised at http_client.ml:166.21-83 -> http_client.ml:175.4-75 -> xmlrpc_client.ml:258.2-63 -> xmlrpc_client.ml:237.7-10 -> xmlrpc_client.ml:242.13-14 -> pervasiveext.ml:22.2-9 -> pervasiveext.ml:26.22-25 -> pervasiveext.ml:22.2-9 -> pervasiveext.ml:26.22-25 -> rrdd_shared.ml:120.1-131 -> list.ml:69.12-15 -> pervasiveext.ml:22.2-9 -> pervasiveext.ml:26.22-25 -> rrdd_main.ml:591.4-17

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|bringing up management interface D:2c0efe3501de|master_connection] stunnel: Using commandline: /usr/sbin/stunnel -fd ce4b99ec-9f06-9d25-c3df-993f25a295af 

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|bringing up management interface D:2c0efe3501de|master_connection] stunnel: stunnel has pidty: (FEFork (19,7242))

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|bringing up management interface D:2c0efe3501de|master_connection] stunnel: stunnel start

Oct 18 09:15:35 xs-02 xapi: [ info|xs-02.dde.gogrid.net|0 thread_zero|bringing up management interface D:2c0efe3501de|master_connection] stunnel connected pid=7242 fd=16

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|bringing up management interface D:2c0efe3501de|backtrace] Raised at db_rpc_client_v1.ml:39.14-41 -> db_actions.ml:7192.28-63 -> xapi_mgmt_iface.ml:52.17-49 -> threadext.ml:20.20-24 -> threadext.ml:20.62-65 -> xapi.ml:310.3-71

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|bringing up management interface D:2c0efe3501de|xapi] Caught exception bringing up management interface: UUID_INVALID: [ host; e32c5aa1-b129-4e0c-92ca-089268dc0ee9 ]

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [starting thread Starting periodic scheduler]

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|startup] task [starting thread Remote requests]

Oct 18 09:15:35 xs-02 xapi: [ info|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|xapi] Running in 'Pool Slave' mode

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|xapi] Running in 'Pool Slave' mode

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|5 UNIX /var/xapi/xapi|session.login_with_password D:b00f1a1b3a11|backtrace] Raised at db_rpc_client_v1.ml:39.14-41 -> db_actions.ml:7192.28-63 -> xapi_session.ml:363.57-91 -> xapi_session.ml:36.12-17 -> xapi_session.ml:36.67-68 -> server_helpers.ml:72.10-22

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|5 UNIX /var/xapi/xapi|session.login_with_password D:b00f1a1b3a11|dispatcher] Server_helpers.exec exception_handler: Got exception UUID_INVALID: [ host; e32c5aa1-b129-4e0c-92ca-089268dc0ee9 ]

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|7||dummytaskhelper] task Starting periodic scheduler D:5a6404e4d45b created by task D:d790ab93e94f

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|5 UNIX /var/xapi/xapi|session.login_with_password D:b00f1a1b3a11|dispatcher] Raised at string.ml:150.25-34 -> stringext.ml:108.13-29

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|5 UNIX /var/xapi/xapi|session.login_with_password D:b00f1a1b3a11|backtrace] Raised at string.ml:150.25-34 -> stringext.ml:108.13-29

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|5 UNIX /var/xapi/xapi|session.login_with_password D:b00f1a1b3a11|xapi] Raised at server_helpers.ml:94.14-15 -> pervasiveext.ml:22.2-9

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|5 UNIX /var/xapi/xapi|session.login_with_password D:b00f1a1b3a11|xapi] Raised at pervasiveext.ml:26.22-25 -> pervasiveext.ml:22.2-9

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|5 UNIX /var/xapi/xapi|dispatch:session.login_with_password D:0ae69a1a4b95|xapi] Raised at pervasiveext.ml:26.22-25 -> pervasiveext.ml:22.2-9

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|5 UNIX /var/xapi/xapi|dispatch:session.login_with_password D:0ae69a1a4b95|backtrace] Raised at pervasiveext.ml:26.22-25 -> server_helpers.ml:140.10-106 -> server.ml:501.19-183 -> server_helpers.ml:119.4-7

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|7|Starting periodic scheduler D:5a6404e4d45b|backgroundscheduler] Periodic scheduler started

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|8||dummytaskhelper] task Remote requests D:f9d74e761ad1 created by task D:d790ab93e94f

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|6 UNIX /var/xapi/xapi|session.login_with_password D:49aa80495cc6|backtrace] Raised at db_rpc_client_v1.ml:39.14-41 -> db_actions.ml:7192.28-63 -> xapi_session.ml:363.57-91 -> xapi_session.ml:36.12-17 -> xapi_session.ml:36.67-68 -> server_helpers.ml:72.10-22

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|6 UNIX /var/xapi/xapi|session.login_with_password D:49aa80495cc6|dispatcher] Server_helpers.exec exception_handler: Got exception UUID_INVALID: [ host; e32c5aa1-b129-4e0c-92ca-089268dc0ee9 ]

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|6 UNIX /var/xapi/xapi|session.login_with_password D:49aa80495cc6|dispatcher] Raised at string.ml:150.25-34 -> stringext.ml:108.13-29

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|6 UNIX /var/xapi/xapi|session.login_with_password D:49aa80495cc6|backtrace] Raised at string.ml:150.25-34 -> stringext.ml:108.13-29

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|6 UNIX /var/xapi/xapi|session.login_with_password D:49aa80495cc6|xapi] Raised at server_helpers.ml:94.14-15 -> pervasiveext.ml:22.2-9

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|6 UNIX /var/xapi/xapi|session.login_with_password D:49aa80495cc6|xapi] Raised at pervasiveext.ml:26.22-25 -> pervasiveext.ml:22.2-9

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|6 UNIX /var/xapi/xapi|dispatch:session.login_with_password D:f5474e285cad|xapi] Raised at pervasiveext.ml:26.22-25 -> pervasiveext.ml:22.2-9

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|6 UNIX /var/xapi/xapi|dispatch:session.login_with_password D:f5474e285cad|backtrace] Raised at pervasiveext.ml:26.22-25 -> server_helpers.ml:140.10-106 -> server.ml:501.19-183 -> server_helpers.ml:119.4-7

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|xapi] Attempting to acquire a management IP address

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|mscgen] xapi=>networkd [label="Interface.get_ipv4_addr"];

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|xapi] Acquired management IP address: 192.168.2.27

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|xapi] Attempting to communicate with master

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|mscgen] xapi=>xapi [label="<methodCall><methodName>session.slave_local_login</methodName><params><param><value>b7ab33f3-8864-a7fc-4c68-ea3d4741e37c/d8392808-edbf-9d6e-573a-993a12570e3b/d3227802-ec5c-6eeb-80d8-e1bac35c20ac</value></param></params></methodCall>"];

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|stunnel] Using commandline: /usr/sbin/stunnel -fd 3b0e7995-8114-e0e7-2d1b-bdea55aae31e

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|stunnel] stunnel has pidty: (FEFork (18,7253))

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|stunnel] stunnel start

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|xmlrpc_client] stunnel pid: 7253 (cached = false) connected to 192.168.2.26:443

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|xmlrpc_client] with_recorded_stunnelpid task_opt=None s_pid=7253

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|mscgen] xapi=>xapi [label="<methodCall><methodName>pool.hello</methodName><params><param><value>OpaqueRef:310d373c-0430-04be-8f3f-fbf9009a4879</value></param><param><value>e32c5aa1-b129-4e0c-92ca-089268dc0ee9</value></param><param><value>192.168.2.27</value></param></params></methodCall>"];

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|stunnel] Using commandline: /usr/sbin/stunnel -fd 06d7eda5-2a57-d147-2dae-ec097936e8c3

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|stunnel] stunnel has pidty: (FEFork (18,7257))

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|stunnel] stunnel start

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|xmlrpc_client] stunnel pid: 7257 (cached = false) connected to 192.168.2.26:443

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|xmlrpc_client] with_recorded_stunnelpid task_opt=None s_pid=7257

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|xapi] Master claims he has no record of us being a slave

Oct 18 09:15:35 xs-02 xapi: [debug|xs-02.dde.gogrid.net|0 thread_zero|server_init D:d790ab93e94f|mscgen] xapi=>xapi [label="<methodCall><methodName>session.local_logout</methodName><params><param><value>OpaqueRef:310d373c-0430-04be-8f3f-fbf9009a4879</value></param></params></methodCall>"];---

---

 

UPDATE: did this a second time without defining a default local storage repo (but changed my storage repos from EXT to LVM), and I got the same result. This time I’ve saved the logs (all of /var/log)… let me know which might be useful.

 

 

 

- Brian Menges

Principal Engineer, DevOps

GoGrid | ServePath | ColoServe | UpStream Networks

 



The information contained in this message, and any attachments, may contain confidential and legally privileged material. It is solely for the use of the person or entity to which it is addressed. Any review, retransmission, dissemination, or action taken in reliance upon this information by persons or entities other than the intended recipient is prohibited. If you receive this in error, please contact the sender and delete the material from any computer.
_______________________________________________
Xen-api mailing list
Xen-api@xxxxxxxxxxxxx
http://lists.xen.org/cgi-bin/mailman/listinfo/xen-api

 


Rackspace

Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.