[Top] [All Lists]
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Xen-API] Storage XenMotion

Good day.

Unfortunately it corrupts VHD after Storage XenMotion. Pure installation of XenServer 6.2, empty source nfs-based SR (one VHD), absolutely empty target SR.

Got this (too scary to put near product within range of 50km):


Aug 23 17:36:09 lab-xvg4 SMGC: [10848] Starting asynch srUpdate for SR 8673efcb-8f37-66a1-2e4b-869ebfc65123
Aug 23 17:36:09 lab-xvg4 SM: [11098] sr_update {'sr_uuid': '8673efcb-8f37-66a1-2e4b-869ebfc65123', 'subtask_of': 'OpaqueRef:eec2850c-911e-6f8d-7f51-90d582d9be85', 'args': [], 'host_ref': 'OpaqueRef:a74a78be-51a6-4074-0200-b84f461cbb34', 'session_ref': 'OpaqueRef:121950cd-7eef-8461-4a75-ee6dcf40a890', 'device_config': {'SRmaster': 'true', 'serverpath': '/vol/groundhog-sr/', 'server': '192.168.3.250'}, 'command': 'sr_update', 'sr_ref': 'OpaqueRef:529d6557-ca7d-9078-b0e0-83979ca62cae'}
Aug 23 17:36:09 lab-xvg4 SM: [11098] lock: closed /var/lock/sm/8673efcb-8f37-66a1-2e4b-869ebfc65123/sr
Aug 23 17:36:10 lab-xvg4 SMGC: [10848] SR.update_asynch status changed to [success]
Aug 23 17:36:10 lab-xvg4 SM: [10848] lock: released /var/lock/sm/8673efcb-8f37-66a1-2e4b-869ebfc65123/running
Aug 23 17:36:10 lab-xvg4 SM: [10848] lock: tried lock /var/lock/sm/8673efcb-8f37-66a1-2e4b-869ebfc65123/sr, acquired: True (exists: True)
Aug 23 17:36:10 lab-xvg4 SM: [10848] ['/usr/bin/vhd-util', 'scan', '-f', '-c', '-m', '/var/run/sr-mount/8673efcb-8f37-66a1-2e4b-869ebfc65123/*.vhd']
Aug 23 17:36:10 lab-xvg4 SM: [10848]   pread SUCCESS
Aug 23 17:36:10 lab-xvg4 SMGC: [10848] SR 8673 ('nfssr') (3 VDIs in 1 VHD trees): no changes
Aug 23 17:36:10 lab-xvg4 SM: [10848] lock: released /var/lock/sm/8673efcb-8f37-66a1-2e4b-869ebfc65123/sr
Aug 23 17:36:10 lab-xvg4 SMGC: [10848] Removed vhd-blocks from *c8e03791(3.000G/24.055M)
Aug 23 17:36:10 lab-xvg4 SMGC: [10848] Got sm-config for *c8e03791(3.000G/24.055M): {'vhd-parent': '121364ab-8ec5-44c6-a3f0-543b700680db'}
Aug 23 17:36:10 lab-xvg4 SM: [10848] ['/usr/bin/vhd-util', 'read', '--debug', '-B', '-n', '/var/run/sr-mount/8673efcb-8f37-66a1-2e4b-869ebfc65123/c8e03791-5985-4239-9915-40c902050f26.vhd']
Aug 23 17:36:10 lab-xvg4 SM: [10848]   pread SUCCESS
Aug 23 17:36:10 lab-xvg4 SMGC: [10848] Set vhd-blocks = eJxjYMAOHAiIo8uj813AYg5wcQUonYDDXHIBABzvAoU= for *c8e03791(3.000G/24.055M)
Aug 23 17:36:10 lab-xvg4 SMGC: [10848] Got sm-config for *c8e03791(3.000G/24.055M): {'vhd-parent': '121364ab-8ec5-44c6-a3f0-543b700680db', 'vhd-blocks': 'eJxjYMAOHAiIo8uj813AYg5wcQUonYDDXHIBABzvAoU='}
Aug 23 17:36:10 lab-xvg4 SMGC: [10848] Got sm-config for *121364ab(3.000G/1.100G): {'base_mirror': 'b5a5ee83-697c-05dd-67d6-755c76ba196f/1054e6d8-4f3b-4de8-a33b-a2d80c59d0a7', 'vhd-blocks': 'eJz7//JPBxD86DzAgAISoLQDC5gEQiAAstNb6v///8fClu4CpP+7OLhAVaS4QABIFB08S0tLA4l/AcqnQ8WefylxP+JS45bmlg4U+5f+z6X+i5tLCktJChC4pLg4QKwFIagLILQLAwuQZmFxgLoPADwhRyY='}
Aug 23 17:36:10 lab-xvg4 SMGC: [10848] Num combined blocks = 562
Aug 23 17:36:10 lab-xvg4 SMGC: [10848] Coalesced size = 1.100G
Aug 23 17:36:10 lab-xvg4 SMGC: [10848] Coalesce candidate: *c8e03791(3.000G/24.055M) (tree height 3)
Aug 23 17:36:10 lab-xvg4 SM: [10848] lock: tried lock /var/lock/sm/8673efcb-8f37-66a1-2e4b-869ebfc65123/running, acquired: True (exists: True)
Aug 23 17:36:10 lab-xvg4 SM: [10848] lock: tried lock /var/lock/sm/8673efcb-8f37-66a1-2e4b-869ebfc65123/sr, acquired: True (exists: True)
Aug 23 17:36:10 lab-xvg4 SM: [10848] ['/usr/bin/vhd-util', 'scan', '-f', '-c', '-m', '/var/run/sr-mount/8673efcb-8f37-66a1-2e4b-869ebfc65123/*.vhd']
Aug 23 17:36:10 lab-xvg4 SM: [10848]   pread SUCCESS
Aug 23 17:36:10 lab-xvg4 SMGC: [10848] SR 8673 ('nfssr') (3 VDIs in 1 VHD trees): no changes
Aug 23 17:36:10 lab-xvg4 SM: [10848] lock: released /var/lock/sm/8673efcb-8f37-66a1-2e4b-869ebfc65123/sr
Aug 23 17:36:10 lab-xvg4 SMGC: [10848] Got sm-config for *c8e03791(3.000G/24.055M): {'vhd-parent': '121364ab-8ec5-44c6-a3f0-543b700680db', 'vhd-blocks': 'eJxjYMAOHAiIo8uj813AYg5wcQUonYDDXHIBABzvAoU='}
Aug 23 17:36:10 lab-xvg4 SMGC: [10848] Got sm-config for *121364ab(3.000G/1.100G): {'base_mirror': 'b5a5ee83-697c-05dd-67d6-755c76ba196f/1054e6d8-4f3b-4de8-a33b-a2d80c59d0a7', 'vhd-blocks': 'eJz7//JPBxD86DzAgAISoLQDC5gEQiAAstNb6v///8fClu4CpP+7OLhAVaS4QABIFB08S0tLA4l/AcqnQ8WefylxP+JS45bmlg4U+5f+z6X+i5tLCktJChC4pLg4QKwFIagLILQLAwuQZmFxgLoPADwhRyY='}
Aug 23 17:36:10 lab-xvg4 SMGC: [10848] Removed vhd-blocks from *c8e03791(3.000G/24.055M)
Aug 23 17:36:10 lab-xvg4 SMGC: [10848] Got sm-config for *c8e03791(3.000G/24.055M): {'vhd-parent': '121364ab-8ec5-44c6-a3f0-543b700680db'}
Aug 23 17:36:10 lab-xvg4 SM: [10848] ['/usr/bin/vhd-util', 'read', '--debug', '-B', '-n', '/var/run/sr-mount/8673efcb-8f37-66a1-2e4b-869ebfc65123/c8e03791-5985-4239-9915-40c902050f26.vhd']
Aug 23 17:36:10 lab-xvg4 SM: [10848]   pread SUCCESS
Aug 23 17:36:10 lab-xvg4 SMGC: [10848] Set vhd-blocks = eJxjYMAOHAiIo8uj813AYg5wcQUonYDDXHIBABzvAoU= for *c8e03791(3.000G/24.055M)
Aug 23 17:36:10 lab-xvg4 SMGC: [10848] Got sm-config for *c8e03791(3.000G/24.055M): {'vhd-parent': '121364ab-8ec5-44c6-a3f0-543b700680db', 'vhd-blocks': 'eJxjYMAOHAiIo8uj813AYg5wcQUonYDDXHIBABzvAoU='}
Aug 23 17:36:10 lab-xvg4 SMGC: [10848] Got sm-config for *121364ab(3.000G/1.100G): {'base_mirror': 'b5a5ee83-697c-05dd-67d6-755c76ba196f/1054e6d8-4f3b-4de8-a33b-a2d80c59d0a7', 'vhd-blocks': 'eJz7//JPBxD86DzAgAISoLQDC5gEQiAAstNb6v///8fClu4CpP+7OLhAVaS4QABIFB08S0tLA4l/AcqnQ8WefylxP+JS45bmlg4U+5f+z6X+i5tLCktJChC4pLg4QKwFIagLILQLAwuQZmFxgLoPADwhRyY='}
Aug 23 17:36:10 lab-xvg4 SMGC: [10848] Num combined blocks = 562
Aug 23 17:36:10 lab-xvg4 SMGC: [10848] Coalesced size = 1.100G
Aug 23 17:36:10 lab-xvg4 SMGC: [10848] Coalesce candidate: *c8e03791(3.000G/24.055M) (tree height 3)
Aug 23 17:36:10 lab-xvg4 SMGC: [10848] Coalescing *c8e03791(3.000G/24.055M) -> *121364ab(3.000G/1.100G)
Aug 23 17:36:10 lab-xvg4 SM: [10848] ['/usr/bin/vhd-util', 'check', '--debug', '-n', '/var/run/sr-mount/8673efcb-8f37-66a1-2e4b-869ebfc65123/c8e03791-5985-4239-9915-40c902050f26.vhd']
Aug 23 17:36:10 lab-xvg4 SM: [10848] FAILED in util.pread: (rc 22) stdout: 'differencing header is invalid: parent creation time in future
Aug 23 17:36:10 lab-xvg4 SM: [10848] /var/run/sr-mount/8673efcb-8f37-66a1-2e4b-869ebfc65123/c8e03791-5985-4239-9915-40c902050f26.vhd appears invalid; dumping metadata
Aug 23 17:36:10 lab-xvg4 SM: [10848] VHD Footer Summary:
Aug 23 17:36:10 lab-xvg4 SM: [10848] -------------------
Aug 23 17:36:10 lab-xvg4 SM: [10848] Cookie              : conectix
Aug 23 17:36:10 lab-xvg4 SM: [10848] Features            : (0x00000002) <RESV>
Aug 23 17:36:10 lab-xvg4 SM: [10848] File format version : Major: 1, Minor: 0
Aug 23 17:36:10 lab-xvg4 SM: [10848] Data offset         : 512
Aug 23 17:36:10 lab-xvg4 SM: [10848] Timestamp           : Fri Aug 23 17:32:15 2013
Aug 23 17:36:10 lab-xvg4 SM: [10848] Creator Application : 'tap'
Aug 23 17:36:10 lab-xvg4 SM: [10848] Creator version     : Major: 1, Minor: 3
Aug 23 17:36:10 lab-xvg4 SM: [10848] Creator OS          : Unknown!
Aug 23 17:36:10 lab-xvg4 SM: [10848] Original disk size  : 3072 MB (3221225472 Bytes)
Aug 23 17:36:10 lab-xvg4 SM: [10848] Current disk size   : 3072 MB (3221225472 Bytes)
Aug 23 17:36:10 lab-xvg4 SM: [10848] Geometry            : Cyl: 6241, Hds: 16, Sctrs: 63
Aug 23 17:36:10 lab-xvg4 SM: [10848]                     : = 3071 MB (3220955136 Bytes)
Aug 23 17:36:10 lab-xvg4 SM: [10848] Disk type           : Differencing hard disk
Aug 23 17:36:10 lab-xvg4 SM: [10848] Checksum            : 0xffffeff7|0xffffeff7 (Good!)
Aug 23 17:36:10 lab-xvg4 SM: [10848] UUID                : 3c966502-afdd-4426-8295-ac2ab35bb074
Aug 23 17:36:10 lab-xvg4 SM: [10848] Saved state         : No
Aug 23 17:36:10 lab-xvg4 SM: [10848] Hidden              : 1
Aug 23 17:36:10 lab-xvg4 SM: [10848]
Aug 23 17:36:10 lab-xvg4 SM: [10848] VHD Header Summary:
Aug 23 17:36:10 lab-xvg4 SM: [10848] -------------------
Aug 23 17:36:10 lab-xvg4 SM: [10848] Cookie              : cxsparse
Aug 23 17:36:10 lab-xvg4 SM: [10848] Data offset (unusd) : 18446744073709
Aug 23 17:36:10 lab-xvg4 SM: [10848] Table offset        : 1536
Aug 23 17:36:10 lab-xvg4 SM: [10848] Header version      : 0x00010000
Aug 23 17:36:10 lab-xvg4 SM: [10848] Max BAT size        : 1536
Aug 23 17:36:10 lab-xvg4 SM: [10848] Block size          : 2097152 (2 MB)
Aug 23 17:36:10 lab-xvg4 SM: [10848] Parent name         : 121364ab-8ec5-44c6-a3f0-543b700680db.vhd
Aug 23 17:36:10 lab-xvg4 SM: [10848] Parent UUID         : fe69800f-11b2-4959-97c9-861b3f220ea4
Aug 23 17:36:10 lab-xvg4 SM: [10848] Parent timestamp    : Fri Aug 23 21:42:48 2013
Aug 23 17:36:10 lab-xvg4 SM: [10848] Checksum            : 0xffffdc4e|0xffffdc4e (Good!)
Aug 23 17:36:10 lab-xvg4 SM: [10848]
Aug 23 17:36:10 lab-xvg4 SM: [10848] VHD Parent Locators:
Aug 23 17:36:10 lab-xvg4 SM: [10848] --------------------
Aug 23 17:36:10 lab-xvg4 SM: [10848] locator:            : 0
Aug 23 17:36:10 lab-xvg4 SM: [10848]        code         : PLAT_CODE_MACX
Aug 23 17:36:10 lab-xvg4 SM: [10848]        data_space   : 512
Aug 23 17:36:10 lab-xvg4 SM: [10848]        data_length  : 49
Aug 23 17:36:10 lab-xvg4 SM: [10848]        data_offset  : 8704
Aug 23 17:36:10 lab-xvg4 SM: [10848]        decoded name : ./121364ab-8ec5-44c6-a3f0-543b700680db.vhd
Aug 23 17:36:10 lab-xvg4 SM: [10848]
Aug 23 17:36:10 lab-xvg4 SM: [10848] locator:            : 1
Aug 23 17:36:10 lab-xvg4 SM: [10848]        code         : PLAT_CODE_W2KU
Aug 23 17:36:10 lab-xvg4 SM: [10848]        data_space   : 512
Aug 23 17:36:10 lab-xvg4 SM: [10848]        data_length  : 84
Aug 23 17:36:10 lab-xvg4 SM: [10848]        data_offset  : 9216
Aug 23 17:36:10 lab-xvg4 SM: [10848]        decoded name : ./121364ab-8ec5-44c6-a3f0-543b700680db.vhd
Aug 23 17:36:10 lab-xvg4 SM: [10848]
Aug 23 17:36:10 lab-xvg4 SM: [10848] locator:            : 2
Aug 23 17:36:10 lab-xvg4 SM: [10848]        code         : PLAT_CODE_W2RU
Aug 23 17:36:10 lab-xvg4 SM: [10848]        data_space   : 512
Aug 23 17:36:10 lab-xvg4 SM: [10848]        data_length  : 84
Aug 23 17:36:10 lab-xvg4 SM: [10848]        data_offset  : 9728
Aug 23 17:36:10 lab-xvg4 SM: [10848]        decoded name : ./121364ab-8ec5-44c6-a3f0-543b700680db.vhd
Aug 23 17:36:10 lab-xvg4 SM: [10848]
Aug 23 17:36:10 lab-xvg4 SM: [10848] VHD Batmap Summary:
Aug 23 17:36:10 lab-xvg4 SM: [10848] -------------------
Aug 23 17:36:10 lab-xvg4 SM: [10848] Batmap offset       : 8192
Aug 23 17:36:10 lab-xvg4 SM: [10848] Batmap size (secs)  : 1
Aug 23 17:36:10 lab-xvg4 SM: [10848] Batmap version      : 0x00010002
Aug 23 17:36:10 lab-xvg4 SM: [10848] Checksum            : 0xffffffff|0xffffffff (Good!)
Aug 23 17:36:10 lab-xvg4 SM: [10848]
Aug 23 17:36:10 lab-xvg4 SM: [10848] ', stderr: ''
Aug 23 17:36:10 lab-xvg4 SMGC: [10848] *~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*
Aug 23 17:36:10 lab-xvg4 SMGC: [10848]          ***********************
Aug 23 17:36:10 lab-xvg4 SMGC: [10848]          *  E X C E P T I O N  *
Aug 23 17:36:10 lab-xvg4 SMGC: [10848]          ***********************
Aug 23 17:36:10 lab-xvg4 SMGC: [10848] coalesce: EXCEPTION util.SMException, VHD *c8e03791(3.000G/24.055M) corrupted
Aug 23 17:36:10 lab-xvg4 SMGC: [10848]   File "/opt/xensource/sm/cleanup.py", line 1414, in coalesce
Aug 23 17:36:10 lab-xvg4 SMGC: [10848]     self._coalesce(vdi)
Aug 23 17:36:10 lab-xvg4 SMGC: [10848]   File "/opt/xensource/sm/cleanup.py", line 1604, in _coalesce
Aug 23 17:36:10 lab-xvg4 SMGC: [10848]     vdi._doCoalesce()
Aug 23 17:36:10 lab-xvg4 SMGC: [10848]   File "/opt/xensource/sm/cleanup.py", line 663, in _doCoalesce
Aug 23 17:36:10 lab-xvg4 SMGC: [10848]     self.validate()
Aug 23 17:36:10 lab-xvg4 SMGC: [10848]   File "/opt/xensource/sm/cleanup.py", line 646, in validate
Aug 23 17:36:10 lab-xvg4 SMGC: [10848]     raise util.SMException("VHD %s corrupted" % self)
Aug 23 17:36:10 lab-xvg4 SMGC: [10848]
Aug 23 17:36:10 lab-xvg4 SMGC: [10848] *~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*
Aug 23 17:36:10 lab-xvg4 SMGC: [10848] Coalesce failed, skipping



On 23.08.2013 12:44, Bob Ball wrote:

It is possible, and present, however it is disabled by default because, as Jon said, it wasn’t considered necessary and therefore we didn’t enable it and test it to verify the functionality.

 

On the other hand, I have had success enabling it in specific scenarios, and while it is not a supported mode, if you’re using XCP I guess that you don’t have support from Citrix either way!

 

If you edit /opt/xensource/sm/cleanup.py, go to class FileSR and delete the “findLeafCoalesceable” method which simply returns None then it will use the base classes method and online leaf coalescing on EXT3 should work automatically.

 

Bob

 

From: xen-api-bounces@xxxxxxxxxxxxx [mailto:xen-api-bounces@xxxxxxxxxxxxx] On Behalf Of George Shuklin
Sent: 23 August 2013 08:52
To: Jonathan Ludlam
Cc: xen-api@xxxxxxxxxxxxxxxxxxx
Subject: Re: [Xen-API] Storage XenMotion

 

Good day.

It's kinda strange - newer version of XCP (1.6) and XenServer 6.2 had no anything related to leaf-coalesce. In XCP 1.1 there was plugin, in newer versions there is none.

... And manual vhd coalesce is really ugly way.


On 23.08.2013 03:50, Jonathan Ludlam wrote:

On an LVHD based SR, this should get automatically coalesced (so called 'online leaf-coalesce'). However, on file-based VHD SRs I believe the decision was taken not to do online leaf coalesce, as it wasn't felt necessary.

 

Having said that, you might find this link helps, though I haven't tried anything in it myself: http://support.citrix.com/article/CTX123400



Jon

 



Sent from my iPad


On 16 Aug 2013, at 14:51, "George Shuklin" <george.shuklin@xxxxxxxxx> wrote:

Good day.

After VDI migration there is base copy (vhd parent) disk for VDI's of newly migrated VM. I see no way to coalesce it back except manual operation with VHD (vhd-util coalesce -n VHD -o new.vhd, introducing it back to xapi and recreating VBD).

Is any way to do this?

Thanks.

_______________________________________________
Xen-api mailing list
Xen-api@xxxxxxxxxxxxx
http://lists.xen.org/cgi-bin/mailman/listinfo/xen-api

 


_______________________________________________
Xen-api mailing list
Xen-api@xxxxxxxxxxxxx
http://lists.xen.org/cgi-bin/mailman/listinfo/xen-api

 

©2013 Xen Project, A Linux Foundation Collaborative Project. All Rights Reserved.
Linux Foundation is a registered trademark of The Linux Foundation.
Xen Project is a trademark of The Linux Foundation.

Rackspace

Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.