Re: [Xen-API] Resizing VDI with Local Caching enabled

[Marco Sinhoreli <msinhore@xxxxxxxxx>]

Hi Andrei:

I've 4 hosts on pool. The did it in host master.

Need more info? please let me know.

Thanks



On Thu, Mar 24, 2011 at 4:15 PM, Andrei Lifchits
<Andrei.Lifchits@xxxxxxxxxx> wrote:
> Hi Marco,
>
> Would you mind also providing detailed repro steps for this? How many hosts 
> do you have in your pool? Which host did you do it on?
>
> Thanks,
> Andrei
>
> -----Original Message-----
> From: Marco Sinhoreli [mailto:msinhore@xxxxxxxxx]
> Sent: Thursday, March 24, 2011 5:04 PM
> To: Jonathan Davies
> Cc: Andrei Lifchits; xen-api
> Subject: Re: [Xen-API] Resizing VDI with Local Caching enabled
>
> Hi Jonathan:
>
> Bellow the /var/log/SMlog file content:
>
> <log>
>
> [6667] 2011-03-24 13:54:15.913428 Â Â Â ['/usr/sbin/tap-ctl', 'stats',
> '-p', '28818', '-m', '0']
> [6667] 2011-03-24 13:54:15.917045 Â Â Â Â= 0
> [6904] 2011-03-24 13:55:11.249673 Â Â Â ['/usr/sbin/tap-ctl', 'list']
> [6904] 2011-03-24 13:55:11.253768 Â Â Â Â= 0
> [6904] 2011-03-24 13:55:11.259516 Â Â Â ['/usr/sbin/tap-ctl', 'stats',
> '-p', '26360', '-m', '2']
> [6904] 2011-03-24 13:55:11.263313 Â Â Â Â= 0
> [6904] 2011-03-24 13:55:11.263955 Â Â Â ['/usr/sbin/tap-ctl', 'stats',
> '-p', '28818', '-m', '0']
> [6904] 2011-03-24 13:55:11.267715 Â Â Â Â= 0
> [7257] 2011-03-24 13:56:06.571060 Â Â Â ['/usr/sbin/tap-ctl', 'list']
> [7257] 2011-03-24 13:56:06.574950 Â Â Â Â= 0
> [7257] 2011-03-24 13:56:06.580724 Â Â Â ['/usr/sbin/tap-ctl', 'stats',
> '-p', '26360', '-m', '2']
> [7257] 2011-03-24 13:56:06.584472 Â Â Â Â= 0
> [7257] 2011-03-24 13:56:06.585132 Â Â Â ['/usr/sbin/tap-ctl', 'stats',
> '-p', '28818', '-m', '0']
> [7257] 2011-03-24 13:56:06.588925 Â Â Â Â= 0
> [7538] 2011-03-24 13:57:01.902472 Â Â Â ['/usr/sbin/tap-ctl', 'list']
> [7538] 2011-03-24 13:57:01.906591 Â Â Â Â= 0
> [7538] 2011-03-24 13:57:01.912364 Â Â Â ['/usr/sbin/tap-ctl', 'stats',
> '-p', '26360', '-m', '2']
> [7538] 2011-03-24 13:57:01.916432 Â Â Â Â= 0
> [7538] 2011-03-24 13:57:01.917099 Â Â Â ['/usr/sbin/tap-ctl', 'stats',
> '-p', '28818', '-m', '0']
> [7538] 2011-03-24 13:57:01.921214 Â Â Â Â= 0
> [7931] 2011-03-24 13:57:57.242696 Â Â Â ['/usr/sbin/tap-ctl', 'list']
> [7931] 2011-03-24 13:57:57.246488 Â Â Â Â= 0
> [7931] 2011-03-24 13:57:57.252225 Â Â Â ['/usr/sbin/tap-ctl', 'stats',
> '-p', '26360', '-m', '2']
> [7931] 2011-03-24 13:57:57.256070 Â Â Â Â= 0
> [7931] 2011-03-24 13:57:57.256718 Â Â Â ['/usr/sbin/tap-ctl', 'stats',
> '-p', '28818', '-m', '0']
> [7931] 2011-03-24 13:57:57.260511 Â Â Â Â= 0
> [8329] 2011-03-24 13:58:52.568972 Â Â Â ['/usr/sbin/tap-ctl', 'list']
> [8329] 2011-03-24 13:58:52.573106 Â Â Â Â= 0
> [8329] 2011-03-24 13:58:52.578847 Â Â Â ['/usr/sbin/tap-ctl', 'stats',
> '-p', '26360', '-m', '2']
> [8329] 2011-03-24 13:58:52.582838 Â Â Â Â= 0
> [8329] 2011-03-24 13:58:52.583487 Â Â Â ['/usr/sbin/tap-ctl', 'stats',
> '-p', '28818', '-m', '0']
> [8329] 2011-03-24 13:58:52.587380 Â Â Â Â= 0
> [8523] 2011-03-24 13:59:47.905467 Â Â Â ['/usr/sbin/tap-ctl', 'list']
> [8523] 2011-03-24 13:59:47.909332 Â Â Â Â= 0
> [8523] 2011-03-24 13:59:47.915058 Â Â Â ['/usr/sbin/tap-ctl', 'stats',
> '-p', '26360', '-m', '2']
> [8523] 2011-03-24 13:59:47.918973 Â Â Â Â= 0
> [8523] 2011-03-24 13:59:47.919625 Â Â Â ['/usr/sbin/tap-ctl', 'stats',
> '-p', '28818', '-m', '0']
> [8523] 2011-03-24 13:59:47.923533 Â Â Â Â= 0
> [8766] 2011-03-24 14:00:16.874228 Â Â Â lock: acquired
> /var/lock/sm/b5631d2b-7931-c93c-39da-5a20978e823b/sr
> [8766] 2011-03-24 14:00:16.876175 Â Â Â ['/usr/sbin/td-util', 'query',
> 'vhd', '-vpf', 
> '/var/run/sr-mount/b5631d2b-7931-c93c-39da-5a20978e823b/5d095db5-4135-47f7-8118-3d9449965799.vhd']
> [8766] 2011-03-24 14:00:16.903674 Â Â Â SUCCESS
> [8766] 2011-03-24 14:00:16.904485 Â Â Â lock: released
> /var/lock/sm/b5631d2b-7931-c93c-39da-5a20978e823b/sr
> [8766] 2011-03-24 14:00:16.904600 Â Â Â vdi_deactivate {'sr_uuid':
> 'b5631d2b-7931-c93c-39da-5a20978e823b', 'subtask_of':
> 'OpaqueRef:c7c8309d-f5fb-a97c-6443-a8b1f4b3dabe', 'vdi_ref':
> 'OpaqueRef:c602d033-57a7-bf8f-7d5d-ca76e2520402', 'vdi_on_boot':
> 'persist', 'args': [], 'vdi_location':
> '5d095db5-4135-47f7-8118-3d9449965799', 'host_ref':
> 'OpaqueRef:0ed3e74b-aee7-e262-61cd-fe18a9a6d360', 'session_ref':
> 'OpaqueRef:fcea3677-4e21-e61b-a171-4369039ffe22', 'device_config':
> {'options': '', 'SRmaster': 'true', 'serverpath':
> '/vol/vol6/orquestra', 'server': 'riofd06.globoi.com'}, 'command':
> 'vdi_deactivate', 'vdi_allow_caching': 'true', 'sr_ref':
> 'OpaqueRef:e5bbc8cc-f3d5-3cc5-3e11-2c68797c8c45', 'local_cache_sr':
> '5dea02ae-a488-829b-92d2-3eb5c288b90f', 'vdi_uuid':
> '5d095db5-4135-47f7-8118-3d9449965799'}
> [8766] 2011-03-24 14:00:16.904773 Â Â Â blktap2.deactivate
> [8766] 2011-03-24 14:00:16.904855 Â Â Â lock: acquired
> /var/lock/sm/5d095db5-4135-47f7-8118-3d9449965799/vdi
> [8766] 2011-03-24 14:00:16.913169 Â Â Â ['/usr/sbin/tap-ctl', 'list', '-m', 
> '2']
> [8766] 2011-03-24 14:00:16.916386 Â Â Â Â= 0
> [8766] 2011-03-24 14:00:16.916680 Â Â Â ['/usr/sbin/tap-ctl', 'close',
> '-p', '26360', '-m', '2']
> [8766] 2011-03-24 14:00:16.992138 Â Â Â Â= 0
> [8766] 2011-03-24 14:00:16.992272 Â Â Â ['/usr/sbin/tap-ctl',
> 'detach', '-p', '26360', '-m', '2']
> [8766] 2011-03-24 14:00:16.996854 Â Â Â Â= 0
> [8766] 2011-03-24 14:00:16.997078 Â Â Â ['/usr/sbin/tap-ctl', 'free', '-m', 
> '2']
> [8766] 2011-03-24 14:00:16.999694 Â Â Â Â= 0
> [8766] 2011-03-24 14:00:16.999870 Â Â Â tap.deactivate: Shut down
> Tapdisk(vhd:/var/run/sr-mount/5dea02ae-a488-829b-92d2-3eb5c288b90f/5d095db5-4135-47f7-8118-3d9449965799.vhdcache,
> pid=26360, minor=2, state=R)
> [8766] 2011-03-24 14:00:17.039695 Â Â Â ['/usr/sbin/vhd-util',
> 'query', '--debug', '-p', '-n',
> '/var/run/sr-mount/b5631d2b-7931-c93c-39da-5a20978e823b/5d095db5-4135-47f7-8118-3d9449965799.vhd']
> [8766] 2011-03-24 14:00:17.052353 Â Â Â SUCCESS
> [8766] 2011-03-24 14:00:17.058312 Â Â Â Tearing down the cache
> [8766] 2011-03-24 14:00:17.059648 Â Â Â ['/usr/sbin/td-util', 'query',
> 'vhd', '-vpf', 
> '/var/run/sr-mount/b5631d2b-7931-c93c-39da-5a20978e823b/7dde9a41-45bf-4a4a-a17c-10b9ca93c41f.vhd']
> [8766] 2011-03-24 14:00:17.102206 Â Â Â SUCCESS
> [8766] 2011-03-24 14:00:17.449727 Â Â Â lock: acquired
> /var/lock/sm/7dde9a41-45bf-4a4a-a17c-10b9ca93c41f/cachesetup
> [8766] 2011-03-24 14:00:17.449808 Â Â Â lock: released
> /var/lock/sm/7dde9a41-45bf-4a4a-a17c-10b9ca93c41f/cachesetup
> [8766] 2011-03-24 14:00:17.449863 Â Â Â lock: closed
> /var/lock/sm/7dde9a41-45bf-4a4a-a17c-10b9ca93c41f/cachesetup
> [8766] 2011-03-24 14:00:17.449926 Â Â Â lock: closed
> /var/lock/sm/5dea02ae-a488-829b-92d2-3eb5c288b90f/sr
> [8766] 2011-03-24 14:00:17.734256 Â Â Â ['/usr/sbin/td-util', 'query',
> 'vhd', '-vpf', 
> '/var/run/sr-mount/b5631d2b-7931-c93c-39da-5a20978e823b/5d095db5-4135-47f7-8118-3d9449965799.vhd']
> [8766] 2011-03-24 14:00:17.746639 Â Â Â SUCCESS
> [8766] 2011-03-24 14:00:17.762216 Â Â Â Removed host key
> host_OpaqueRef:0ed3e74b-aee7-e262-61cd-fe18a9a6d360 for
> 5d095db5-4135-47f7-8118-3d9449965799
> [8766] 2011-03-24 14:00:17.762311 Â Â Â lock: released
> /var/lock/sm/5d095db5-4135-47f7-8118-3d9449965799/vdi
> [8766] 2011-03-24 14:00:17.762378 Â Â Â lock: closed
> /var/lock/sm/5d095db5-4135-47f7-8118-3d9449965799/vdi
> [8766] 2011-03-24 14:00:17.762456 Â Â Â lock: closed
> /var/lock/sm/b5631d2b-7931-c93c-39da-5a20978e823b/sr
> [8766] 2011-03-24 14:00:17.762628 Â Â Â lock: closed
> /var/lock/sm/b5631d2b-7931-c93c-39da-5a20978e823b/sr
> [8822] 2011-03-24 14:00:17.884668 Â Â Â lock: acquired
> /var/lock/sm/b5631d2b-7931-c93c-39da-5a20978e823b/sr
> [8822] 2011-03-24 14:00:17.886117 Â Â Â ['/usr/sbin/td-util', 'query',
> 'vhd', '-vpf', 
> '/var/run/sr-mount/b5631d2b-7931-c93c-39da-5a20978e823b/5d095db5-4135-47f7-8118-3d9449965799.vhd']
> [8822] 2011-03-24 14:00:17.902571 Â Â Â SUCCESS
> [8822] 2011-03-24 14:00:17.903878 Â Â Â vdi_detach {'sr_uuid':
> 'b5631d2b-7931-c93c-39da-5a20978e823b', 'subtask_of':
> 'OpaqueRef:c7c8309d-f5fb-a97c-6443-a8b1f4b3dabe', 'vdi_ref':
> 'OpaqueRef:c602d033-57a7-bf8f-7d5d-ca76e2520402', 'vdi_on_boot':
> 'persist', 'args': [], 'vdi_location':
> '5d095db5-4135-47f7-8118-3d9449965799', 'host_ref':
> 'OpaqueRef:0ed3e74b-aee7-e262-61cd-fe18a9a6d360', 'session_ref':
> 'OpaqueRef:28d24a42-044e-091a-6b31-a49a5b80b565', 'device_config':
> {'options': '', 'SRmaster': 'true', 'serverpath':
> '/vol/vol6/orquestra', 'server': 'riofd06.globoi.com'}, 'command':
> 'vdi_detach', 'vdi_allow_caching': 'true', 'sr_ref':
> 'OpaqueRef:e5bbc8cc-f3d5-3cc5-3e11-2c68797c8c45', 'local_cache_sr':
> '5dea02ae-a488-829b-92d2-3eb5c288b90f', 'vdi_uuid':
> '5d095db5-4135-47f7-8118-3d9449965799'}
> [8822] 2011-03-24 14:00:17.904166 Â Â Â lock: closed
> /var/lock/sm/5d095db5-4135-47f7-8118-3d9449965799/vdi
> [8822] 2011-03-24 14:00:17.904285 Â Â Â lock: released
> /var/lock/sm/b5631d2b-7931-c93c-39da-5a20978e823b/sr
> [8822] 2011-03-24 14:00:17.904565 Â Â Â lock: closed
> /var/lock/sm/b5631d2b-7931-c93c-39da-5a20978e823b/sr
> [8994] 2011-03-24 14:00:43.246717 Â Â Â ['/usr/sbin/tap-ctl', 'list']
> [8994] 2011-03-24 14:00:43.250366 Â Â Â Â= 0
> [8994] 2011-03-24 14:00:43.256244 Â Â Â ['/usr/sbin/tap-ctl', 'stats',
> '-p', '28818', '-m', '0']
> [8994] 2011-03-24 14:00:43.260298 Â Â Â Â= 0
> [9095] 2011-03-24 14:01:12.462263 Â Â Â lock: acquired
> /var/lock/sm/b5631d2b-7931-c93c-39da-5a20978e823b/sr
> [9095] 2011-03-24 14:01:12.464090 Â Â Â ['/usr/sbin/td-util', 'query',
> 'vhd', '-vpf', 
> '/var/run/sr-mount/b5631d2b-7931-c93c-39da-5a20978e823b/5d095db5-4135-47f7-8118-3d9449965799.vhd']
> [9095] 2011-03-24 14:01:12.481012 Â Â Â SUCCESS
> [9095] 2011-03-24 14:01:12.482403 Â Â Â lock: released
> /var/lock/sm/b5631d2b-7931-c93c-39da-5a20978e823b/sr
> [9095] 2011-03-24 14:01:12.482584 Â Â Â vdi_resize {'sr_uuid':
> 'b5631d2b-7931-c93c-39da-5a20978e823b', 'subtask_of':
> 'OpaqueRef:4e9f7429-4c78-35ca-3c35-aa2ba7e87b03', 'vdi_ref':
> 'OpaqueRef:c602d033-57a7-bf8f-7d5d-ca76e2520402', 'vdi_on_boot':
> 'persist', 'args': ['42949672960'], 'vdi_location':
> '5d095db5-4135-47f7-8118-3d9449965799', 'host_ref':
> 'OpaqueRef:0ed3e74b-aee7-e262-61cd-fe18a9a6d360', 'session_ref':
> 'OpaqueRef:f7ef4d98-e63d-d4cc-ea06-c1eefd721779', 'device_config':
> {'options': '', 'SRmaster': 'true', 'serverpath':
> '/vol/vol6/orquestra', 'server': 'riofd06.globoi.com'}, 'command':
> 'vdi_resize', 'vdi_allow_caching': 'true', 'sr_ref':
> 'OpaqueRef:e5bbc8cc-f3d5-3cc5-3e11-2c68797c8c45', 'local_cache_sr':
> '5dea02ae-a488-829b-92d2-3eb5c288b90f', 'vdi_uuid':
> '5d095db5-4135-47f7-8118-3d9449965799'}
> [9095] 2011-03-24 14:01:12.482785 Â Â Â ['/usr/sbin/vhd-util',
> 'resize', '--debug', '-s', '40960', '-n', 
> '/var/run/sr-mount/b5631d2b-7931-c93c-39da-5a20978e823b/5d095db5-4135-47f7-8118-3d9449965799.vhd',
> '-j', '.journal-5d095db5-4135-47f7-8118-3d9449965799']
> [9095] 2011-03-24 14:01:12.702535 Â Â Â SUCCESS
> [9095] 2011-03-24 14:01:12.702738 Â Â Â ['/usr/sbin/vhd-util',
> 'query', '--debug', '-v', '-n',
> '/var/run/sr-mount/b5631d2b-7931-c93c-39da-5a20978e823b/5d095db5-4135-47f7-8118-3d9449965799.vhd']
> [9095] 2011-03-24 14:01:12.716394 Â Â Â SUCCESS
> [9095] 2011-03-24 14:01:12.749430 Â Â Â _db_update_sm_config:
> 5d095db5-4135-47f7-8118-3d9449965799 del sm-config:vhd-parent
> [9095] 2011-03-24 14:01:12.788894 Â Â Â lock: closed
> /var/lock/sm/b5631d2b-7931-c93c-39da-5a20978e823b/sr
> [9233] 2011-03-24 14:01:38.575962 Â Â Â ['/usr/sbin/tap-ctl', 'list']
> [9233] 2011-03-24 14:01:38.579594 Â Â Â Â= 0
> [9233] 2011-03-24 14:01:38.585400 Â Â Â ['/usr/sbin/tap-ctl', 'stats',
> '-p', '28818', '-m', '0']
> [9233] 2011-03-24 14:01:38.589243 Â Â Â Â= 0
>
> </log>
>
> On Thu, Mar 24, 2011 at 12:01 PM, Jonathan Davies 
> <Jonathan.Davies@xxxxxxxxxxxxx> wrote:
>> Hi Marco,
>>
>> No, that's not the expected behaviour...
>>
>> Andrei (cc'd) has not been able to reproduce this. Are you able to provide 
>> /var/log/SMlog and some more detailed reproduction steps?
>>
>> Thanks,
>>
>> Jonathan
>>
>>> -----Original Message-----
>>> From: xen-api-bounces@xxxxxxxxxxxxxxxxxxx [mailto:xen-api-
>>> bounces@xxxxxxxxxxxxxxxxxxx] On Behalf Of Marco Sinhoreli
>>> Sent: 23 March 2011 15:03
>>> To: xen-api
>>> Subject: [Xen-API] Resizing VDI with Local Caching enabled
>>>
>>> Hello all:
>>>
>>> I'm trying resize a VDI cloned from a gold-image. I'm using storage
>>> local caching in my tests. After resize, the virtual machine isn't
>>> booting. Bellow the exception:
>>>
>>>
>>> <output>
>>> [root@server ~]# vdi=$(xe vbd-list
>>> vm-uuid=fa537d17-1b07-b472-74c7-67b2a2f5561f device=xvda
>>> params=vdi-uuid --minimal) [root@server ~]# xe vdi-resize uuid=$vdi
>>> disk-size=40GiB [root@server ~]# echo $?
>>> 0
>>> [root@server ~]# xe vm-start
>>> uuid=fa537d17-1b07-b472-74c7-67b2a2f5561f
>>> There was an SR backend failure.
>>> status: non-zero exit
>>> stdout:
>>> stderr: Traceback (most recent call last):
>>> Â File "/opt/xensource/sm/NFSSR", line 253, in ?
>>> Â Â SRCommand.run(NFSSR, DRIVER_INFO)
>>> Â File "/opt/xensource/sm/SRCommand.py", line 246, in run
>>> Â Â ret = cmd.run(sr)
>>> Â File "/opt/xensource/sm/SRCommand.py", line 94, in run
>>> Â Â return self._run_locked(sr)
>>> Â File "/opt/xensource/sm/SRCommand.py", line 131, in _run_locked
>>> Â Â return self._run(sr, target)
>>> Â File "/opt/xensource/sm/SRCommand.py", line 183, in _run
>>> Â Â caching_params)
>>> Â File "/opt/xensource/sm/blktap2.py", line 1280, in activate
>>> Â Â if self._activate_locked(sr_uuid, vdi_uuid, caching_params):
>>> Â File "/opt/xensource/sm/blktap2.py", line 29, in wrapper
>>> Â Â ret = op(self, *args)
>>> Â File "/opt/xensource/sm/blktap2.py", line 1312, in _activate_locked
>>> Â Â dev_path = self._activate(sr_uuid, vdi_uuid, caching_params)
>>> Â File "/opt/xensource/sm/blktap2.py", line 1326, in _activate
>>> Â Â dev_path = self.setup_cache(sr_uuid, vdi_uuid, caching_params)
>>> Â File "/opt/xensource/sm/blktap2.py", line 1468, in setup_cache
>>> Â Â local_sr_uuid, scratch_mode)
>>> Â File "/opt/xensource/sm/blktap2.py", line 1550, in _setup_cache
>>> Â Â standby=scratch_mode)
>>> Â File "/opt/xensource/sm/blktap2.py", line 711, in launch_on_tap
>>> Â Â raise TapdiskFailed(cls.Arg(_type, path), ctl)
>>> blktap2.TapdiskFailed:
>>> Tapdisk(vhd:/var/run/sr-mount/01cbd019-bd89-1296-a4bf-
>>> fd9d412f64f4/05732396-9466-4828-9926-2217a10a18c9.vhdcache):
>>> ['/usr/sbin/tap-ctl', 'open', '-p', '21483', '-m', '3', '-a',
>>> 'vhd:/var/run/sr-mount/01cbd019-bd89-1296-a4bf-fd9d412f64f4/05732396-
>>> 9466-4828-9926-2217a10a18c9.vhdcache',
>>> '-e', '0', '-2',
>>> 'vhd:/var/run/sr-mount/b5631d2b-7931-c93c-39da-5a20978e823b/05732396-
>>> 9466-4828-9926-2217a10a18c9.vhd']
>>> failed: status=22, pid=21485, errmsg= </output>
>>>
>>> Is it a bug or could I have done something not permitted?
>>>
>>> Thoughts?
>>>
>>>
>>> Cheers!
>>>
>>> --
>>> Marco Sinhoreli
>>>
>>> _______________________________________________
>>> xen-api mailing list
>>> xen-api@xxxxxxxxxxxxxxxxxxx
>>> http://lists.xensource.com/mailman/listinfo/xen-api
>>
>
>
>
> --
> Marco Sinhoreli
>



-- 
Marco Sinhoreli

_______________________________________________
xen-api mailing list
xen-api@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/mailman/listinfo/xen-api