您好,登錄后才能下訂單哦!
這篇文章主要介紹了登錄openstack的dashboard發現無法啟動云主機怎么辦,具有一定借鑒價值,感興趣的朋友可以參考下,希望大家閱讀完這篇文章之后大有收獲,下面讓小編帶著大家一起了解一下。
測試機器每天晚上都要關機,每天上午開機的時候總會出現一些莫名其妙的問題,登錄openstack的dashboard,發現無法啟動云主機,創建云硬盤失敗。
查看底層存儲ceph的狀態,發現好幾個osd并未啟動,于是啟動關閉的osd,ceph集群進入健康狀態。
ceph集群一共是三臺機器216、217和218,其中216機器有些問題,總是啟動不來,但它又是主mon,導致217和218上的osd一直連接不上216的mon會被標記為down的狀態,只有在216正常啟動后再啟動217和218的osd才會正常。
# view /var/log/cinder/volume.log
看到如下錯誤:
。。。
2016-08-02 15:01:44.865 9622 ERROR cinder.utils [req-0706d398-b2bf-4925-9613-04bdb1deb8f9 6d8248aff00546bb86f439342780e770 a3f5a48418e449578f9c0c56105287cc - - -] Volume driver RBDDriver not initialized
2016-08-02 15:01:44.866 9622 ERROR oslo_messaging.rpc.dispatcher [req-0706d398-b2bf-4925-9613-04bdb1deb8f9 6d8248aff00546bb86f439342780e770 a3f5a48418e449578f9c0c56105287cc - - -] Exception during message handling: Volume driver not ready.
2016-08-02 15:01:44.866 9622 TRACE oslo_messaging.rpc.dispatcher Traceback (most recent call last):
2016-08-02 15:01:44.866 9622 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 142, in _dispatch_and_reply
2016-08-02 15:01:44.866 9622 TRACE oslo_messaging.rpc.dispatcher executor_callback))
2016-08-02 15:01:44.866 9622 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 186, in _dispatch
2016-08-02 15:01:44.866 9622 TRACE oslo_messaging.rpc.dispatcher executor_callback)
2016-08-02 15:01:44.866 9622 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 130, in _do_dispatch
2016-08-02 15:01:44.866 9622 TRACE oslo_messaging.rpc.dispatcher result = func(ctxt, **new_args)
2016-08-02 15:01:44.866 9622 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/osprofiler/profiler.py", line 105, in wrapper
2016-08-02 15:01:44.866 9622 TRACE oslo_messaging.rpc.dispatcher return f(*args, **kwargs)
2016-08-02 15:01:44.866 9622 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 1076, in initialize_connection
2016-08-02 15:01:44.866 9622 TRACE oslo_messaging.rpc.dispatcher utils.require_driver_initialized(self.driver)
2016-08-02 15:01:44.866 9622 TRACE oslo_messaging.rpc.dispatcher File "/usr/lib/python2.7/site-packages/cinder/utils.py", line 598, in require_driver_initialized
2016-08-02 15:01:44.866 9622 TRACE oslo_messaging.rpc.dispatcher raise exception.DriverNotInitialized()
2016-08-02 15:01:44.866 9622 TRACE oslo_messaging.rpc.dispatcher DriverNotInitialized: Volume driver not ready.
2016-08-02 15:01:44.866 9622 TRACE oslo_messaging.rpc.dispatcher
2016-08-02 15:01:44.870 9622 INFO oslo_messaging._drivers.impl_rabbit [req-0706d398-b2bf-4925-9613-04bdb1deb8f9 6d8248aff00546bb86f439342780e770 a3f5a48418e449578f9c0c56105287cc - - -] Connecting to AMQP server on 192.168.8.217:5672
2016-08-02 15:01:44.883 9622 INFO oslo_messaging._drivers.impl_rabbit [req-0706d398-b2bf-4925-9613-04bdb1deb8f9 6d8248aff00546bb86f439342780e770 a3f5a48418e449578f9c0c56105287cc - - -] Connected to AMQP server on 192.168.8.217:5672
2016-08-02 15:01:44.885 9622 ERROR oslo_messaging._drivers.common [req-0706d398-b2bf-4925-9613-04bdb1deb8f9 6d8248aff00546bb86f439342780e770 a3f5a48418e449578f9c0c56105287cc - - -] Returning exception Volume driver not ready. to caller
2016-08-02 15:01:44.885 9622 ERROR oslo_messaging._drivers.common [req-0706d398-b2bf-4925-9613-04bdb1deb8f9 6d8248aff00546bb86f439342780e770 a3f5a48418e449578f9c0c56105287cc - - -] ['Traceback (most recent call last):\n', ' File "/usr/
lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 142, in _dispatch_and_reply\n executor_callback))\n', ' File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 186, in _dispatch\n execut
or_callback)\n', ' File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", line 130, in _do_dispatch\n result = func(ctxt, **new_args)\n', ' File "/usr/lib/python2.7/site-packages/osprofiler/profiler.py", line 105
, in wrapper\n return f(*args, **kwargs)\n', ' File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 1076, in initialize_connection\n utils.require_driver_initialized(self.driver)\n', ' File "/usr/lib/python2.7/
site-packages/cinder/utils.py", line 598, in require_driver_initialized\n raise exception.DriverNotInitialized()\n', 'DriverNotInitialized: Volume driver not ready.\n']
2016-08-02 15:02:42.248 9622 INFO cinder.volume.manager [req-fe77cb0b-b8e0-4abc-a6a4-3127ec2dcbc3 - - - - -] Updating volume status
2016-08-02 15:02:42.250 9622 WARNING cinder.volume.manager [req-fe77cb0b-b8e0-4abc-a6a4-3127ec2dcbc3 - - - - -] Unable to update stats, RBDDriver -1.1.0 driver is uninitialized.
2016-08-02 15:03:42.249 9622 INFO cinder.volume.manager [req-eca34b20-dca4-4ce4-a9aa-0d782076aca4 - - - - -] Updating volume status
2016-08-02 15:03:42.251 9622 WARNING cinder.volume.manager [req-eca34b20-dca4-4ce4-a9aa-0d782076aca4 - - - - -] Unable to update stats, RBDDriver -1.1.0 driver is uninitialized.
。。。
其中出現次數最多的就是 RBDDriver -1.1.0 driver is uninitialized.
往上翻日志,可以追溯到機器剛啟動的時候,發現是由于連接不上ceph集群,導致 RBDDriver -1.1.0 driver 未初始化。
2016-08-02 08:47:41.014 9622 INFO cinder.volume.manager [req-72b8c8a4-a831-4395-80fc-f18a6535ce90 - - - - -] Starting volume driver RBDDriver (1.1.0)
2016-08-02 08:52:41.074 9622 ERROR cinder.volume.drivers.rbd [req-72b8c8a4-a831-4395-80fc-f18a6535ce90 - - - - -] Error connecting to ceph cluster.
2016-08-02 08:52:41.074 9622 TRACE cinder.volume.drivers.rbd Traceback (most recent call last):
2016-08-02 08:52:41.074 9622 TRACE cinder.volume.drivers.rbd File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/rbd.py", line 314, in _connect_to_rados
2016-08-02 08:52:41.074 9622 TRACE cinder.volume.drivers.rbd client.connect()
2016-08-02 08:52:41.074 9622 TRACE cinder.volume.drivers.rbd File "rados.pyx", line 785, in rados.Rados.connect (rados.c:8969)
2016-08-02 08:52:41.074 9622 TRACE cinder.volume.drivers.rbd TimedOut: error connecting to the cluster
2016-08-02 08:52:41.074 9622 TRACE cinder.volume.drivers.rbd
2016-08-02 08:52:41.080 9622 ERROR cinder.volume.manager [req-72b8c8a4-a831-4395-80fc-f18a6535ce90 - - - - -] Error encountered during initialization of driver: RBDDriver
2016-08-02 08:52:41.081 9622 ERROR cinder.volume.manager [req-72b8c8a4-a831-4395-80fc-f18a6535ce90 - - - - -] Bad or unexpected response from the storage volume backend API: Error connecting to ceph cluster.
2016-08-02 08:52:41.081 9622 TRACE cinder.volume.manager Traceback (most recent call last):
2016-08-02 08:52:41.081 9622 TRACE cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 302, in init_host
2016-08-02 08:52:41.081 9622 TRACE cinder.volume.manager self.driver.check_for_setup_error()
2016-08-02 08:52:41.081 9622 TRACE cinder.volume.manager File "/usr/lib/python2.7/site-packages/osprofiler/profiler.py", line 105, in wrapper
2016-08-02 08:52:41.081 9622 TRACE cinder.volume.manager return f(*args, **kwargs)
2016-08-02 08:52:41.081 9622 TRACE cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/rbd.py", line 287, in check_for_setup_error
2016-08-02 08:52:41.081 9622 TRACE cinder.volume.manager with RADOSClient(self):
2016-08-02 08:52:41.081 9622 TRACE cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/rbd.py", line 242, in __init__
2016-08-02 08:52:41.081 9622 TRACE cinder.volume.manager self.cluster, self.ioctx = driver._connect_to_rados(pool)
2016-08-02 08:52:41.081 9622 TRACE cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/rbd.py", line 322, in _connect_to_rados
2016-08-02 08:52:41.081 9622 TRACE cinder.volume.manager raise exception.VolumeBackendAPIException(data=msg)
2016-08-02 08:52:41.081 9622 TRACE cinder.volume.manager VolumeBackendAPIException: Bad or unexpected response from the storage volume backend API: Error connecting to ceph cluster.
2016-08-02 08:52:41.081 9622 TRACE cinder.volume.manager
2016-08-02 08:52:41.127 9622 INFO oslo_messaging._drivers.impl_rabbit [req-d845763e-483f-4495-8dc4-70fb2757d522 - - - - -] Connecting to AMQP server on 192.168.8.217:5672
2016-08-02 08:52:41.146 9622 INFO oslo_messaging._drivers.impl_rabbit [req-d845763e-483f-4495-8dc4-70fb2757d522 - - - - -] Connected to AMQP server on 192.168.8.217:5672
2016-08-02 08:52:42.163 9622 INFO cinder.volume.manager [req-8e733ab2-45c7-41c6-b89f-46ad5319d291 - - - - -] Updating volume status
2016-08-02 08:52:42.164 9622 WARNING cinder.volume.manager [req-8e733ab2-45c7-41c6-b89f-46ad5319d291 - - - - -] Unable to update stats, RBDDriver -1.1.0 driver is uninitialized.
2016-08-02 08:53:42.163 9622 INFO cinder.volume.manager [req-89715cce-2cc6-44a7-a80f-c7da27d5074a - - - - -] Updating volume status
2016-08-02 08:53:42.165 9622 WARNING cinder.volume.manager [req-89715cce-2cc6-44a7-a80f-c7da27d5074a - - - - -] Unable to update stats, RBDDriver -1.1.0 driver is uninitialized.
2016-08-02 08:54:42.164 9622 INFO cinder.volume.manager [req-42e4bb17-c2b7-4800-bf86-9f80947d3ca9 - - - - -] Updating volume status
2016-08-02 08:54:42.165 9622 WARNING cinder.volume.manager [req-42e4bb17-c2b7-4800-bf86-9f80947d3ca9 - - - - -] Unable to update stats, RBDDriver -1.1.0 driver is uninitialized.
雖然現在集群已經恢復正常了,但是RBDDriver還是不能正常工作,這里就需要重啟一下cinder的服務才行。
# systemctl restart openstack-cinder-api openstack-cinder-scheduler openstack-cinder-volume
重啟完服務,等待一下再查看日志
2016-08-02 15:10:08.805 1953 INFO cinder.openstack.common.service [req-01aa405c-6b1b-4456-b38b-22fc86a74ba9 - - - - -] Caught SIGTERM, stopping children
2016-08-02 15:10:08.808 1953 INFO cinder.openstack.common.service [req-01aa405c-6b1b-4456-b38b-22fc86a74ba9 - - - - -] Waiting on 1 children to exit
2016-08-02 15:10:08.809 1953 INFO cinder.openstack.common.service [req-01aa405c-6b1b-4456-b38b-22fc86a74ba9 - - - - -] Child 9622 killed by signal 15
2016-08-02 15:10:10.046 59977 INFO cinder.volume.manager [req-2cae44c1-861c-43ab-9b5a-d4b71453daeb - - - - -] Determined volume DB was not empty at startup.
2016-08-02 15:10:10.066 59977 INFO cinder.openstack.common.service [req-2cae44c1-861c-43ab-9b5a-d4b71453daeb - - - - -] Starting 1 workers
2016-08-02 15:10:10.070 59977 INFO cinder.openstack.common.service [req-2cae44c1-861c-43ab-9b5a-d4b71453daeb - - - - -] Started child 60005
2016-08-02 15:10:10.071 60005 INFO cinder.service [-] Starting cinder-volume node (version 2015.1.2)
2016-08-02 15:10:10.073 60005 INFO cinder.volume.manager [req-dbf976a6-1253-4022-a52c-3a8ce3f1f5ae - - - - -] Starting volume driver RBDDriver (1.1.0)
2016-08-02 15:10:10.178 60005 INFO cinder.volume.manager [req-dbf976a6-1253-4022-a52c-3a8ce3f1f5ae - - - - -] Updating volume status
2016-08-02 15:10:10.226 60005 INFO oslo_messaging._drivers.impl_rabbit [req-dbf976a6-1253-4022-a52c-3a8ce3f1f5ae - - - - -] Connecting to AMQP server on 192.168.8.217:5672
2016-08-02 15:10:10.240 60005 INFO oslo_messaging._drivers.impl_rabbit [req-dbf976a6-1253-4022-a52c-3a8ce3f1f5ae - - - - -] Connected to AMQP server on 192.168.8.217:5672
2016-08-02 15:10:10.290 60005 INFO oslo_messaging._drivers.impl_rabbit [req-c1532ac0-ef22-424f-ba60-02b1de8967c9 - - - - -] Connecting to AMQP server on 192.168.8.217:5672
2016-08-02 15:10:10.303 60005 INFO oslo_messaging._drivers.impl_rabbit [req-c1532ac0-ef22-424f-ba60-02b1de8967c9 - - - - -] Connected to AMQP server on 192.168.8.217:5672
2016-08-02 15:11:43.288 60005 INFO cinder.volume.flows.manager.create_volume [req-e2cf8138-38dd-4812-98d7-a8ec27b53800 6d8248aff00546bb86f439342780e770 a3f5a48418e449578f9c0c56105287cc - - -] Volume 37b011a3-f5f2-4bb2-8cb6-e646bf955ce6:
being created as image with specification: {'status': u'creating', 'image_location': (None, None), 'volume_size': 1, 'volume_name': u'volume-37b011a3-f5f2-4bb2-8cb6-e646bf955ce6', 'image_id': u'5008d784-fa11-45d3-b910-653c7f2420fc', 'i
mage_service': <cinder.image.glance.GlanceImageService object at 0x4dd80d0>, 'image_meta': {'status': u'active', 'name': u'cirros_raw', 'deleted': False, 'container_format': u'bare', 'created_at': datetime.datetime(2016, 7, 28, 6, 15, 2
8, tzinfo=<iso8601.Utc>), 'disk_format': u'qcow2', 'updated_at': datetime.datetime(2016, 7, 28, 6, 15, 30, tzinfo=<iso8601.Utc>), 'id': u'5008d784-fa11-45d3-b910-653c7f2420fc', 'owner': u'aa61c20829e34bbeb67e9b8fc4b5a6b4', 'min_ram': 0,
'checksum': u'ee1eca47dc88f4879d8a229cc70a07c6', 'min_disk': 0, 'is_public': True, 'deleted_at': None, 'properties': {}, 'size': 13287936}}
2016-08-02 15:11:44.840 60005 INFO cinder.image.image_utils [req-e2cf8138-38dd-4812-98d7-a8ec27b53800 6d8248aff00546bb86f439342780e770 a3f5a48418e449578f9c0c56105287cc - - -] Image download 12.00 MB at 12.00 MB/s
2016-08-02 15:11:45.864 60005 INFO cinder.image.image_utils [req-e2cf8138-38dd-4812-98d7-a8ec27b53800 6d8248aff00546bb86f439342780e770 a3f5a48418e449578f9c0c56105287cc - - -] Converted 12.00 MB image at 12.00 MB/s
感謝你能夠認真閱讀完這篇文章,希望小編分享的“登錄openstack的dashboard發現無法啟動云主機怎么辦”這篇文章對大家有幫助,同時也希望大家多多支持億速云,關注億速云行業資訊頻道,更多相關知識等著你來學習!
免責聲明:本站發布的內容(圖片、視頻和文字)以原創、轉載和分享為主,文章觀點不代表本網站立場,如果涉及侵權請聯系站長郵箱:is@yisu.com進行舉報,并提供相關證據,一經查實,將立刻刪除涉嫌侵權內容。