您好,登錄后才能下訂單哦!
hadoop client/hive client去連接 微軟云Azure上的HDI報錯:
hive --service metastore
Exception in thread "main" org.apache.thrift.transport.TTransportException: Could not create ServerSocket on address 0.0.0.0/0.0.0.0:9083.
根本原因是這里使用的是HDI
1、這兩個配置文件都改(centos和ubuntu有區別)
# vim /usr/hdp/2.2.0.0-2041/hive/conf/hive-site.xml
# vim /etc/hive/conf/hive-site.xml
<?xml version="1.0" encoding="UTF-8" standalone="no"?> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> <configuration supports_final="true"> <!-- Hive Configuration can either be stored in this file or in the hadoop configuration files that are implied by Hadoop setup variables. Aside from Hadoop setup variables - this file is provided as a convenience so that Hive users do not have to edit hadoop configuration files (that may be managed as a centralized resource). --> <property> <name>hive.metastore.warehouse.dir</name> <value>/hive/warehouse</value> <description>location of default database for the warehouse</description> </property> <property> <name>hive.metastore.uris</name> <value>thrift://headnodehost:9083</value> <description>Thrift URI for the remote metastore. Used by metastore client to connect to remote metastore.</description> </property> </configuration>
2、修改hosts
vim /etc/hosts
內容是來自于HDI的windows機器上的配置
10.0.2.7 headnodehost # SlaveNodeManager 10.0.2.7 jobtrackerhost # SlaveNodeManager 10.0.2.7 namenodehost # SlaveNodeManager
hive普通用戶報錯:
1、報錯
Booting Derby (version The Apache Software Foundation - Apache Derby - 10.10.1.1 - (1458268)) instance a816c00e-0154-2ed3-cbb2-00000e1ebc98
on database directory /var/lib/hive/metastore/metastore_db in READ ONLY mode with class loader sun.misc.Launcher$AppClassLoader@7cc355be.
Loaded fromfile:/usr/hdp/2.2.0.0-2041/hive/lib/derby-10.10.1.1.jar.
問題:明顯是metastore數據庫read only,沒有寫權限
解決辦法:
# cd /var/lib/hive/metastore/
# chmod -R a+w metastore_db/
2、報錯如下,但是hive還是進來了
Booting Derby version The Apache Software Foundation - Apache Derby - 10.10.1.1 - (1458268): instance a816c00e-0154-3155-87b8-00000e0b5a08
on database directory /var/lib/hive/metastore/metastore_db with class loader sun.misc.Launcher$AppClassLoader@7cc355be
Loaded from file:/usr/hdp/2.2.0.0-2041/hive/lib/derby-10.10.1.1.jar
java.vendor=Oracle Corporation
java.runtime.version=1.8.0_51-b16
user.dir=/var/lib/hive
os.name=Linux
os.arch=amd64
os.version=2.6.32-573.1.1.el6.x86_64
derby.system.home=null
Database Class Loader started - derby.database.classpath=''
hive>
>
還是權限問題:/var/lib/hive# chown -R hive:hive metastore/
免責聲明:本站發布的內容(圖片、視頻和文字)以原創、轉載和分享為主,文章觀點不代表本網站立場,如果涉及侵權請聯系站長郵箱:is@yisu.com進行舉報,并提供相關證據,一經查實,將立刻刪除涉嫌侵權內容。