啟動(dòng)hive時(shí)報(bào)錯(cuò):
Execution Error, return code 30041 from org.apache.hadoop.hive.ql.exec.spark.SparkTask. Failed to create Spark client for Spark session a2d32dbe-d48c-486f-be8b-2f5c75ffe182
日志監(jiān)控:
java.util.concurrent.ExecutionException: java.util.concurrent.TimeoutException: Timed out waiting for client connection.
解決:
hive.spark.client.connect.timeout的默認(rèn)值是1000ms宦芦,如果執(zhí)行hive的insert語句時(shí)禽拔,拋如下異常彰亥,可以調(diào)大該參數(shù)到10000ms
在hive的配置文件hive-site.xml中添加:
<!--Hive和Spark連接超時(shí)時(shí)間-->hive.spark.client.connect.timeout10000ms
注意:千萬要檢查自己的配置文件有沒有把目錄或者其他信息寫錯(cuò)惨寿!