yarn管理界面中的錯誤日志：
Exit code: 1
Stack trace: ExitCodeException exitCode=1:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:604)
at org.apache.hadoop.util.Shell.run(Shell.java:507)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:789)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:213)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Container exited with a non-zero exit code 1
看到這個問題是去百度了一下又說是路徑權(quán)限問題的，但并不是咆爽！
于是我去服務(wù)器中下載了更加完整的日志文件
命令如下：
yarn logs -applicationId application_1542248786737_0626 > yarn.log
打開日志后翻到最下面看到如下內(nèi)容：
Container: container_1542248786737_0626_02_000003 on cdh-005_8041
===================================================================
LogType:stderr
Log Upload Time:Mon Nov 26 18:56:09 +0800 2018
LogLength:142
Log Contents:
Invalid maximum heap size: -Xmx0m
Error: Could not create the Java Virtual Machine.
Error: A fatal exception has occurred. Program will exit.
LogType:stdout
Log Upload Time:Mon Nov 26 18:56:09 +0800 2018
LogLength:0
Log Contents:
看到下面的內(nèi)容小伙伴們是不是知道是為什么了
Invalid maximum heap size: -Xmx0m
Error: Could not create the Java Virtual Machine.
內(nèi)存參數(shù)設(shè)置為零不能創(chuàng)建jvm
在提交Spark任務(wù)腳本中沒有指定Driver的內(nèi)存所以在腳本中設(shè)置添加參數(shù)即可
