集群环境：
hdp 3.1.5.0-152
apache spark 2.4.7
错误截图：
错误：
2022-02-18 06:31:00,428 INFO [main] yarn.Client (Logging.scala:logInfo(54)) - Submitting application application_1644979649961_0061 to ResourceManager2022-02-18 06:31:00,464 INFO [main] impl.YarnClientImpl (YarnClientImpl.java:submitApplication(306)) - Submitted application application_1644979649961_00612022-02-18 06:31:01,466 INFO [main] yarn.Client (Logging.scala:logInfo(54)) - Application report for application_1644979649961_0061 (state: ACCEPTED)2022-02-18 06:31:01,469 INFO [main] yarn.Client (Logging.scala:logInfo(54)) - client token: N/A diagnostics: AM container is launched, waiting for AM container to Register with RM ApplicationMaster host: N/A ApplicationMaster RPC port: -1 queue: default start time: 1645165860441 final status: UNDEFINED tracking URL: http://awnx1-cdata-tnode01:8088/proxy/application_1644979649961_0061/ user: root2022-02-18 06:31:02,470 INFO [main] yarn.Client (Logging.scala:logInfo(54)) - Application report for application_1644979649961_0061 (state: ACCEPTED)2022-02-18 06:31:03,471 INFO [main] yarn.Client (Logging.scala:logInfo(54)) - Application report for application_1644979649961_0061 (state: FAILED)2022-02-18 06:31:03,472 INFO [main] yarn.Client (Logging.scala:logInfo(54)) - client token: N/A diagnostics: Application application_1644979649961_0061 failed 1 times (global limit =2; local limit is =1) due to AM Container for appattempt_1644979649961_0061_000001 exited with exitCode: 1Failing this attempt.Diagnostics: [2022-02-18 06:31:02.612]Exception from container-launch.Container id: container_e02_1644979649961_0061_01_000001Exit code: 1[2022-02-18 06:31:02.613]Container exited with a non-zero exit code 1、Error file: prelaunch.err.Last 4096 bytes of prelaunch.err :/data/hadoop/yarn/local/usercache/root/appcache/application_1644979649961_0061/container_e02_1644979649961_0061_01_000001/launch_container.sh: line 38: $PWD:$PWD/__spark_conf__:$PWD/__spark_libs__/*:$HADOOP_CONF_DIR:/usr/hdp/3.1.5.0-152/hadoop/*:/usr/hdp/3.1.5.0-152/hadoop/lib/*:/usr/hdp/current/hadoop-hdfs-client/*:/usr/hdp/current/hadoop-hdfs-client/lib/*:/usr/hdp/current/hadoop-yarn-client/*:/usr/hdp/current/hadoop-yarn-client/lib/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/*:$PWD/mr-framework/hadoop/share/hadoop/mapreduce/lib/*:$PWD/mr-framework/hadoop/share/hadoop/common/*:$PWD/mr-framework/hadoop/share/hadoop/common/lib/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/*:$PWD/mr-framework/hadoop/share/hadoop/yarn/lib/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/*:$PWD/mr-framework/hadoop/share/hadoop/hdfs/lib/*:$PWD/mr-framework/hadoop/share/hadoop/tools/lib/*:/usr/hdp/${hdp.version}/hadoop/lib/hadoop-lzo-0.6.0.${hdp.version}.jar:/etc/hadoop/conf/secure:$PWD/__spark_conf__/__hadoop_conf__: bad substitution[2022-02-18 06:31:02.613]Container exited with a non-zero exit code 1、Error file: prelaunch.err.
该错误是由于apache版本的spark提交任务时找不到hdp.version变量，我们需要在HDP管理页面的MapReduce2的配置中添加该变量
文章参考：spark 异常 __spark_conf__/__hadoop_conf__: bad substitution_编程学问网