从ambari GUI我们不能启动火花
所以我们要通过命令行来启动它,如下所示:
[spark@mas01 spark2]$ ./sbin/start-thriftserver.sh --master yarn- client --executor-memory 512m --hiveconf hive.server2.thrift.port=10015 starting org.apache.spark.sql.hive.thriftserver.HiveThriftServer2, logging to /var/log/spark2/spark-spark- org.apache.spark.sql.hive.thriftserver.HiveThriftServer2-1- master01.octopus9.com.out
但从日志中我们得到的错误:
警告:主纱线客户端自2.0起弃用。 请改用指定部署模式的主“纱”。
请指教这个语法有什么问题?
[spark@mas01 spark2]$ more /var/log/spark2/spark-spark- org.apache.spark.sql.hive.thriftserver.HiveThriftServer2-1- master01.octopus9.com.out Spark Command: /usr/jdk64/jdk1.8.0_112/bin/java -Dhdp.version=2.6.0.3-8 -cp /usr/hdp/2.6.0.3-8/spark2/conf/:/usr/hdp/2.6.0.3-8/spark2/jars/*:/usr/hdp/cu rren t/hadoop-client/conf/ -Xmx10000m org.apache.spark.deploy.SparkSubmit --master yarn-client --class org.apache.spark.sql.hive.thriftserver.HiveThriftServer2 - -name Thrift JDBC/ODBC Server --executor-memory 512m spark-internal - - hiveconf hive.server2.thrift.port=10015 ======================================== Warning: Master yarn-client is deprecated since 2.0. Please use master "yarn" with specified deploy mode instead.