【问题标题】:How can I configure Analytics Engine use Hive LLAP using the Ambari UI?如何使用 Ambari UI 配置 Analytics Engine 使用 Hive LLAP?
【发布时间】:2018-06-15 22:42:53
【问题描述】:

IAE 是否支持 Hive LLAP 功能?如果是,如何使用 Ambari UI 启用它?

我尝试根据 tutorial from Hortonworks 启用,但出现错误:

$ hive

Logging initialized using configuration in file:/etc/hive/2.6.5.0-292/0/hive-log4j.properties
Exception in thread "main" java.lang.RuntimeException: org.apache.tez.dag.api.TezException: org.apache.hadoop.yarn.exceptions.YarnException: Failed to submit application_1528895103783_0002 to YARN : org.apache.hadoop.security.AccessControlException: Queue root.default already has 1 applications, cannot accept submission of application: application_1528895103783_0002
    at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:582)
    at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:681)
    at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.apache.hadoop.util.RunJar.run(RunJar.java:233)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:148)
Caused by: org.apache.tez.dag.api.TezException: org.apache.hadoop.yarn.exceptions.YarnException: Failed to submit application_1528895103783_0002 to YARN : org.apache.hadoop.security.AccessControlException: Queue root.default already has 1 applications, cannot accept submission of application: application_1528895103783_0002
    at org.apache.tez.client.TezClient.start(TezClient.java:388)
    at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:197)
    at org.apache.hadoop.hive.ql.exec.tez.TezSessionState.open(TezSessionState.java:116)
    at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:579)
    ... 8 more
Caused by: org.apache.hadoop.yarn.exceptions.YarnException: Failed to submit application_1528895103783_0002 to YARN : org.apache.hadoop.security.AccessControlException: Queue root.default already has 1 applications, cannot accept submission of application: application_1528895103783_0002
    at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.submitApplication(YarnClientImpl.java:272)
    at org.apache.tez.client.TezYarnClient.submitApplication(TezYarnClient.java:72)
    at org.apache.tez.client.TezClient.start(TezClient.java:383)
    ... 11 more

【问题讨论】:

    标签: hadoop hive ibm-cloud analytics-engine


    【解决方案1】:

    我已按照https://hortonworks.com/tutorial/interactive-sql-on-hadoop-with-hive-llap/ 中描述的程序进行操作,并且有效。

    我认为,您应该注意的一点是按照建议更改 YARN 内存,而程序中没有的一件事是启用“Pre-emption” YARN 功能。

    问候, 让

    【讨论】:

      猜你喜欢
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      • 2022-07-13
      • 1970-01-01
      • 1970-01-01
      • 2014-05-12
      • 2012-01-03
      • 2018-11-02
      相关资源
      最近更新 更多