【问题标题】:wso2 am 1.9.1 + bam 2.5 issue on linuxwso2 am 1.9.1 + bam 2.5 在 linux 上的问题
【发布时间】:2016-03-27 06:56:22
【问题描述】:

我在同一台 linux 机器上安装 wso2 am 1.9.1 和 wso2 bam 2.5,并按照https://docs.wso2.com/display/AM190/Publishing+API+Runtime+Statistics 的描述配置 wso2 am 和 bam。但是当我启动wso2 bam时,脚本am_stats_analyzer又运行起来了,没有报错。在 wso2 am 部分,显示未配置统计信息。

java版本是Oracle jdk 1.7.80。并以root身份运行。日志在下面,这些会一次又一次地打印出来,请帮帮我!

日志

 [2015-12-21 02:22:00,005]  INFO {org.wso2.carbon.analytics.hive.task.HiveScriptExecutorTask} -  Running script executor task for script **am_stats_analyzer**. 
 [Mon Dec 21 02:22:00 CST 2015]Hive history file=/home/wso2bam-2.5.0/tmp/hive/root-querylogs/hive_job_log_root_201512210222_2145444007.txt
 OK
 OK
 Total MapReduce jobs = 1
 Launching Job 1 out of 1
 Number of reduce tasks not specified. Estimated from input data size: 1
 In order to change the average load for a reducer (in bytes):
    set hive.exec.reducers.bytes.per.reducer=<number>
 In order to limit the maximum number of reducers:
   set hive.exec.reducers.max=<number>
 In order to set a constant number of reducers:
   set mapred.reduce.tasks=<number>
 log4j:WARN No appenders could be found for logger (org.apache.axiom.util.stax.dialect.StAXDialectDetector).
 log4j:WARN Please initialize the log4j system properly.
 Execution log at: /home/wso2bam-2.5.0/repository/logs//wso2carbon.log
 [2015-12-21 02:22:07,801]  WARN {org.apache.hadoop.mapred.JobClient} -  Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
 Job running in-process (local Hadoop)
 Hadoop job information for null: number of mappers: 0; number of reducers: 0
 2015-12-21 02:22:10,999 null map = 0%,  reduce = 0%
 2015-12-21 02:22:14,001 null map = 100%,  reduce = 0%
 2015-12-21 02:22:20,004 null map = 100%,  reduce = 100%
 Ended Job = job_local_0001
 Execution completed successfully
 Mapred Local Task Succeeded . Convert the Join into MapJoin
 OK
 OK
 Total MapReduce jobs = 1
 Launching Job 1 out of 1
 Number of reduce tasks not specified. Estimated from input data size: 1
 In order to change the average load for a reducer (in bytes):
   set hive.exec.reducers.bytes.per.reducer=<number>
 In order to limit the maximum number of reducers:
   set hive.exec.reducers.max=<number>
 In order to set a constant number of reducers:
   set mapred.reduce.tasks=<number>
 log4j:WARN No appenders could be found for logger (org.apache.axiom.util.stax.dialect.StAXDialectDetector).
 log4j:WARN Please initialize the log4j system properly.
 Execution log at: /home/wso2bam-2.5.0/repository/logs//wso2carbon.log
 [2015-12-21 02:22:24,419]  WARN {org.apache.hadoop.mapred.JobClient} -  Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
 Job running in-process (local Hadoop)
 Hadoop job information for null: number of mappers: 0; number of reducers: 0
 2015-12-21 02:22:27,574 null map = 0%,  reduce = 0%
 2015-12-21 02:22:30,576 null map = 100%,  reduce = 0%
 2015-12-21 02:22:36,579 null map = 100%,  reduce = 100%
 Ended Job = job_local_0001
 Execution completed successfully
 Mapred Local Task Succeeded . Convert the Join into MapJoin
 OK
 OK
 Total MapReduce jobs = 1
 Launching Job 1 out of 1
 Number of reduce tasks not specified. Estimated from input data size: 1
 In order to change the average load for a reducer (in bytes):
   set hive.exec.reducers.bytes.per.reducer=<number>

 In order to limit the maximum number of reducers:
   set hive.exec.reducers.max=<number>

 In order to set a constant number of reducers:
   set mapred.reduce.tasks=<number>

 log4j:WARN No appenders could be found for logger (org.apache.axiom.util.stax.dialect.StAXDialectDetector).
 log4j:WARN Please initialize the log4j system properly.
 Execution log at: /home/wso2bam-2.5.0/repository/logs//wso2carbon.log
 [2015-12-21 02:22:40,883]  WARN {org.apache.hadoop.mapred.JobClient} -  Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
 Job running in-process (local Hadoop)
 Hadoop job information for null: number of mappers: 0; number of reducers: 0
 2015-12-21 02:22:43,945 null map = 0%,  reduce = 0%
 2015-12-21 02:22:46,947 null map = 100%,  reduce = 0%
 2015-12-21 02:22:52,950 null map = 100%,  reduce = 100%
 Ended Job = job_local_0001
 Execution completed successfully
 Mapred Local Task Succeeded . Convert the Join into MapJoin
 OK
 OK
 OK
 Total MapReduce jobs = 1

【问题讨论】:

    标签: wso2 wso2-am wso2bam


    【解决方案1】:

    在 APIM 发布者门户中未显示统计数据可能有多种原因。因为统计数据表不是使用 hive 脚本创建的,该脚本计划每两分钟运行一次(CORN 表达式 0 0/2 * * * ? in am_stats_analyzer)。数据不会插入到相应的表中。因此,您必须(Curl 命令/Advance Rest 客户端)调用 api。一旦 api 命中请求,统计值就会被插入到在 TestStatsDB 架构下创建的表中。

    【讨论】:

      猜你喜欢
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      相关资源
      最近更新 更多