【问题标题】:Exception in export data from hcatalog to teradata将数据从 hcatalog 导出到 teradata 时出现异常
【发布时间】:2016-07-04 09:14:27
【问题描述】:

我正在尝试使用 Sqoop 将表导出到 Teradata。
表数据是在 mapreduce 作业中以 parquet 格式创建的,然后我使用 Impala 创建了指向该数据的外部表。

这是我正在运行的命令:

sqoop export --connect jdbc:teradata://<ip>/DATABASE=TESTDB --username <username> --password <password> \
    --hcatalog-database parq_xml --hcatalog-table <table_name> --table <table_name>

但它失败并出现下一个异常(仅显示尾部):

16/03/17 23:45:21 INFO hcat.SqoopHCatUtilities: Adding to job classpath: file:/opt/cloudera/parcels/CDH-5.4.0-1.cdh5.4.0.p0.27/lib/hive/lib/hive-jdbc-standalone.jar
16/03/17 23:45:21 INFO hcat.SqoopHCatUtilities: Adding to job classpath: file:/opt/cloudera/parcels/CDH-5.4.0-1.cdh5.4.0.p0.27/lib/hive/lib/zookeeper.jar
16/03/17 23:45:21 INFO hcat.SqoopHCatUtilities: Adding to job classpath: file:/opt/cloudera/parcels/CDH-5.4.0-1.cdh5.4.0.p0.27/lib/hive/lib/commons-collections-3.2.1.jar
16/03/17 23:45:21 INFO hcat.SqoopHCatUtilities: Adding to job classpath: file:/opt/cloudera/parcels/CDH-5.4.0-1.cdh5.4.0.p0.27/lib/hive/lib/logredactor-1.0.2.jar
16/03/17 23:45:21 INFO hcat.SqoopHCatUtilities: Adding jar files under /opt/cloudera/parcels/CDH-5.4.0-1.cdh5.4.0.p0.27/bin/../lib/sqoop/../hive-hcatalog/share/hcatalog/storage-handlers to distributed cache (recursively)
16/03/17 23:45:21 WARN hcat.SqoopHCatUtilities: No files under /opt/cloudera/parcels/CDH-5.4.0-1.cdh5.4.0.p0.27/bin/../lib/sqoop/../hive-hcatalog/share/hcatalog/storage-handlers to add to distributed cache for hcatalog job
16/03/17 23:45:21 INFO common.ConnectorPlugin: load plugins in file:/home/ovlasyuk/xml/teradata.connector.plugins.xml
16/03/17 23:45:21 ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.IllegalArgumentException: Can not create a Path from a null string
java.lang.IllegalArgumentException: Can not create a Path from a null string
        at org.apache.hadoop.fs.Path.checkPathArg(Path.java:123)
        at org.apache.hadoop.fs.Path.<init>(Path.java:135)
        at com.cloudera.connector.teradata.exports.ExportJob.configureOutputFormat(ExportJob.java:176)
        at org.apache.sqoop.mapreduce.ExportJobBase.runExport(ExportJobBase.java:425)
        at com.cloudera.connector.teradata.TeradataManager.exportTable(TeradataManager.java:97)
        at org.apache.sqoop.tool.ExportTool.exportTable(ExportTool.java:81)
        at org.apache.sqoop.tool.ExportTool.run(ExportTool.java:100)
        at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
        at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
        at org.apache.sqoop.Sqoop.main(Sqoop.java:236)

怎么了?

【问题讨论】:

    标签: hadoop sqoop hcatalog


    【解决方案1】:

    好的,答案是 Teradata 连接器不支持 Hcatalog。

    【讨论】:

      猜你喜欢
      • 2018-02-19
      • 2019-03-10
      • 2019-09-27
      • 2017-08-24
      • 2018-08-24
      • 2013-04-11
      • 1970-01-01
      • 2016-07-30
      • 2018-07-06
      相关资源
      最近更新 更多