Sqoop 返回“404 Not Found 的响应状态”

【问题标题】：Sqoop returns "response status of 404 Not Found"Sqoop 返回“404 Not Found 的响应状态”
【发布时间】：2015-01-09 22:47:12
【问题描述】：

我在 CentOS 7 上安装了最新的 Hadoop 2.5.1 和 Sqoop 1.99.3（来自 tarball 文件）。 Sqoop 已按照此处的说明安装：http://sqoop.apache.org/docs/1.99.3/Installation.html

然后我想根据这个页面测试Sqoop服务器：http://sqoop.apache.org/docs/1.99.3/Sqoop5MinutesDemo.html

我运行了以下命令：

show version --all

并收到以下错误消息：

Exception: com.sun.jersey.api.client.UniformInterfaceException Message: GET http://localhost:12000/sqoop/version returned a response status of 404 Not Found

这是我尝试启动 Sqoop 服务器后立即包含的配置和日志文件（通过运行 Sqoop.sh server start）：

/etc/bashrc 中的 Sqoop 变量：

export SQOOP_HOME="/usr/local/sqoop"
export SQOOP_CONF_DIR=$SQOOP_HOME/server/conf

/usr/local/sqoop/server/conf/Catalina.properties：

/usr/local/hadoop/share/hadoop/common/*.jar,
/usr/local/hadoop/share/hadoop/common/lib/*.jar,
/usr/local/hadoop/share/hadoop/hdfs/*.jar,
/usr/local/hadoop/share/hadoop/hdfs/lib/*.jar,
/usr/local/hadoop/share/hadoop/mapreduce/*.jar,
/usr/local/hadoop/share/hadoop/mapreduce/lib/*.jar,
/usr/local/hadoop/share/hadoop/tools/*.jar,
/usr/local/hadoop/share/hadoop/tools/lib/*.jar,
/usr/local/hadoop/share/hadoop/yarn/*.jar,
/usr/local/hadoop/share/hadoop/yarn/lib/*.jar

/usr/local/sqoop/server/conf/sqoop.properties：

org.apache.sqoop.submission.engine.mapreduce.configuration.directory=/usr/local/hadoop/etc/hadoop/

/usr/local/sqoop/server/logs/localhost.2014-11-13.log:

SEVERE: Exception sending context initialized event to listener instance of class org.apache.sqoop.server.ServerInitializer
java.lang.NoClassDefFoundError: org/apache/hadoop/conf/Configuration

/usr/local/sqoop/log/sqoop.log:

2014-11-13 08:19:55,466 INFO  audit.AuditLoggerManager [org.apache.sqoop.audit.AuditLoggerManager.initialize(AuditLoggerManager.java:79)] Begin audit logger manager initialization
2014-11-13 08:19:55,470 WARN  audit.FileAuditLogger [org.apache.sqoop.audit.FileAuditLogger.initialize(FileAuditLogger.java:67)] appender: log4j.appender.defaultAppender
2014-11-13 08:19:55,471 INFO  audit.AuditLoggerManager [org.apache.sqoop.audit.AuditLoggerManager.initializeLoggers(AuditLoggerManager.java:126)] Audit Logger has been initialized: default
2014-11-13 08:19:55,471 INFO  audit.AuditLoggerManager [org.apache.sqoop.audit.AuditLoggerManager.initialize(AuditLoggerManager.java:85)] Audit logger manager initialized: OK
2014-11-13 08:19:55,472 INFO  repository.RepositoryManager [org.apache.sqoop.repository.RepositoryManager.initialize(RepositoryManager.java:80)] Setting system properties: {derby.stream.error.file=/usr/loc
2014-11-13 08:19:55,478 INFO  repository.JdbcRepositoryContext [org.apache.sqoop.repository.JdbcRepositoryContext.<init>(JdbcRepositoryContext.java:154)] [repo-ctx] handler=org.apache.sqoop.repository.derb
2014-11-13 08:19:55,683 INFO  derby.DerbyRepositoryHandler [org.apache.sqoop.repository.derby.DerbyRepositoryHandler.initialize(DerbyRepositoryHandler.java:207)] DerbyRepositoryHandler initialized.
2014-11-13 08:19:55,686 INFO  repository.JdbcRepositoryProvider [org.apache.sqoop.repository.JdbcRepositoryProvider.initializeRepositoryHandler(JdbcRepositoryProvider.java:160)] JdbcRepositoryProvider init
2014-11-13 08:19:55,686 INFO  repository.JdbcRepositoryProvider [org.apache.sqoop.repository.JdbcRepositoryProvider.initialize(JdbcRepositoryProvider.java:67)] JdbcRepository initialized.
2014-11-13 08:19:55,686 INFO  repository.RepositoryManager [org.apache.sqoop.repository.RepositoryManager.initialize(RepositoryManager.java:118)] Creating or upgrading on disk structures if necessary
2014-11-13 08:19:56,022 DEBUG repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.begin(JdbcRepositoryTransaction.java:73)] Tx count-begin: 1, rollback: false
2014-11-13 08:19:56,022 INFO  repository.JdbcRepository [org.apache.sqoop.repository.JdbcRepository$1.doIt(JdbcRepository.java:130)] Creating repository schema objects
2014-11-13 08:19:56,198 DEBUG derby.DerbyRepositoryHandler [org.apache.sqoop.repository.derby.DerbyRepositoryHandler.detectVersion(DerbyRepositoryHandler.java:272)] Detecting old version of repository
2014-11-13 08:19:56,354 DEBUG repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.commit(JdbcRepositoryTransaction.java:84)] Tx count-commit: 1, rollback: false
2014-11-13 08:19:56,354 DEBUG repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.close(JdbcRepositoryTransaction.java:103)] Tx count-close: 0, rollback: false
2014-11-13 08:19:56,354 INFO  repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.close(JdbcRepositoryTransaction.java:111)] Attempting transaction commit
2014-11-13 08:19:56,360 DEBUG repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.begin(JdbcRepositoryTransaction.java:73)] Tx count-begin: 1, rollback: false
2014-11-13 08:19:56,375 DEBUG derby.DerbyRepositoryHandler [org.apache.sqoop.repository.derby.DerbyRepositoryHandler.detectVersion(DerbyRepositoryHandler.java:272)] Detecting old version of repository
2014-11-13 08:19:56,375 DEBUG repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.commit(JdbcRepositoryTransaction.java:84)] Tx count-commit: 1, rollback: false
2014-11-13 08:19:56,376 DEBUG repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.close(JdbcRepositoryTransaction.java:103)] Tx count-close: 0, rollback: false
2014-11-13 08:19:56,376 INFO  repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.close(JdbcRepositoryTransaction.java:111)] Attempting transaction commit
2014-11-13 08:19:56,376 INFO  repository.RepositoryManager [org.apache.sqoop.repository.RepositoryManager.initialize(RepositoryManager.java:128)] Repository initialized: OK
2014-11-13 08:19:56,377 INFO  connector.ConnectorManager [org.apache.sqoop.connector.ConnectorManager.initialize(ConnectorManager.java:174)] Connector config urls: [jar:file:/usr/local/sqoop-1.99.3-bin-had
2014-11-13 08:19:56,378 DEBUG connector.ConnectorHandler [org.apache.sqoop.connector.ConnectorHandler.<init>(ConnectorHandler.java:58)] Connector configuration: {org.apache.sqoop.connector.class=org.apache
2014-11-13 08:19:56,415 INFO  connector.ConnectorHandler [org.apache.sqoop.connector.ConnectorHandler.<init>(ConnectorHandler.java:113)] Connector [org.apache.sqoop.connector.jdbc.GenericJdbcConnector] ini
2014-11-13 08:19:56,416 DEBUG repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.begin(JdbcRepositoryTransaction.java:73)] Tx count-begin: 1, rollback: false
2014-11-13 08:19:56,416 DEBUG repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.begin(JdbcRepositoryTransaction.java:73)] Tx count-begin: 2, rollback: false
2014-11-13 08:19:56,416 DEBUG derby.DerbyRepositoryHandler [org.apache.sqoop.repository.derby.DerbyRepositoryHandler.findConnector(DerbyRepositoryHandler.java:441)] Looking up connector: generic-jdbc-conne
2014-11-13 08:19:56,477 DEBUG derby.DerbyRepositoryHandler [org.apache.sqoop.repository.derby.DerbyRepositoryHandler.findConnector(DerbyRepositoryHandler.java:488)] Looking up connector: generic-jdbc-conne
2014-11-13 08:19:56,477 DEBUG repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.commit(JdbcRepositoryTransaction.java:84)] Tx count-commit: 2, rollback: false
2014-11-13 08:19:56,477 DEBUG repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.close(JdbcRepositoryTransaction.java:103)] Tx count-close: 1, rollback: false
2014-11-13 08:19:56,478 DEBUG connector.ConnectorManager [org.apache.sqoop.connector.ConnectorManager.registerConnectors(ConnectorManager.java:227)] Registered connector: connector-generic-jdbc-connector:1
2014-11-13 08:19:56,478 DEBUG repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.commit(JdbcRepositoryTransaction.java:84)] Tx count-commit: 1, rollback: false
2014-11-13 08:19:56,478 DEBUG repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.close(JdbcRepositoryTransaction.java:103)] Tx count-close: 0, rollback: false
2014-11-13 08:19:56,478 INFO  repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.close(JdbcRepositoryTransaction.java:111)] Attempting transaction commit
2014-11-13 08:19:56,478 INFO  connector.ConnectorManager [org.apache.sqoop.connector.ConnectorManager.initialize(ConnectorManager.java:200)] Connectors loaded: {generic-jdbc-connector={generic-jdbc-connect
2014-11-13 08:19:56,486 DEBUG repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.begin(JdbcRepositoryTransaction.java:73)] Tx count-begin: 1, rollback: false
2014-11-13 08:19:56,486 DEBUG derby.DerbyRepositoryHandler [org.apache.sqoop.repository.derby.DerbyRepositoryHandler.findFramework(DerbyRepositoryHandler.java:537)] Looking up framework metadata
2014-11-13 08:19:56,503 DEBUG derby.DerbyRepositoryHandler [org.apache.sqoop.repository.derby.DerbyRepositoryHandler.findFramework(DerbyRepositoryHandler.java:583)] Looking up framework metadta found: fram
2014-11-13 08:19:56,503 DEBUG repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.commit(JdbcRepositoryTransaction.java:84)] Tx count-commit: 1, rollback: false
2014-11-13 08:19:56,503 DEBUG repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.close(JdbcRepositoryTransaction.java:103)] Tx count-close: 0, rollback: false
2014-11-13 08:19:56,503 INFO  repository.JdbcRepositoryTransaction [org.apache.sqoop.repository.JdbcRepositoryTransaction.close(JdbcRepositoryTransaction.java:111)] Attempting transaction commit
2014-11-13 08:19:56,504 INFO  framework.FrameworkManager [org.apache.sqoop.framework.FrameworkManager.initialize(FrameworkManager.java:159)] Submission manager initialized: OK
2014-11-13 08:19:56,507 INFO  mapreduce.MapreduceSubmissionEngine [org.apache.sqoop.submission.mapreduce.MapreduceSubmissionEngine.initialize(MapreduceSubmissionEngine.java:75)] Initializing Map-reduce Sub
2014-11-13 08:19:56,512 INFO  core.SqoopServer [org.apache.sqoop.core.SqoopServer.destroy(SqoopServer.java:35)] Shutting down Sqoop server

根据日志文件的最后一行，Sqoop 服务器自行关闭并且没有启动。我用谷歌搜索了上面所有可能的错误消息组合，但没有找到任何有用的东西。如何解决此问题？

【问题讨论】：

    标签： sqoop


    【解决方案1】：

    这在找不到 hadoop 库时很常见。您可以做两件事：

    1. 通过 apache Big Top 或通过 Hadoop 分销商之一（即Cloudera）安装 Sqoop
    2. 编辑 tomcat 配置以包含这些 jars（正如您在上面尝试过的那样）。日志文件会详细说明缺少哪些类。您可以通过命令行 search 为您丢失的 jars。

    我强烈推荐第一个选项。

    【讨论】：

      【解决方案2】：

      谢谢！我仔细检查了 catalana.properties 文件，并确保 common.loader 部分是单行。如果此部分包含多行，则 TomCat 将不会加载 Sqoop webapp。不接受换行符。

      【讨论】：

        猜你喜欢
        • 2014-01-25
        • 1970-01-01
        • 1970-01-01
        • 2016-02-10
        • 2019-03-14
        • 1970-01-01
        • 2016-03-16
        • 2021-06-03
        • 1970-01-01
        相关资源
        最近更新 更多
        热门标签
        Java Python linux javascript Mysql C# Docker 算法 前端 SpringBoot Redis Vue spring 设计模式 .net core .net kubernetes c++ 数据库 数据结构 大数据 js 机器学习 微服务 Android Go 程序员 面试 JVM ASP.net core 云原生 人工智能 后端 PHP git CSS golang k8s Nginx Django mybatis 深度学习 多线程 React 架构 devops 爬虫 云计算 Spring Boot LeetCode