【问题标题】:Problems connecting to Cassandra pool from Spring application从 Spring 应用程序连接到 Cassandra 池的问题
【发布时间】:2016-07-16 15:44:05
【问题描述】:

我希望有人能够真正提供帮助,因为我目前正忙于尝试使用 Cassandra ATM。

我的设置: 对于开发,我有一个带有两个节点的最小 Cassandra 3.0.4 集群(一个在我的工作机器上,一个在 VM 上)。通常只有本地的启动并运行。 我使用最新的 Java 驱动程序版本 3.0.0 连接到池。

我的 cassandra.yaml 包含 rpc_addresslisten_address 到每个节点的 IP。种子是我的主要工作机器。

我的问题: 从 cqlsh (在任何时候)以及当两个节点都在运行时(从 Java)一切都运行良好。但是,一旦我在 VM 中停止它,我的基于 Spring 的应用程序就会在启动期间抛出错误:

2016-03-29 09:05:33.515 | INFO  | main                 | com.datastax.driver.core.NettyUtil                          :83    | Did not find Netty's native epoll transport in the classpath, defaulting to NIO.
2016-03-29 09:05:34.147 | INFO  | main                 | com.datastax.driver.core.policies.DCAwareRoundRobinPolicy   :95    | Using data-center name 'datacenter1' for DCAwareRoundRobinPolicy (if this is incorrect, please provide the correct datacenter name with DCAwareRoundRobinPolicy constructor)
2016-03-29 09:05:34.149 | INFO  | main                 | com.datastax.driver.core.Cluster$Manager                    :1475  | New Cassandra host /10.20.30.74:9042 added
2016-03-29 09:05:34.149 | INFO  | main                 | com.datastax.driver.core.Cluster$Manager                    :1475  | New Cassandra host /10.20.30.77:9042 added
2016-03-29 09:05:34.150 | INFO  | main                 | my_company.cassandra.dao.impl.CassandraDaoImpl     :55    | Connected to cluster: TestCaseCluster
2016-03-29 09:05:34.151 | INFO  | main                 | my_company.cassandra.dao.impl.CassandraDaoImpl     :57    | Datacenter: datacenter1; Host: /10.20.30.74; Rack: rack1, State: UP|true
2016-03-29 09:05:34.151 | INFO  | main                 | my_company.cassandra.dao.impl.CassandraDaoImpl     :57    | Datacenter: datacenter1; Host: /10.20.30.77; Rack: rack1, State: UP|true
2016-03-29 09:05:34.220 | WARN  | luster1-nio-worker-2 | com.datastax.driver.core.SessionManager$7                   :378   | Error creating pool to /10.20.30.77:9042
com.datastax.driver.core.exceptions.ConnectionException: [/10.20.30.77] Pool was closed during initialization
    at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:149) [cassandra-driver-core-3.0.0.jar:?]
    at com.datastax.driver.core.HostConnectionPool$2.onSuccess(HostConnectionPool.java:135) [cassandra-driver-core-3.0.0.jar:?]
    at com.google.common.util.concurrent.Futures$4.run(Futures.java:1181) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:297) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.ExecutionList.executeListener(ExecutionList.java:156) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:145) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:185) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.Futures$CombinedFuture.setOneValue(Futures.java:1626) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.Futures$CombinedFuture.access$400(Futures.java:1470) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.Futures$CombinedFuture$2.run(Futures.java:1548) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:297) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.ExecutionList.executeListener(ExecutionList.java:156) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:145) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.AbstractFuture.set(AbstractFuture.java:185) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.Futures$FallbackFuture$1$1.onSuccess(Futures.java:475) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.Futures$4.run(Futures.java:1181) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:297) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.Futures$ImmediateFuture.addListener(Futures.java:102) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.Futures.addCallback(Futures.java:1184) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.Futures$FallbackFuture$1.onFailure(Futures.java:472) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.Futures$4.run(Futures.java:1172) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:297) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.ExecutionList.executeListener(ExecutionList.java:156) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:145) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:202) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.Futures$FallbackFuture$1$1.onFailure(Futures.java:483) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.Futures$4.run(Futures.java:1172) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:297) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.ExecutionList.executeListener(ExecutionList.java:156) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.ExecutionList.add(ExecutionList.java:101) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.AbstractFuture.addListener(AbstractFuture.java:170) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.Futures.addCallback(Futures.java:1184) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.Futures$FallbackFuture$1.onFailure(Futures.java:472) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.Futures$4.run(Futures.java:1172) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:297) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.ExecutionList.executeListener(ExecutionList.java:156) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:145) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:202) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.Futures$ChainingListenableFuture.run(Futures.java:857) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.MoreExecutors$SameThreadExecutorService.execute(MoreExecutors.java:297) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.ExecutionList.executeListener(ExecutionList.java:156) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.ExecutionList.execute(ExecutionList.java:145) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:202) [guava-16.0.1.jar:?]
    at com.google.common.util.concurrent.SettableFuture.setException(SettableFuture.java:68) [guava-16.0.1.jar:?]
    at com.datastax.driver.core.Connection$1.operationComplete(Connection.java:157) [cassandra-driver-core-3.0.0.jar:?]
    at com.datastax.driver.core.Connection$1.operationComplete(Connection.java:140) [cassandra-driver-core-3.0.0.jar:?]
    at io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:680) [netty-common-4.0.33.Final.jar:4.0.33.Final]
    at io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:603) [netty-common-4.0.33.Final.jar:4.0.33.Final]
    at io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:563) [netty-common-4.0.33.Final.jar:4.0.33.Final]
    at io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:424) [netty-common-4.0.33.Final.jar:4.0.33.Final]
    at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:276) [netty-transport-4.0.33.Final.jar:4.0.33.Final]
    at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:292) [netty-transport-4.0.33.Final.jar:4.0.33.Final]
    at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:528) [netty-transport-4.0.33.Final.jar:4.0.33.Final]
    at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468) [netty-transport-4.0.33.Final.jar:4.0.33.Final]
    at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382) [netty-transport-4.0.33.Final.jar:4.0.33.Final]
    at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354) [netty-transport-4.0.33.Final.jar:4.0.33.Final]
    at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:112) [netty-common-4.0.33.Final.jar:4.0.33.Final]
    at java.lang.Thread.run(Thread.java:745) [?:1.8.0_74]

在这个例子中,我觉得下面这行很有趣:

Datacenter: datacenter1; Host: /10.20.30.77; Rack: rack1, State: UP|true

因为这是提到的虚拟机,实际上已经关闭:

Datacenter: datacenter1
=======================
Status=Up/Down
|/ State=Normal/Leaving/Joining/Moving
--  Address      Load       Tokens       Owns (effective)  Host ID                               Rack
DN  10.20.30.77  89.12 KB   256          100.0%            197f6f0f-b820-4ab8-b7ef-bcc8773a345c  rack1
UN  10.20.30.74  96.26 KB   256          100.0%            db7d053b-f8d1-4a59-9cb2-3abf54b24687  rack1

根据nodetools status 的这段摘录,DN 应该表示“下降”和“正常”。 据我了解,Java 驱动程序不会将第二个节点识别为已关闭,但仍会尝试连接到它,因为它位于(可用)节点列表中。

这是一个不兼容的问题,因为驱动版本和Cassandra版本的组合?但我认为,它们是兼容的: DataStax Java-Driver documentation on GitHub

如果您需要更多信息,请询问。我将相应地更新此文本。

感谢和问候。

丹尼尔

edit1:我已经用复制类 SimpleStrategy 和因子 3 初始化了一个 Keyspace - 我读到过,这个数字不应该超过节点的数量(我猜它在文档中的某个地方,但是我没有链接了)...这是一个原因吗?

【问题讨论】:

    标签: java spring spring-boot cassandra nosql


    【解决方案1】:

    可惜,似乎没有人知道这种问题。在互联网上进行了几次尝试和搜索(在这个特定问题上我几乎没有发现任何东西),我几乎放弃了这个想法。

    但是。

    然后有两件事引起了我的注意:

    1. 我的测试密钥空间的复制因子是 3,而我只有两个节点。不太明智。
    2. 如果我仔细观察异常,我会发现这是一个警告,而不是致命错误。

    那又怎样?

    我仍然能够连接到集群并实际查询它,但总是因为这个异常而过早放弃。

    几乎“无事生非”

    到目前为止一切正常,我可以进一步开发我的应用程序。以及了解这个高可用性 NoSQL 数据库以及它与“经典”关系数据库的不同之处,即使查询语言有很多相似之处。 真是太刺激了!

    所以:抱歉大惊小怪!

    干杯, 丹尼尔

    【讨论】:

      【解决方案2】:

      自从我面临同样的问题以来,我尝试阅读更多关于您所面临问题的信息。我有一个包含 4 个节点的集群,但其中一个节点遇到了问题。我执行了以下两个步骤以避免出现此错误 -

      1. 从我在 java 类中创建 cassandra 集群时传递的节点列表中删除了特定的失败节点。
      2. 从我在 cassandra 中的集群配置中删除了该节点。除非节点已从集群中删除,否则 #1 不会进行任何更改。

      可逆地,如果节点已关闭且无法启动,您实际上应该修复节点。如果不需要该节点,则应将其从集群中删除,并且在启动服务时不应弹出警告。我想,Cassandra 需要永久修复此问题(警告),因为如果节点关闭,则不需要创建会话。另一方面,它只是一个警告,如果您的应用程序没有任何可疑之处,可以忽略它。

      【讨论】:

      • 嗨,我遇到了类似的问题。我的集群由以下 thredd 节点组成 spring.data.cassandra.contact-points=10.202.82.25,10.180.19.157,10.180.12.222 但我正在低于错误堆栈 [/10.183.74.152:9042] 初始化期间池已关闭 New Cassandra主机/10.202.82.25:9042 添加了新的Cassandra 主机/10.180.12.222:9042 添加了新的Cassandra 主机/10.180.19.157:9042 添加了新的Cassandra 主机/10.183.74.152:9042 添加了创建池到/10.183.74.152:9042 驱动程序时出错。 core.exceptions.ConnectionException: [/10.183.74.152:9042] 初始化期间池已关闭
      • 不知道为什么它有另一个节点,即 10.183.74.152 以及它来自哪里?你能告诉我我在这里做错了什么吗?
      【解决方案3】:

      'nodetool status' 显示您的 cassandra 节点已关闭,要解决您的问题,您必须启动节点

      【讨论】:

        猜你喜欢
        • 1970-01-01
        • 2018-11-14
        • 1970-01-01
        • 2013-12-23
        • 2020-01-25
        • 1970-01-01
        • 2012-10-19
        • 2014-12-21
        • 2021-09-15
        相关资源
        最近更新 更多