【问题标题】:Solr 7.4 throws an error when I try to start it当我尝试启动 Solr 7.4 时,它会引发错误
【发布时间】:2021-07-23 21:54:42
【问题描述】:

我正在将 Solr 从 3 台旧机器迁移到 3 台新机器,但我只能让 Solr 在 3 台新机器中的一台上运行。 Solr 在 3 台旧机器上运行良好,但无法弄清楚为什么它不能在 2 台新机器上运行。

我在 3 台 RHEL 7 机器上运行 Solr 7.4。

对于 Solr 无法启动的 2 台新机器,我在尝试启动它时收到以下错误。

Starting Solr...

find: `/user/solr/tagCollection/core_node3': No such file or directory

*** [WARN] *** Your open file limit is currently 1024.
 It should be set to 65000 to avoid operational disruption.
 If you no longer wish to see this warning, set SOLR_ULIMIT_CHECKS to false in your profile or solr.in.sh
*** [WARN] ***  Your Max Processes Limit is currently 4096.
 It should be set to 65000 to avoid operational disruption.
 If you no longer wish to see this warning, set SOLR_ULIMIT_CHECKS to false in your profile or solr.in.sh
Waiting up to 180 seconds to see Solr running on port 8983 [-]  Still not seeing Solr listening on 8983 after 180 seconds!

2021-06-22 08:15:48.910 INFO  (qtp867148091-17) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.Collection3.shard1.replica_n1:UPDATE./update.requests&key=solr.core.Collection3.shard1.replica_n1:QUERY./select.requests&key=solr.core.Collection3.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=183
2021-06-22 08:15:48.911 INFO  (qtp867148091-20) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.jvm:os.processCpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemLoadAverage&key=solr.jvm:memory.heap.used} status=0 QTime=1
2021-06-22 08:16:49.424 INFO  (qtp867148091-17) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.Collection3.shard1.replica_n1:UPDATE./update.requests&key=solr.core.Collection3.shard1.replica_n1:QUERY./select.requests&key=solr.core.Collection3.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=182
2021-06-22 08:16:49.425 INFO  (qtp867148091-16) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.jvm:os.processCpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemLoadAverage&key=solr.jvm:memory.heap.used} status=0 QTime=0
2021-06-22 08:17:49.932 INFO  (qtp867148091-17) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.Collection3.shard1.replica_n1:UPDATE./update.requests&key=solr.core.Collection3.shard1.replica_n1:QUERY./select.requests&key=solr.core.Collection3.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=186
2021-06-22 08:17:49.934 INFO  (qtp867148091-13) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.jvm:os.processCpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemLoadAverage&key=solr.jvm:memory.heap.used} status=0 QTime=1
2021-06-22 08:18:50.463 INFO  (qtp867148091-13) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.Collection3.shard1.replica_n1:UPDATE./update.requests&key=solr.core.Collection3.shard1.replica_n1:QUERY./select.requests&key=solr.core.Collection3.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=188
2021-06-22 08:18:50.466 INFO  (qtp867148091-22) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.jvm:os.processCpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemLoadAverage&key=solr.jvm:memory.heap.used} status=0 QTime=1
2021-06-22 08:19:50.979 INFO  (qtp867148091-13) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.Collection3.shard1.replica_n1:UPDATE./update.requests&key=solr.core.Collection3.shard1.replica_n1:QUERY./select.requests&key=solr.core.Collection3.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=187
2021-06-22 08:19:50.981 INFO  (qtp867148091-19) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.jvm:os.processCpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemLoadAverage&key=solr.jvm:memory.heap.used} status=0 QTime=1
2021-06-22 08:20:01.494 INFO  (qtp867148091-18) [   ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=clusterstatus&wt=json and sendToOCPQueue=true
2021-06-22 08:20:01.495 INFO  (qtp867148091-18) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=clusterstatus&wt=json} status=0 QTime=1
2021-06-22 08:20:51.495 INFO  (qtp867148091-13) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.Collection3.shard1.replica_n1:UPDATE./update.requests&key=solr.core.Collection3.shard1.replica_n1:QUERY./select.requests&key=solr.core.Collection3.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=188
2021-06-22 08:20:51.502 INFO  (qtp867148091-14) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.jvm:os.processCpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemLoadAverage&key=solr.jvm:memory.heap.used} status=0 QTime=6
2021-06-22 08:21:52.024 INFO  (qtp867148091-13) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.Collection3.shard1.replica_n1:UPDATE./update.requests&key=solr.core.Collection3.shard1.replica_n1:QUERY./select.requests&key=solr.core.Collection3.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=186
2021-06-22 08:21:52.026 INFO  (qtp867148091-16) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.jvm:os.processCpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemLoadAverage&key=solr.jvm:memory.heap.used} status=0 QTime=1
2021-06-22 08:22:52.546 INFO  (qtp867148091-13) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.Collection3.shard1.replica_n1:UPDATE./update.requests&key=solr.core.Collection3.shard1.replica_n1:QUERY./select.requests&key=solr.core.Collection3.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=186
2021-06-22 08:22:52.548 INFO  (qtp867148091-20) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.jvm:os.processCpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemLoadAverage&key=solr.jvm:memory.heap.used} status=0 QTime=1
2021-06-22 08:23:53.050 INFO  (qtp867148091-20) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.Collection3.shard1.replica_n1:UPDATE./update.requests&key=solr.core.Collection3.shard1.replica_n1:QUERY./select.requests&key=solr.core.Collection3.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=182
2021-06-22 08:23:53.053 INFO  (qtp867148091-22) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.jvm:os.processCpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemLoadAverage&key=solr.jvm:memory.heap.used} status=0 QTime=1
2021-06-22 08:24:53.569 INFO  (qtp867148091-20) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.Collection3.shard1.replica_n1:UPDATE./update.requests&key=solr.core.Collection3.shard1.replica_n1:QUERY./select.requests&key=solr.core.Collection3.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=188
2021-06-22 08:24:53.570 INFO  (qtp867148091-85) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.jvm:os.processCpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemLoadAverage&key=solr.jvm:memory.heap.used} status=0 QTime=0
2021-06-22 08:25:01.787 INFO  (qtp867148091-18) [   ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterstatus with params action=clusterstatus&wt=json and sendToOCPQueue=true
2021-06-22 08:25:01.788 INFO  (qtp867148091-18) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=clusterstatus&wt=json} status=0 QTime=1
2021-06-22 08:25:54.096 INFO  (qtp867148091-20) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.Collection3.shard1.replica_n1:UPDATE./update.requests&key=solr.core.Collection3.shard1.replica_n1:QUERY./select.requests&key=solr.core.Collection3.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=186
2021-06-22 08:25:54.098 INFO  (qtp867148091-14) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.jvm:os.processCpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemLoadAverage&key=solr.jvm:memory.heap.used} status=0 QTime=0
2021-06-22 08:26:54.617 INFO  (qtp867148091-20) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.Collection3.shard1.replica_n1:UPDATE./update.requests&key=solr.core.Collection3.shard1.replica_n1:QUERY./select.requests&key=solr.core.Collection3.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=194
2021-06-22 08:26:54.619 INFO  (qtp867148091-19) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.jvm:os.processCpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemLoadAverage&key=solr.jvm:memory.heap.used} status=0 QTime=0
2021-06-22 08:27:55.130 INFO  (qtp867148091-19) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.core.Collection3.shard1.replica_n1:UPDATE./update.requests&key=solr.core.Collection3.shard1.replica_n1:QUERY./select.requests&key=solr.core.Collection3.shard1.replica_n1:INDEX.sizeInBytes} status=0 QTime=188
2021-06-22 08:27:55.131 INFO  (qtp867148091-13) [   ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={wt=javabin&version=2&key=solr.jvm:os.processCpuLoad&key=solr.node:CONTAINER.fs.coreRoot.usableSpace&key=solr.jvm:os.systemLoadAverage&key=solr.jvm:memory.heap.used} status=0 QTime=

有人对如何解决这个问题有任何想法吗?我已经更新了所有配置设置以使用 Zookeeper 中的新 IP,并且当我在所有 3 台新服务器上运行 zookeeper 状态时,它们会相应地报告。我真的很难理解为什么 3 台新服务器中有 1 台正在运行。

此外,这是我在 Solr 运行良好的 1 台主机上获得的输出。

Starting Solr...

find: `/user/solr/tagCollection/core_node3': No such file or directory

*** [WARN] *** Your open file limit is currently 1024.
 It should be set to 65000 to avoid operational disruption.
 If you no longer wish to see this warning, set SOLR_ULIMIT_CHECKS to false in your profile or solr.in.sh
*** [WARN] ***  Your Max Processes Limit is currently 1024.
 It should be set to 65000 to avoid operational disruption.
 If you no longer wish to see this warning, set SOLR_ULIMIT_CHECKS to false in your profile or solr.in.sh
Warning: Available entropy is low. As a result, use of the UUIDField, SSL, or any other features that require
RNG might not work properly. To check for the amount of available entropy, use 'cat /proc/sys/kernel/random/entropy_avail'.

Waiting up to 180 seconds to see Solr running on port 8983 [\]
Started Solr server on port 8983 (pid=10825). Happy searching!
                                                                                                                                                                  
COMMAND   PID     USER   FD   TYPE  DEVICE SIZE/OFF NODE NAME
java    10825 solruser  125u  IPv6 7365290      0t0  TCP *:8983 (LISTEN)

【问题讨论】:

  • 问题的日志数据中似乎没有任何实际错误 - 只是一些 WARN 和 INFO 消息。我至少会修复警告,如日志消息中所述(如果可能,还有“没有这样的文件”消息)。

标签: solr lucene apache-zookeeper solrcloud solr7


【解决方案1】:

因此,在花费数小时尝试解决此问题后,我们发现我们的 2 台新虚拟机没有重新创建,以使其具有与旧机器相同的规格。他们的内存大约是我们原来机器的一半。因此,每当我们在它们上启动 Solr 时,它们都不会启动,因为作为 Solr 启动过程的一部分,我们为 RAM 设置了一个自定义大小,该值比新机器的值更高。将 2 台服务器重建为具有正确规格的新实例后,Solr 启动时没有任何问题。

【讨论】:

    【解决方案2】:

    这只是一个警告,如果您将使用大数据,您应该解决它。所以你需要在你的操作系统中添加打开文件的限制。如果您使用Linux,请在/etc/sysctl.conf 中添加以下内容,并在重新登录后重新启动。

    soft nofile 65536
    hard nofile 65536
    

    更多信息:Setting the Open File Limit (Linux/Unix)

    【讨论】:

    • 感谢您的回复。我知道这些只是警告,我可以按照你说的来解决它们,但我真正的困惑是“180 秒后仍然没有看到 Solr 在 8983 上监听!”之后的输出。我不明白为什么我会得到那个输出,我也不明白这意味着什么。我所知道的是,在我的其他主机上,当我在它们上启动 Solr 时,我看到相同的文件打开限制警告,但随后它显示了正常的 Solr 启动输出,并列出了进程 ID。在这种情况下,我没有得到它,而是得到了我在上面共享的重复输出
    猜你喜欢
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 2021-09-10
    • 2022-08-02
    • 1970-01-01
    • 1970-01-01
    • 2018-03-22
    • 2019-09-23
    相关资源
    最近更新 更多