【问题标题】:Google Cloud Search: Apache Nutch connector, No IndexWriters activated - check your configurationGoogle Cloud Search:Apache Nutch 连接器,未激活 IndexWriters - 检查您的配置
【发布时间】:2019-03-18 18:43:34
【问题描述】:

参考这个帖子 thread

我也尝试使用 Google Cloud Search,但问题不同。

我停留在“没有激活 IndexWriters - 检查您的配置”

我在thread 中添加了conf/nutch-site.xml 示例

    <property>
      <name>plugin.includes</name>
      <value>protocol-httpclient|urlfilter-regex|parse-(html|tika)|index-(basic|more|metadata)|indexer-google-cloud-search|urlnormalizer-(pass|regex|basic)</value>
      <description>Regular expression naming plugin directory names to
      include.  Any plugin not matching this expression is excluded.
      In any case you need at least include the nutch-extensionpoints plugin. By
      default Nutch includes crawling just HTML and plain text via HTTP,
      and basic indexing and search plugins. In order to use HTTPS please enable
      protocol-httpclient, but be aware of possible intermittent problems with the
      underlying commons-httpclient library.
      </description>
    </property>

但是我没有得到下面的输出。

      INFO  gcs.GoogleCloudSearchIndexWriter - Starting up!

相反,我得到了这个。

    Indexer: starting at 2019-03-16 14:53:13
    Indexer: deleting gone documents: false
    Indexer: URL filtering: false
    Indexer: URL normalizing: false
    No IndexWriters activated - check your configuration

    Indexer: number of documents indexed, deleted, or skipped:
    Indexer:      1  indexed (add/update)
    Indexer: finished at 2019-03-16 14:53:14, elapsed: 00:00:01

请引导我前进。

【问题讨论】:

    标签: nutch


    【解决方案1】:

    您只启用了索引器插件(在这种情况下,它只将数据发送到输出 GCS)。您仍然需要配置一个IndexWriter。看看example template provided with Nutch

    【讨论】:

      猜你喜欢
      • 1970-01-01
      • 2013-07-13
      • 2014-01-27
      • 2014-07-30
      • 1970-01-01
      • 2014-11-06
      • 1970-01-01
      • 2019-05-08
      • 2015-07-15
      相关资源
      最近更新 更多