【问题标题】:While trying to load data using DSE graphloader I am getting the error - DSE Graph not configured to process queries尝试使用 DSE graphloader 加载数据时出现错误 - DSE Graph 未配置为处理查询
【发布时间】:2016-12-29 04:34:31
【问题描述】:

我正在使用 DSE Graphloader 将数据从 CSV 文件加载到 DSE Graph。

我做了以下步骤来加载数据——

创建图表:

system.graph('followTopic').create()

设置别名:

:remote config alias g followTopic.g

创建以下架构:

schema.propertyKey("id").Text().single().create()
schema.propertyKey("follower").Text().single().create()
schema.propertyKey("name").Text().single().create()
schema.propertyKey("type").Text().single().create()
schema.propertyKey("followed").Text().single().create()
schema.propertyKey("timestamp").Timestamp().single().create()
schema.vertexLabel("record").partitionKey("id").create()
schema.vertexLabel("user").properties("name").create()`

映射文件:

// CONFIGURATION

// Configures the data loader to create the schema
config create_schema: false, load_new: true, load_threads: 3

// DATA INPUT
// Define the data input source (a file which can be specified via command    line arguments)
// inputfiledir is the directory for the input files

inputfiledir = '/home/adminuser/data/'
followTopic = File.csv(inputfiledir + "follow.csv").delimiter(',')

//Specifies what data source to load using which mapper (as defined inline)

load(followTopic).asVertices {
   label "record"
   key "id"
}

我使用的 CSV 是:

id,follower,followed,type,timestamp
1,@20cburns,topic_/best-friend,topic,5/7/2016 11:03:42 PM +00:00
2,@68,topic_/tears-fall,topic,5/3/2016 2:20:01 AM +00:00
3,@abba,topic_/best-friend,topic,6/15/2016 4:08:24 PM +00:00
…

然后在运行 graphloader 命令时,我得到下面提到的错误 -

./graphloader ../followTopinMapping.groovy -filename ../follow.csv -graph followTopic -address localhost

异常错误信息:

2016-08-22 14:18:00 ERROR DataLoaderImpl:519 - Graph driver attempts   exceeded for this operation, logging failure, but no records are present (may have been a schema operation)
com.datastax.dsegraphloader.exception.TemporaryException:      com.datastax.driver.core.exceptions.InvalidQueryException: DSE Graph not    configured to process queries
at    com.datastax.dsegraphloader.impl.loader.driver.DseGraphDriverImpl.executeGraphQuery(DseGraphDriverImpl.java:71)
at  com.datastax.dsegraphloader.impl.loader.driver.DseGraphDriverImpl.executeGraphQuery(DseGraphDriverImpl.java:87)
at com.datastax.dsegraphloader.impl.loader.driver.DseGraphDriverImpl.getSchema(DseGraphDriverImpl.java:128)
at com.datastax.dsegraphloader.impl.loader.driver.SafeGraphDriver.lambda$tryGetSchema$14(SafeGraphDriver.java:94)
at com.datastax.dsegraphloader.impl.loader.DataLoaderImpl.execute(DataLoaderImpl.java:194)
at com.datastax.dsegraphloader.impl.loader.DataLoaderBuilder.execute(DataLoaderBuilder.java:101)
at com.datastax.dsegraphloader.cli.Executable.execute(Executable.java:69)
at com.datastax.dsegraphloader.cli.Executable.main(Executable.java:163)

关于错误信息“DSE Graph 未配置为处理查询” 我需要对 DSE Graph loader 进行什么配置才能将数据加载到 DSE Graph 中?

【问题讨论】:

    标签: datastax-enterprise datastax-startup


    【解决方案1】:

    从 DataStax 人员那里获得了帮助以使其正常工作。

    实际上,集群上的一些设置搞砸了,所以我们只是创建了一个新集群,然后在 /etc/default/dse 文件中进行了一项设置以在该集群的节点上启用 DSE Graph 服务-

    GRAPH_ENABLED=1
    

    之后将架构更新为 -

    schema.propertyKey("id").Text().single().create()
    schema.propertyKey("follower").Text().single().create()
    schema.propertyKey("name").Text().single().create()
    schema.propertyKey("type").Text().single().create()
    schema.propertyKey("followed").Text().single().create()
    schema.propertyKey("timestamp").Timestamp().single().create()
    schema.vertexLabel("record").partitionKey("id").properties("follower", "name", "type", "followed", "timestamp").create()
    

    关于 TimeStamp 也应该是一个数字值,以便通过 DSE Graphloader 成功加载。

    在这些更改之后,我能够通过 DSE Graphloader 成功加载数据。

    【讨论】:

      猜你喜欢
      • 2016-12-21
      • 2016-12-08
      • 2018-06-14
      • 2019-09-19
      • 2016-12-26
      • 2017-03-10
      • 2016-11-19
      • 2017-12-19
      • 2019-09-28
      相关资源
      最近更新 更多