douyun6399
douyun6399
2016-02-18 03:49
浏览 179
已采纳

使用golang将数千个节点插入neo4j

I am importing data to neo4j using neoism, and I have some issues importing big data, 1000 nodes, would take 8s. here is a part of the code that imports 100nodes. quite basic code, needs improvement, anyone can help me improve this?

var wg sync.WaitGroup
for _, itemProps := range items {
    wg.Add(1)
    go func(i interface{}) {
        s := time.Now()
        cypher := neoism.CypherQuery{
            Statement: fmt.Sprintf(`
                CREATE (%v)
                SET i = {Props}
                RETURN i
            `, ItemLabel),
            Parameters: neoism.Props{"Props": i},
        }
        if err := database.ExecuteCypherQuery(cypher); err != nil {
            utils.Error(fmt.Sprintf("error ImportItemsNeo4j! %v", err))
            wg.Done()
            return
        }
        utils.Info(fmt.Sprintf("import Item success! took: %v", time.Since(s)))
        wg.Done()
    }(itemProps)
}
wg.Wait()

图片转代码服务由CSDN问答提供 功能建议

我正在使用 neoism 将数据导入neo4j,并且在导入大数据时遇到一些问题 ,1000个节点,将花费8s。 这是导入100个节点的代码的一部分。 quite基本代码,需要改进,有人可以帮助我改善吗?

  var wg sync.WaitGroup 
for _,itemProps:=范围项目{
 wg.Add(  1)
 go func(i interface {}){
s:= time.Now()
 cypher:= neoism.CypherQuery {
语句:fmt.Sprintf(`
 CREATE(%v)
 SET  i = {道具} 
返回i 
`,ItemLabel),
参数:neoism.Props {“道具”:i},
} 
如果err:= database.ExecuteCypherQuery(cypher);  err!= nil {
 utils.Error(fmt.Sprintf(“ error ImportItemsNeo4j!%v”,err))
 wg.Done()
 return 
} 
 utils.Info(fmt.Sprintf(“ 导入商品成功!时间:%v“,时间。(因为)))
 wg.Done()
}(itemProps)
} 
wg.Wait()
    
 
  • 点赞
  • 写回答
  • 关注问题
  • 收藏
  • 邀请回答

1条回答 默认 最新

  • dream752614590
    dream752614590 2016-02-18 08:45
    已采纳

    Afaik neoism still uses old APIs, you should use cq instead: https://github.com/go-cq/cq

    also you should batch your creates,

    i.e. either send multiple statements per request, e.g 100 statements per request

    or even better send a list of parameters to a single cypher query:

    e.g. {data} is a [{id:1},{id:2},...]

    UNWIND {data} as props
    CREATE (n:Label) SET n = props
    
    点赞 评论

相关推荐