douyun6399
2016-02-18 03:49
浏览 313
已采纳

使用golang将数千个节点插入neo4j

I am importing data to neo4j using neoism, and I have some issues importing big data, 1000 nodes, would take 8s. here is a part of the code that imports 100nodes. quite basic code, needs improvement, anyone can help me improve this?

var wg sync.WaitGroup
for _, itemProps := range items {
    wg.Add(1)
    go func(i interface{}) {
        s := time.Now()
        cypher := neoism.CypherQuery{
            Statement: fmt.Sprintf(`
                CREATE (%v)
                SET i = {Props}
                RETURN i
            `, ItemLabel),
            Parameters: neoism.Props{"Props": i},
        }
        if err := database.ExecuteCypherQuery(cypher); err != nil {
            utils.Error(fmt.Sprintf("error ImportItemsNeo4j! %v", err))
            wg.Done()
            return
        }
        utils.Info(fmt.Sprintf("import Item success! took: %v", time.Since(s)))
        wg.Done()
    }(itemProps)
}
wg.Wait()
  • 写回答
  • 好问题 提建议
  • 追加酬金
  • 关注问题
  • 邀请回答

1条回答 默认 最新

  • dream752614590 2016-02-18 08:45
    最佳回答

    Afaik neoism still uses old APIs, you should use cq instead: https://github.com/go-cq/cq

    also you should batch your creates,

    i.e. either send multiple statements per request, e.g 100 statements per request

    or even better send a list of parameters to a single cypher query:

    e.g. {data} is a [{id:1},{id:2},...]

    UNWIND {data} as props
    CREATE (n:Label) SET n = props
    
    评论
    解决 无用
    打赏 举报

相关推荐 更多相似问题