dqwh1202 2019-09-15 13:10
浏览 32

Apache Beam-Go SDK的API调用的批处理元素？

I'm building a Beam pipeline with the Go SDK.

I have to do some data enrichment by calling a ML model somewhere on the Cloud.

As I am processing a lot of elements, I can't just make an API call for each element, this will introduce a huge latency. I need to send a batch of elements.

I know in python there is a BatchElements() PTransform, how to make something similar in Go?

  • 写回答

1条回答 默认 最新

  • dongnaizao8039 2019-09-17 15:30
    关注

    There is no such transform that is part of the Beam Go SDK at this time.

    You would need to translate the GroupIntoBatches [1, 2] implementation into Go code. This would be a valuable contribution to Apache Beam so please contribute it if you do this.

    评论

报告相同问题？

悬赏问题

  • ¥15 目前主流的音乐软件，像网易云音乐，QQ音乐他们的前端和后台部分是用的什么技术实现的?求解！
  • ¥60 pb数据库修改与连接
  • ¥15 spss统计中二分类变量和有序变量的相关性分析可以用kendall相关分析吗？
  • ¥15 拟通过pc下指令到安卓系统，如果追求响应速度，尽可能无延迟，是不是用安卓模拟器会优于实体的安卓手机？如果是，可以快多少毫秒？
  • ¥20 神经网络Sequential name=sequential, built=False
  • ¥16 Qphython 用xlrd读取excel报错
  • ¥15 单片机学习顺序问题！！
  • ¥15 ikuai客户端多拨vpn，重启总是有个别重拨不上
  • ¥20 关于#anlogic#sdram#的问题，如何解决？(关键词-performance)
  • ¥15 相敏解调 matlab