duanmou9228 2019-04-09 17:28
浏览 49
已采纳

有效地保留最后N个推送项目的集合

Given:

  1. slice with pre-known capacity
  2. capacity and number of slices are large , and around 15MB of memory will be used, so I don't want to waste memory and want to keep minimum memory.
  3. slice will be updated by removing first element and adding new element to end of slice.

b = append(b[1:], n) will increase capacity

to shift and assign myself, I wrote

func shiftAndPut(a []int, n int) (b []int) {
    b = make([]int, cap(a), cap(a))
    for i,v := range(a[1:]) {
        b[i] = v
    }
    b[len(b)-1] = n
    return
}

https://play.golang.org/p/7xIBh0UPp2w

It keeps the capacity same, but requires various computations

  1. iterating slice one time,
  2. calling of function,
  3. new variable for small time,
  4. sub slicing in range function, which adds more computations,
  5. etc

Is there any more optimised way to do this?

  • 写回答

1条回答 默认 最新

  • duanqinjiao5244 2019-04-09 18:38
    关注

    Slice ring buffer, custom implementation :

    data := make([]int, cap, cap)
    pointer := 0
    
    data[pointer] = newData
    pointer = (pointer+1) % cap
    

    custom/ring package implemetation :

    data := ring.New(cap)
    data.Value = newData
    data = data.Next()
    

    After suggestion in comment thread, I did benchmark between slice custom shifting and custom/ring

    BenchmarkCustom1000-4         100000         17322 ns/op
    BenchmarkRing1000-4           100000         22824 ns/op
    BenchmarkCustom-4           100000000           17.4 ns/op
    BenchmarkRing-4             100000000           22.8 ns/op
    

    custom slice shifting using variable (pointer or flag) is faster and also memory optimised.

    本回答被题主选为最佳回答 , 对您是否有帮助呢?
    评论

报告相同问题?

悬赏问题

  • ¥60 求一个简单的网页(标签-安全|关键词-上传)
  • ¥35 lstm时间序列共享单车预测,loss值优化,参数优化算法
  • ¥15 基于卷积神经网络的声纹识别
  • ¥15 Python中的request,如何使用ssr节点,通过代理requests网页。本人在泰国,需要用大陆ip才能玩网页游戏,合法合规。
  • ¥100 为什么这个恒流源电路不能恒流?
  • ¥15 有偿求跨组件数据流路径图
  • ¥15 写一个方法checkPerson,入参实体类Person,出参布尔值
  • ¥15 我想咨询一下路面纹理三维点云数据处理的一些问题,上传的坐标文件里是怎么对无序点进行编号的,以及xy坐标在处理的时候是进行整体模型分片处理的吗
  • ¥15 CSAPPattacklab
  • ¥15 一直显示正在等待HID—ISP