dousha7904 2017-12-03 05:25
浏览 83
已采纳

将byte []转换为golang中的字符串奇怪占据堆

I found strange occupy heap when convert byte[] to string with below code

package main

import (
  "bytes"
  "fmt"
  "net/http"
  _ "net/http/pprof"
  "strings"
  "time"
)

var (
  c = make(chan int, 500000)
)

func main() {
  go func() {
    http.ListenAndServe(":8080", nil)
  }()
  f := func(ss []string) {
    fmt.Println(ss)
    time.Sleep(time.Millisecond)
    <-c
  }
  for {
    c <- 1
    bs := bytes.NewBufferString("A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Q,R,S,T,U,V,W,X,Y,Z").Bytes()
    fmt.Println(bs) // will raise memory leak after marked as comment???
    s := string(bs)
    ss := strings.Split(s, ",")
    go f(ss)
  }
}
  1. without fmt.Println(bs) will gradually exhausting memory.

  2. with fmt.Println(bs) work fine. i can't understand what happened? i'm worked with version go1.9.2 darwin/amd64

  • 写回答

1条回答 默认 最新

  • dounan9070 2017-12-03 07:25
    关注

    No, there is no memory leak:
    You are using 500000 concurrent goroutines, you just need to limit (reduce) the number of concurrent goroutines, e.g.:

    c := make(chan int, runtime.NumCPU())
    

    Try this ( and see the end of this edit):

    package main
    
    import (
        "bytes"
        "fmt"
        "runtime"
        "strings"
        "time"
    )
    
    func main() {
        c := make(chan int, runtime.NumCPU())
        for {
            c <- 1
            bs := bytes.NewBufferString("A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Q,R,S,T,U,V,W,X,Y,Z").Bytes()
            s := string(bs)
            ss := strings.Split(s, ",")
            go func(ss []string) {
                fmt.Println(ss)
                time.Sleep(time.Millisecond)
                <-c
            }(ss)
        }
    }
    

    Your Code:

    package main
    
    import (
        "bytes"
        "fmt"
        "net/http"
        _ "net/http/pprof"
        "strings"
        "time"
    )
    
    var (
        c = make(chan int, 500000)
    )
    
    func main() {
        go func() {
            http.ListenAndServe(":8080", nil)
        }()
        f := func(ss []string) {
            fmt.Println(ss)
            time.Sleep(time.Millisecond)
            <-c
        }
        for {
            c <- 1
            bs := bytes.NewBufferString("A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Q,R,S,T,U,V,W,X,Y,Z").Bytes()
            // fmt.Println(bs) // will raise memory leak after marked as comment???
            s := string(bs)
            ss := strings.Split(s, ",")
            go f(ss)
        }
    }
    

    It reaches steady state after a while and even reduced Memory usage:

    // Mem          CPU time:
    // 5,464,208K 0:1:20
    // 5,468,208K 0:2:20
    // 5,469,608K 0:3:20
    // 5,469,844K 0:4:20
    // 5,469,844K 0:5:20
    // 5,469,848K 0:6:20
    // 5,469,848K 0:7:20 fixed
    // 5,469,848K 0:8:20 fixed
    // 5,469,616K 0:9:20 reduced
    
    本回答被题主选为最佳回答 , 对您是否有帮助呢?
    评论

报告相同问题?

悬赏问题

  • ¥100 如何用js写一个游戏云存档
  • ¥15 ansys fluent计算闪退
  • ¥15 有关wireshark抓包的问题
  • ¥15 需要写计算过程,不要写代码,求解答,数据都在图上
  • ¥15 向数据表用newid方式插入GUID问题
  • ¥15 multisim电路设计
  • ¥20 用keil,写代码解决两个问题,用库函数
  • ¥50 ID中开关量采样信号通道、以及程序流程的设计
  • ¥15 U-Mamba/nnunetv2固定随机数种子
  • ¥30 C++行情软件的tick数据如何高效的合成K线