使用* bufio.Scanner列表以供以后在golang中读取文件是一个好主意吗？

Question

I have a list of delimited files to be read after I obtained their path. Instead of saving path as a string, I'm wondering can I simply store a list of *bufio.Scanner so those will be much easier to be read later (and code will be cleaner too)? Here is a quick example:

func main(){
    scannerList := read(filenameList)
    dowork(scannerList)
}

func read(filenameList []string) (scannerList []*bufio.Scanner){
    for _, filename := range filenameList{
        op, _ := os.Open(filename)
        defer op.Close()
        scanner := bufio.NewScanner(op)
        scannerList = append(scannerList, scanner)
    }
    return
}

func dowork(scannerList []*bufio.Scanner){
    for _, scanner := range scannerList{
        for scanner.Scan(){
            //read stuff
        }
        //do stuff
    }
}

My code similar to above example compiles, but I don't know if this is recommended (or works). Any comments? Thanks!

Answer 1

A Scanner is a complicated structure, and one that embeds a buffer. The buffer can grow dynamically (depending on what the scan function requests) up to 64kB (MaxScanTokenSize).

So in general it is not a good idea to keep redundant Scanners around, as the buffers cannot be released until the Scanners are discarded. But perhaps a few extra kilobytes of memory don't matter much in your case.