douwen8118 2017-09-19 16:56
浏览 154
已采纳

解析csv文件时出现奇怪的输出

I'm parsing a csv file from google api with golang, the file is encoded in utf-16, code below try to read one record(skip header) and print the record, but it gives me the output like this which is weird:

, v=/09/20 00:35:42 k=Smartfren Andromax AD681H

I guess it's probably related with utf-16 encoding, but don't know the detail, here is the code: package main

import (
    "encoding/csv"
    "io"
    "log"
    "net/http"
    "strings"
)

var url = "http://storage.googleapis.com/play_public/supported_devices.csv"

func main() {

    resp, err := http.Get(url)
    if err != nil {
        return
    }
    defer resp.Body.Close()

    r := csv.NewReader(resp.Body)
    r.LazyQuotes = true
    r.FieldsPerRecord = -1
    // skip header
    r.Read()

    m := make(map[string]string)
    for {
        record, err := r.Read()
        if err == io.EOF {
            break
        }
        if err != nil {
            log.Println(err)
            continue
        }
        if len(record) >= 4 {
            m[strings.TrimSpace(record[3])] = strings.TrimSpace(record[1])
            for k, v := range m {
                log.Printf("k=%s, v=%s
", k, v)
            }
            break
        }
    }
}
  • 写回答

1条回答 默认 最新

  • douhao123457 2017-09-19 17:24
    关注

    As you suspected, the input data must be transformed from a stream of UTF-16 encoded characters to UTF-8 encoded ones. You can do that by using the Go sub-repository package golang.org/x/text/encoding/unicode:

    package main
    
    import (
        "encoding/csv"
        "io"
        "log"
        "net/http"
        "strings"
    
        "golang.org/x/text/encoding/unicode"
    )
    
    var url = "http://storage.googleapis.com/play_public/supported_devices.csv"
    
    func main() {
    
        resp, err := http.Get(url)
        if err != nil {
            return
        }
        defer resp.Body.Close()
    
        dec := unicode.UTF16(unicode.LittleEndian, unicode.UseBOM).NewDecoder()
        reader := dec.Reader(resp.Body)
    
        r := csv.NewReader(reader)
        r.LazyQuotes = true
        r.FieldsPerRecord = -1
        // skip header
        r.Read()
    
        m := make(map[string]string)
        for {
            record, err := r.Read()
            if err == io.EOF {
                break
            }
            if err != nil {
                log.Println(err)
                continue
            }
            if len(record) >= 4 {
                m[strings.TrimSpace(record[3])] = strings.TrimSpace(record[1])
                for k, v := range m {
                    log.Printf("k=%s, v=%s
    ", k, v)
                }
                break
            }
        }
    }
    
    本回答被题主选为最佳回答 , 对您是否有帮助呢?
    评论

报告相同问题?

悬赏问题

  • ¥15 fpga自动售货机数码管(相关搜索:数字时钟)
  • ¥15 用前端向数据库插入数据,通过debug发现数据能走到后端,但是放行之后就会提示错误
  • ¥15 python天天向上类似问题,但没有清零
  • ¥30 3天&7天&&15天&销量如何统计同一行
  • ¥30 帮我写一段可以读取LD2450数据并计算距离的Arduino代码
  • ¥15 C#调用python代码(python带有库)
  • ¥15 飞机曲面部件如机翼,壁板等具体的孔位模型
  • ¥15 vs2019中数据导出问题
  • ¥20 云服务Linux系统TCP-MSS值修改?
  • ¥20 关于#单片机#的问题:项目:使用模拟iic与ov2640通讯环境:F407问题:读取的ID号总是0xff,自己调了调发现在读从机数据时,SDA线上并未有信号变化(语言-c语言)