douduiwei2831 2019-01-16 18:55
浏览 90

Go中写入镶木地板文件的时间戳格式是什么

I am trying to write a Go struct in a Parquet file and upload to S3. What format and type do I specify for timestamp parameter in the struct so that athena displays correct timestamp when reading from the parquet file.

type example struct {
     ID              int64  `parquet:"name=id, type=INT64"`
     CreatedAt       int64  `parquet:"name=created_at,type=TIMESTAMP_MILLIS"`
}

ex := example{}
ex.ID = int64(10)
ex.CreatedAt = time.Now().Unix()

fw, err := ParquetFile.NewLocalFileWriter("new.parquet")
pw, err := ParquetWriter.NewParquetWriter(fw, new(example), 1)
pw.Write(ex)

Upload the file new.parquet to S3

Reference - https://github.com/xitongsys/parquet-go. I created a table in Athena with int and timestamp field for the same and trying querying the table. The date is showing something like - 1970-01-18 21:54:23.751. which no where matches the current timestamp.

  • 写回答

1条回答 默认 最新

  • dongsechuan0535 2019-01-16 19:00
    关注

    For example,

    package main
    
    import (
        "fmt"
        "time"
    )
    
    func main() {
        type example struct {
            CreatedAt int64 `parquet:"name=created_at,type=TIMESTAMP_MILLIS"`
        }
    
        ex := example{}
        ex.CreatedAt = time.Now().UnixNano() / int64(time.Millisecond)
        fmt.Println(ex.CreatedAt)
    }
    

    Playground: https://play.golang.org/p/ePOlUKiT6fD

    Output:

    1257894000000
    
    评论

报告相同问题?

悬赏问题

  • ¥15 unity第一人称射击小游戏,有demo,在原脚本的基础上进行修改以达到要求
  • ¥15 买了个传感器,根据商家发的代码和步骤使用但是代码报错了不会改,有没有人可以看看
  • ¥15 关于#Java#的问题,如何解决?
  • ¥15 加热介质是液体,换热器壳侧导热系数和总的导热系数怎么算
  • ¥100 嵌入式系统基于PIC16F882和热敏电阻的数字温度计
  • ¥15 cmd cl 0x000007b
  • ¥20 BAPI_PR_CHANGE how to add account assignment information for service line
  • ¥500 火焰左右视图、视差(基于双目相机)
  • ¥100 set_link_state
  • ¥15 虚幻5 UE美术毛发渲染