Search code examples
node.jsmongodbgoapache-kafkaunix-timestamp

Saving Nanosecond Timestamps in MongoDB (Generated by Go, Saved using Node.js)


I am trying to store Unix timestamps in nanoseconds into the Date type field of a Mongodb database.

The unix timestamps in nanoseconds are generated in a Go program (with time.Now().UnixNano()), submitted to Kafa to be read by a Node.js script which uses mongoose to write the payload object containing the unix timestamp in nanoseconds to the Mongodb store.

However this is throwing an error

UnhandledPromiseRejectionWarning: ValidationError: trade validation failed: timestamp: Cast to Date failed for value "1544720051987010000" at path "timestamp"

Is there a better way to store unix timestamps in nanosecond in Mongodb?


Solution

  • I am trying to store Unix timestamps in nanoseconds into the Date type field of a Mongodb database. Nyxynyx

    That is not going to work.


    Internally, Date objects are stored as a signed 64-bit integer representing the number of milliseconds since the Unix epoch (Jan 1, 1970).

    MongoDB Reference: Date()


    For example,

    package main
    
    import (
        "fmt"
        "time"
    )
    
    func main() {
        timestamp := time.Now().UnixNano() / int64(time.Millisecond)
        fmt.Println(timestamp)
    }
    

    Playground: https://play.golang.org/p/21S_DeVA4jv

    Output:

    1257894000000
    

    To store Unix nanoseconds, use the long data type.