Search code examples
mongodbtemplatesformatrsyslog

Template to store Rsyslog logs with MongoDB


I am trying to insert the logs coming from RSyslog to a MongoDB database.

The logs stored into MongoDB have to respect the following structure :

{
    "_id" : ObjectId("55b8c845a671d907a0ab9e0b"),
    "receptionTime" : "2015-06-12 14:29:45",
    "reportedTime" : "2015-06-12 14:29:45",
    "priority" : "6",
    "facility" : "23",
    "host" : "uacm3-3a-fscr01",
    "service" : "apacheaccess",
    "message" : "My messsage",
    "syslogTag" : "apache-access-fscr:"
}

According to Rsyslog documentation (http://www.rsyslog.com/doc/v8-stable/configuration/templates.html#standard-template-for-writing-to-files) , I have designed the following template :

template(name="BSON" type="list") {
    constant(value="\"receptionTime\": \"")
    property(name="timegenerated")
    constant(value="\", \"reportedTime\": \"")
    property(name="timereported")
    constant(value="\", \"priority\": \"")
    property(name="syslogseverity")
    constant(value="\", \"facility\": \"")
    property(name="syslogfacility")
    constant(value="\", \"host\": \"")
    property(name="hostname")
    constant(value="\", \"service\": \"")
    property(name="programname")
    constant(value="\", \"message\": \"")
    property(name="msg")
    constant(value="\", \"syslogTag\": \"")
    property(name="syslogtag")
    constant(value="\"")
    }

Unfortunately, the logs stored in MongoDB do not respect the required structure at all. Here is what is stored :

{
    "_id" : ObjectId("55e715b25ea0c0a9fbbf8b0f"),
    "timegenerated" : "Sep  2 17:28:50",
    "timereported" : "Sep  2 15:27:57",
    "syslogseverity" : "5",
    "syslogfacility" : "21",
    "hostname" : "uacm3-3b-acd01",
    "programname" : "Sep",
    "msg" : "Some message",
    "syslogtag" : "Sep"
}

Do you have any idea about what I am doing wrong ?


Solution

  • I found a solution, but I still do not understand why the former method was not working:

    template(name="BSON" type="list") {
        property(name="timegenerated" outname="receptionTime")
        property(name="timereported" outname="reportedTime")
        property(name="syslogseverity" outname="priority")
        property(name="syslogfacility" outname="facility")
        property(name="hostname" outname="host")
        property(name="programname" outname="service")
        property(name="msg" outname="message")
        property(name="syslogtag" outname="syslogTag")
        }