Skip to content

Commit

Permalink
Refactor Logstash configuration for pilot_log collector: Remove unnec…
Browse files Browse the repository at this point in the history
…essary fields and fix JSON parsing error
  • Loading branch information
ivukotic committed Oct 4, 2024
1 parent 21eecd1 commit a7a2d6e
Showing 1 changed file with 1 addition and 15 deletions.
16 changes: 1 addition & 15 deletions configs/pilot_log.conf
Original file line number Diff line number Diff line change
Expand Up @@ -23,25 +23,11 @@ filter {
mutate {
remove_field => [ "version" ]
remove_field => [ "@version" ]
# remove_field => [ "host" ]
remove_field => ["extra"][ "logger_name" ]
}

}

[2024-10-04T17:59:31,409][WARN ][logstash.filters.json ][pilot_log]
[9fc6fe456ad9f7522f2fb0236af35eb23e44fbbb9e13207e7d0707303e3ded3a]
Error parsing json {:source=>"message",
:raw=>"{
'TaskID': '41547794',
'PandaJobID': '6356703513',
'Harvester_WorkerID': '628885473',
'Harvester_ID': 'CERN_central_A',
'RequestID': 245061,
'PilotTimeStamp': 1728064763.2951524,
'message': 'AnalysisBase_VHbb::exe... INFO Event number = 78400'
}", :exception=>
#<LogStash::Json::ParserError: Unexpected character (''' (code 39)): was expecting double-quote to start field name

output {

# stdout {
Expand Down

0 comments on commit a7a2d6e

Please sign in to comment.