Skip to content
Brian Trammell edited this page Apr 12, 2018 · 2 revisions

Welcome to the pto3-ecn wiki!

Worklist

This table contains the plan for creating normalizers for each of the files we have from pto1 on muninn:

Campaign Format
ecn-june ECNSpider v1 seqfile
ecn-july ECNSpider v1 seqfile
ecn-august ECNSpider v1 seqfile
ecn-june16 ECNSpider v1 seqfile
more-is-better PathSpider v1 fjson ECN
mustgofaster-tfo PathSpider v1 fjson TFO
tracebox-16 Tracebox JSON
copycat QoF IPFIX

Formats

ECNSpider v1 seqfile

ECNSpider v1 seqfiles contain a CSV file (ECNSpider v1 output) and an IPFIX file (QoF output) in an Apache HDFS sequence file. We'll need to write a custom normalizer to desequence the sequence file, then parse the IPFIX data to extract connectivity and negotiation.

PathSpider v1 fjson ECN BZ2

Normal PathSpider output with ECN conditions as fragmented (or newline-delimited) JSON. Use ecn_normalizer.go in this repository. May need to add new extraction filetypes, because PathSpider's output may.

PathSpider v1 fjson TFO BZ2

Normal PathSpider output with ECN conditions as fragmented (or newline-delimited) JSON. We should create a tfo_normalizer.go in this repository, a small delta from ecn_normalizer. May want to combine these into a pspdr_normalizer.

Tracebox JSON

See pto3-trace for normalizers to parse trace data.

Clone this wiki locally