Stenographer is a full-packet-capture utility for buffering packets to disk for intrusion detection and incident response purposes. It provides a high-performance implementation of NIC-to-disk packet writing, handles deleting those files as disk fills up, and provides methods for reading back specific sets of packets quickly and easily.
stenographer
Latest Change 7/1/2016:
+ Prealloc flag fix
+ Mark “–preallocate_file_mb” as important when using
Dependencies for all linux Distros:
+ libaio-dev
+ libleveldb-dev
+ libsnappy-dev
+ g++
+ libcap2-bin
+ libseccomp-dev
It is designed to:
+ Write packets to disk, very quickly (~10Gbps on multi-core, multi-disk machines)
+ Store as much history as it can (managing disk usage, storing longer durations when traffic slows, then deleting the oldest packets when it hits disk limits)
+ Read a very small percentage (<1%) of packets from disk based on analyst needs
It is NOT designed for:
+ Complex packet processing (TCP stream reassembly, etc)
— It’s fast because it doesn’t do this. Even with the very minimal, single-pass processing of packets we do, processing ~1Gbps for indexing alone can take >75% of a single core.
Processing the data by reading it back from disk also doesn’t work: see next bullet point.
+ Reading back large amounts of packets (> 1% of packets written)
— The key concept here is that disk reads compete with disk writes… you can write at 90% of disk speed, but that only gives you 10% of your disk’s time for reading. Also, we’re writing highly sequential data, which disks are very good at doing quickly, and generally reading back sparse data with lots of seeks, which disks do slowly.
For further reading, check out DESIGN.md for a discussion of stenographer’s design, or read INSTALL.md for how to install stenographer on a machine.
Installation and usage:
go get github.com/google/stenographer or git clone https://github.com/google/stenographer && cd stenographer sudo ./install.sh then Create directories to output packets/indexes to, then update /etc/stenographer/config to point to them cd stenotype && make sudo apt-get install jq cd .. then run what do you want..sample use, you see a picture. for moredetails please read INSTALL.md for how to install stenographer on a machine.
Source : https://github.com/google