aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAge
* Updated CMake nDPId-test target;Toni Uhlig2021-06-18
| | | | | | | * w/o zLib * gcrypt requires to be enabled Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Enable memory profiling for nDPId-test.Toni Uhlig2021-06-18
| | | | | | * print a summary Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Added zLib compression parameters to control compression conditions.Toni Uhlig2021-06-16
| | | | | | | | * more structs are now "compressable" * fixed missing DAEMON_RECONNECT event * improved memory profiler Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Support for zLib flow memory compression. Experimental.Toni Uhlig2021-06-14
| | | | | | | Please use this feature only for testing purposes. It will change or be removed in the future. Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Removed setting CC, CFLAGS and LDFLAGS explicitly for libnDPI build ↵Toni Uhlig2021-06-09
| | | | | | | | (BUILD_NDPI=ON). * for xcompile targets e.g. for OpenWrt, this env vars are already set Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* libndpi updateToni Uhlig2021-06-09
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Trying to fix BUILD_NDPI for xcompilation.Toni Uhlig2021-06-09
| | | | | | * added a CMake warning as well Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Generate a valid version tuple if build was triggered from an unpacked `make ↵Toni Uhlig2021-06-08
| | | | | | dist` archive. Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Fixed broken libnDPI build (BUILD_NDPI=ON) if Ninja used as Generator.Toni Uhlig2021-06-08
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* `make dist`Toni Uhlig2021-06-08
| | | | | | | * fixed run_tests.sh file check bug, CI compat * updated results due to libnDPI submodule update Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Git tag/commit version printing for nDPId/nDPIsrvd. Reduces confusion.Toni Uhlig2021-06-08
| | | | | | * disabled subshell spawn for run_tests.sh, common pitfall while using counters Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Fixed `make daemon` target.Toni Uhlig2021-06-07
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Build system cleanup / cosmetics.1.4Toni Uhlig2021-06-07
| | | | | | * libnDPI submodule update Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Unified IO buffer mgmt.Toni Uhlig2021-06-07
| | | | | | | * c-collectd gives the user control over collectd-exec instance name * added missing collectd type `flow_l4_icmp_count` Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* flow-dash: Simplified and extended bar graph.Toni Uhlig2021-05-28
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* flow-dash: Added live bars visualising midstream/risky flow count.Toni Uhlig2021-05-28
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Added realtime web based graph example using Plotly/Dash.Toni Uhlig2021-05-27
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* libnDPI updated to c4084ca3c7b3657659aff624158a9c4f5710f57dToni Uhlig2021-05-26
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Added simple Python Multiprocess example.Toni Uhlig2021-05-26
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* nDPIsrvd-captured: skip empty flows based on flow total payload lengthToni Uhlig2021-05-20
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Reworked layer 4 flow length naming/calculation.Toni Uhlig2021-05-20
| | | | | | | * nDPIsrvd services usually do not care about layer4 data length, payload length is quite more essential for further processing Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Fixed CMake global CFLAGS misuse which can cause xcompile errors.Toni Uhlig2021-05-19
| | | | | | | | | | nDPIsrvd-captured supports skipping flows w/o any layer 4 payload. * libndpi update * run_tests does not generate any *.out files for fuzz-*.pcap anymore and does not fail if nDPId-test exits with value 1 (most likely caused by a libpcap failure) Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* README.md updateToni Uhlig2021-05-14
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Cosmetic fixes.Toni Uhlig2021-05-13
| | | | | | * daemon.sh script to simplify daemon testing Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Use layer4 specific flow timeouts.Toni Uhlig2021-05-13
| | | | | | * default values "stolen" from nf_conntrack Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Reduced superfluous Travis-CI yaml content.1.3Toni Uhlig2021-05-12
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Added missing datalink types.Toni Uhlig2021-05-12
| | | | | | * basicially C&P from nDPI reader_utils but with some more sanity checks Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Git submodule libnDPI update.Toni Uhlig2021-05-12
| | | | | | * enable ctest to run integration tests (**only** if BUILD_NDPI=ON) Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* OpenWrt compatible build system.1.2Toni Uhlig2021-05-11
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Added GPL-3 License.1.1Toni Uhlig2021-05-11
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Clone nDPI as submodule via CMake (if BUILD_NDPI=ON).1.0Toni Uhlig2021-05-11
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* README.md updatedToni Uhlig2021-05-10
| | | | | | | * removed all those outdated Makefile.old references * added additional CMake build instructions Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* py-flow-info: Support for --ipwhois, --new and --detection.Toni Uhlig2021-04-30
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Unified and improved dependency build/mgmt via CMake and travis-ci.Toni Uhlig2021-04-22
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Added JA3 blacklist downloader/checker from abuse.chToni Uhlig2021-04-17
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Added python example to check JA3 hashes against known hashes via JA3er.comToni Uhlig2021-04-16
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* travis-ci build CMake projectToni Uhlig2021-04-15
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* added some CMake install targetsToni Uhlig2021-04-15
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* added TODOToni Uhlig2021-04-14
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Added nDPId semantic validation test.Toni Uhlig2021-04-14
| | | | | | | | | | | * fixed inconsistent processing of remaining flows during nDPId shutdown phase * fixed multiple `detected' flow events (instead only `detection-update' flow events can occur after a `detected' flow event) * fixed nDPIsrvd.py invalid message buffer handling * improved run_tests.sh so only valid pcap capture files are getting processed (and some more cosmetics + logging) Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Fixed nDPIsrvd.h flow end bug (flow end callback could never be called and ↵Toni Uhlig2021-04-11
| | | | | | caused some memory troubles). Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Added IPv6 support for -I / -E.Toni Uhlig2021-04-11
| | | | | | | * added another Python search path and try-catch ModuleNotFoundError again * run_tests.sh checks for OpenBSD netcat (required for -q) Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* nDPId-test: mimic full nDPId lifecycleToni Uhlig2021-04-09
| | | | | | | * generate DAEMON_EVENT_INIT as well as DAEMON_EVENT_SHUTDOWN * process remaining flows before shutdown (and generate events) Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Added JSON schema validation to run_tests.shToni Uhlig2021-04-09
| | | | | | | * Python3 scripts are now compatible with versions <3.6 * improved and prettified run_tests.sh Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* nDPId-test: added JSON distribution + JSON parsing (Multithreaded design ↵Toni Uhlig2021-04-09
| | | | | | | | | | | | | | re-using most of nDPId/nDPIsrvd core) * improved Makefile.old install targets * splitted nDPIsrvd_parse into nDPIsrvd_parse_line and nDPIsrvd_parse_all for the sake of readability * minor Python script improvments (check for nDPIsrvd.py on multiple locations, may be superseeded by setuptools in the future) * some paths needs to be absolute (chdir() during daemonize) and therefor additional checks introduced * test run script checks and fails if certain files are are missing (PCAP file <=> result output file) * removed not very useful "internal format error" JSON serialization if a BUG for same exists * fixed invalid l4 type statistics counters for nDPIsrvd-collectd Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Reverted internal ndpi structs to dynamic memory allocation hoping that it ↵Toni Uhlig2021-03-26
| | | | | | | | | | will help to reduce the average memory consumption. How? After the detection finished, internal ndpi structs can be free'd as they are not needed anymore. * Set the amount of max. packets to process via subopt. Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* run_tests.sh checks/print-stderr-on-failToni Uhlig2021-03-24
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Updated README.mdToni Uhlig2021-03-24
| | | | | | * added examples/README.md and schema/README.md Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Updated test outputs and pinned travis-ci's nDPI git repo sync to a specific ↵Toni Uhlig2021-03-24
| | | | | | | | commit hash. * fixed Makefile.old COpts hell Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Added diff'able nDPId-test JSON dumps and travis-ci integration.Toni Uhlig2021-03-24
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>