summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAge
...
* | | Improved examples.Toni Uhlig2022-11-02
| | | | | | | | | | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | bump libnDPI to db9f6ec1b4018164e5bff05f115dc60711bb711bToni Uhlig2022-10-31
| | | | | | | | | | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | Create pidfile iff daemon mode enabled.Toni Uhlig2022-10-31
| | | | | | | | | | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | Improved nDPIsrvd-collectd statistics.Toni Uhlig2022-10-31
| | | | | | | | | | | | | | | | | | * Improved RRD-Graph generation script and static WWW html files. Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | Increased network buffer size to 33792 bytes.Toni Uhlig2022-10-30
| | | | | | | | | | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | nDPid-test: add buffer testToni Uhlig2022-10-30
| | | | | | | | | | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | nDPId-test: Fixed thread sync/lock issue.Toni Uhlig2022-10-22
| | | | | | | | | | | | | | | | | | * rarely happens in CI Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | Merge branch 'main' of github.com:utoni/nDPIdToni Uhlig2022-10-20
|\ \ \
| * | | Add ArchLinux PKGBUILD.lns2022-10-19
| | | | | | | | | | | | | | | | Signed-off-by: lns <matzeton@googlemail.com>
* | | | Special Thanks to Damiano Verzulli (@verzulli).Toni Uhlig2022-10-20
|/ / / | | | | | | | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | nDPId: Added error event threshold to prevent event spamming which may be ↵Toni Uhlig2022-10-17
| | | | | | | | | | | | | | | | | | abused. Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | py-machine-learning: load and save trained modelsToni Uhlig2022-10-15
| | | | | | | | | | | | | | | | | | * added link to a pre-trained model Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | Removed discontinued examples from the ReadMe.Toni Uhlig2022-10-13
| | | | | | | | | | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | Removed example py-ja3-checker.Toni Uhlig2022-10-13
| | | | | | | | | | | | | | | | | | | | | * renamed sklearn-ml.py to sklearn-random-forest.py (there is more to come!) * force all protocol classes to lower case Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | Improved py-machine-learning example.Toni Uhlig2022-10-11
| | | | | | | | | | | | | | | | | | | | | | | | * colorize/prettify output * added sklearn controls/tuning options * disable IAT/Packet-Length features as default Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | daemon.sh: fixed race conditionToni Uhlig2022-10-10
| | | | | | | | | | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | Improved py-machine-learning example.Toni Uhlig2022-10-10
| | | | | | | | | | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | daemon.sh: cat nDPId / nDPIsrvd log on failureToni Uhlig2022-10-09
| | | | | | | | | | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | Improved py-machine-learning example.Toni Uhlig2022-10-09
| | | | | | | | | | | | | | | | | | | | | | | | | | | * c-analysed: fixed quoting bug * nDPId: fixed invalid iat storing/serialisation * nDPId: free data analysis after event was sent Signed-off-by: Toni Uhlig <matzeton@googlemail.com> Signed-off-by: lns <matzeton@googlemail.com>
* | | Improved OpenWrt UCI/InitscriptToni Uhlig2022-10-06
| | | | | | | | | | | | | | | | | | * c-analysed: chuser()/chgroup() Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | Fixed heap overflow on shutdown caused by missing remotes size/used reset.Toni Uhlig2022-10-05
| | | | | | | | | | | | | | | | | | * introduced with 22a8d04c748ff3e04ca11c5c29b4433c7136f5f5 Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | OpenWrt UCI/InitscriptToni Uhlig2022-10-03
| | | | | | | | | | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | Generate code coverage w/o external shell script, use CMake.lns2022-10-03
| | | | | | | | | | | | | | | | | | * upload codecov/dist artifacts Signed-off-by: lns <matzeton@googlemail.com>
* | | Small fixes.lns2022-10-01
| | | | | | | | | | | | Signed-off-by: lns <matzeton@googlemail.com>
* | | c-analysed: improved feature extraction from "analyse" eventsToni Uhlig2022-10-01
| | | | | | | | | | | | | | | | | | | | | | | | * c-captured: update detected risks on "detection-update" events * c-collectd: added missing flow breed * c-collectd: PUTVAL macros are more flexible now Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | Added nDPIsrvd-analysed to generate CSV files from analyse events.Toni Uhlig2022-09-30
| | | | | | | | | | | | | | | | | | | | | * nDPIsrvd.h: iterate over JSON arrays * nDPId: calculate l3 payload packet entropies for analysis Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | nDPId-test: Force collector blocking mode.Toni Uhlig2022-09-25
| | | | | | | | | | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | Refactored client distributor C API.Toni Uhlig2022-09-25
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Still not perfect, but the code before was not even able to deal with JSON arrays. Use common "speaking" function names for all functions in nDPIsrvd.h * Provide a more or less generic and easy extendable JSON walk function. * Modified C examples to align with the changed C API. * c-collectd: Reduced lot's of code duplication by providing mapping tables. * nDPId: IAT array requires one slot less (first packet has always an IAT of 0). Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | nDPIsrvd.h: Fixed bug during token parsing/hashing. Do not hash array contents.Toni Uhlig2022-09-23
| | | | | | | | | | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | Improved flown analyse event:Toni Uhlig2022-09-22
| | | | | | | | | | | | | | | | | | | | | | | | * store packet directions * merged direction based IATs * merged direction based PKTLENs Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | flow-info.py: Command line arguments --no-color, --no-statusbar (both useful ↵Toni Uhlig2022-09-22
| | | | | | | | | | | | | | | | | | | | | | | | for tests/CI) and --print-analyse-results. * run_tests.sh: Use flow-info.py for additional DIFF tests. Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | Merge branch 'main' of github.com:utoni/nDPIdToni Uhlig2022-09-19
|\ \ \
| * | | Improve READMEDamiano Verzulli2022-09-19
| | | | | | | | | | | | | | | | | | | | | | | | | | | | - link to already-existing JSON-schemas have been added - a graphical schema detailing flow-events timeline have been added in both PNG and source-Drawio formats. Link to PNG have been included in the README
* | | | nDPId: Reduced flow-updates for TCP flows to 1/4 of the timeout value.Toni Uhlig2022-09-19
|/ / / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * nDPId: Fixed broken validation tests. * nDPId: Removed TICK_RESOLUTION, not required anymore. * c-collectd: Improved total layer4 payload calculation/update handling. * c-collectd: Updated RRD Graph script according to total layer4 payload changes. * py-flow-info.py: Fixed several bugs and syntax errors. * Python scripts: Added dirname(argv[0]) as search path for nDPIsrvd.py. * nDPIsrvd&nDPId-test: Fixed missing EPOLLERR check. Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | Added layer4 payload length bins.Toni Uhlig2022-09-19
| | | | | | | | | | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | bump libnDPI to 174cd739dbb1358ab012c4779e42e0221bef835cToni Uhlig2022-09-18
| | | | | | | | | | | | | | | | | | | | | * ReadMe stuff * OpenWrt Makefile: set NEED_LINKING_AGAINST_LIBM=ON Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | Add -Werror to OpenWrt package TARGET_CFLAGS.Toni Uhlig2022-09-17
| | | | | | | | | | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | Provide thread sync via locking on architectures that do not support ↵Toni Uhlig2022-09-17
| | | | | | | | | | | | | | | | | | Compare&Swap. Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | Add OpenWrt CI via Github Actions.Toni Uhlig2022-09-17
| | | | | | | | | | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | Fixed last pkt time.lns2022-09-14
| | | | | | | | | | | | Signed-off-by: lns <matzeton@googlemail.com>
* | | New flow event: 'analysis'.Toni Uhlig2022-09-13
| | | | | | | | | | | | | | | | | | | | | | | | | | | * The goal was to provide a separate event for extracted feature that are not required and only useful for a few (e.g. someone who wants do ML). * Increased network buffer size to 32kB (8192 * 4). * Switched timestamp precision from ms to us for *ALL* timestamps. Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | OpenWrt packaging support.Toni Uhlig2022-09-13
| | | | | | | | | | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | nDPIsrvd-collectd: Stdout should be unbuffered.Toni Uhlig2022-09-12
| | | | | | | | | | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | nDPIsrvd-collectd: RRD Graph generation script and a basic static HTML5 ↵Toni Uhlig2022-09-12
| | | | | | | | | | | | | | | | | | website for viewing the generated image files. Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | Use CMake XCompile and collect host-triplet from ${CC}.Toni Uhlig2022-09-11
| | | | | | | | | | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | nDPId: Removed thread_id nonsense as it does not provide any useful ↵Toni Uhlig2022-09-10
| | | | | | | | | | | | | | | | | | | | | | | | information and is not portable at all, not even on Linux systems .. * nDPId: Removed blocking I/O warning, which causes logspams.. Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | include fixToni Uhlig2022-09-10
| | | | | | | | | | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | Fixed compilation warnings on linux32 platforms.Toni Uhlig2022-09-10
| | | | | | | | | | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | Do not use pthread_t as numeric value. Some systems define pthread_t as struct *Toni Uhlig2022-09-10
| | | | | | | | | | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | nDPIsrvd: Fixed NUL pointer deref during logging attempt.Toni Uhlig2022-09-10
| | | | | | | | | | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>