aboutsummaryrefslogtreecommitdiff
path: root/test
Commit message (Collapse)AuthorAge
* bump libnDPI to 0db12b1390b1cc554b927230c76b05264c05b4981.6rc1Toni Uhlig2023-11-07
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Set timeout for nDPId-test run's.Toni Uhlig2023-11-03
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Switched to UNIX socket use for tests.Toni Uhlig2023-10-20
| | | | | | * use `ss` to make sure that the socket is not available anymore after every single test Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Serialize nDPId / libnDPI versions within daemon events.Toni Uhlig2023-09-10
| | | | | | * changed nDPI version hints / requirements Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* bump libnDPI to 1f693c3f5a5dcd9d69dffb610b9a81bd33f95382Toni Uhlig2023-08-27
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Fixed invalid base64 encoding in some rare cases.Toni Uhlig2023-08-24
| | | | | | * nDPId-test may also verify the correct encoding/decoding Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Tiny improvments.Toni Uhlig2023-08-02
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* bump libnDPI to 2b230e28e0612e8654ad617534deb9aaaabd51b7Toni Uhlig2023-07-23
| | | | | | | * fixes loading of gambling lists which increased nDPId's memory usage *a lot* * nDPId: handle EINTR correctly Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* bump libnDPI to 8ea0eaa0d0c4a3be05f67ef7fa1d22c2579cf7d1Toni Uhlig2023-06-12
| | | | | | | | | | * added build fix for Gitlab CI * added friendly C11 check * set required libnDPI versionto 4.7 (ArchLinux ndpi-git sets version to 4.7, which is not released yet) * reduced sklearn-random-forest memory consumption by adjusting min. sample leaf Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* bump libnDPI to 04f5c5196e790db8b8cc39e42c8645fb7f3dd141lns2023-05-30
| | | | | | * added custom nDPI logging callback Signed-off-by: lns <matzeton@googlemail.com>
* Fixed integer overflow for tcp timeout (>INT_MAX).lns2023-05-26
| | | | Signed-off-by: lns <matzeton@googlemail.com>
* bump libnDPI to ...Toni Uhlig2023-05-24
| | | | | | | | * upstream changed regression test interface, needed to adapt * improved libnDPI helper build script * updated JSON schema Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Moved `datalink` json key/value from error to packet events and renamed it ↵Toni Uhlig2023-04-21
| | | | | | to `pkt_datalink`. Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Improved collectd risk processing to be in sync with libnDPI risks.Toni Uhlig2023-01-11
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* bump libnDPI to a944514ddec73f79704f55aab1423e39f4ce7a03Toni Uhlig2023-01-09
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* nDPid: Fixed base64encode bug which lead to invalid base64 strings.Toni Uhlig2023-01-09
| | | | | | | | * py-semantic-validation: Decode base64 raw packet data as well * nDPIsrvd.py: Added PACKETS_PLEN_MAX * nDPIsrvd.py: Improved JSON parse error/exception handling Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Add collectd statistics diff test.Toni Uhlig2022-12-06
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Limit the size of base64 serialized raw packet data (8192 bytes per packet).Toni Uhlig2022-12-06
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Strace support for diff tests.Toni Uhlig2022-12-03
| | | | | | * tiny README update Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Test for diff's in flow-analyse CSV generator daemon.Toni Uhlig2022-11-16
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Improved the point of time when to append the raw packet base64 data to the ↵Toni Uhlig2022-11-15
| | | | | | | | | serializer. * nDPId-test: Increased the max-packets-per-flow-to-send from 3 to 5. This is quite useful for TCP as the first 3 packets are usually part of the three-way-handshake. Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Sync unit tests.Toni Uhlig2022-11-13
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* bump libnDPI to db9f6ec1b4018164e5bff05f115dc60711bb711bToni Uhlig2022-10-31
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* nDPId: Added error event threshold to prevent event spamming which may be ↵Toni Uhlig2022-10-17
| | | | | | abused. Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Improved py-machine-learning example.Toni Uhlig2022-10-09
| | | | | | | | | * c-analysed: fixed quoting bug * nDPId: fixed invalid iat storing/serialisation * nDPId: free data analysis after event was sent Signed-off-by: Toni Uhlig <matzeton@googlemail.com> Signed-off-by: lns <matzeton@googlemail.com>
* Small fixes.lns2022-10-01
| | | | Signed-off-by: lns <matzeton@googlemail.com>
* Added nDPIsrvd-analysed to generate CSV files from analyse events.Toni Uhlig2022-09-30
| | | | | | | * nDPIsrvd.h: iterate over JSON arrays * nDPId: calculate l3 payload packet entropies for analysis Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Refactored client distributor C API.Toni Uhlig2022-09-25
| | | | | | | | | | | * Still not perfect, but the code before was not even able to deal with JSON arrays. Use common "speaking" function names for all functions in nDPIsrvd.h * Provide a more or less generic and easy extendable JSON walk function. * Modified C examples to align with the changed C API. * c-collectd: Reduced lot's of code duplication by providing mapping tables. * nDPId: IAT array requires one slot less (first packet has always an IAT of 0). Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* nDPIsrvd.h: Fixed bug during token parsing/hashing. Do not hash array contents.Toni Uhlig2022-09-23
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Improved flown analyse event:Toni Uhlig2022-09-22
| | | | | | | | * store packet directions * merged direction based IATs * merged direction based PKTLENs Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* flow-info.py: Command line arguments --no-color, --no-statusbar (both useful ↵Toni Uhlig2022-09-22
| | | | | | | | for tests/CI) and --print-analyse-results. * run_tests.sh: Use flow-info.py for additional DIFF tests. Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* nDPId: Reduced flow-updates for TCP flows to 1/4 of the timeout value.Toni Uhlig2022-09-19
| | | | | | | | | | | | * nDPId: Fixed broken validation tests. * nDPId: Removed TICK_RESOLUTION, not required anymore. * c-collectd: Improved total layer4 payload calculation/update handling. * c-collectd: Updated RRD Graph script according to total layer4 payload changes. * py-flow-info.py: Fixed several bugs and syntax errors. * Python scripts: Added dirname(argv[0]) as search path for nDPIsrvd.py. * nDPIsrvd&nDPId-test: Fixed missing EPOLLERR check. Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Added layer4 payload length bins.Toni Uhlig2022-09-19
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* bump libnDPI to 174cd739dbb1358ab012c4779e42e0221bef835cToni Uhlig2022-09-18
| | | | | | | * ReadMe stuff * OpenWrt Makefile: set NEED_LINKING_AGAINST_LIBM=ON Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Fixed last pkt time.lns2022-09-14
| | | | Signed-off-by: lns <matzeton@googlemail.com>
* New flow event: 'analysis'.Toni Uhlig2022-09-13
| | | | | | | | | * The goal was to provide a separate event for extracted feature that are not required and only useful for a few (e.g. someone who wants do ML). * Increased network buffer size to 32kB (8192 * 4). * Switched timestamp precision from ms to us for *ALL* timestamps. Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Bump libnDPI to 37f918322c0a489b5143a987c8f1a44a6f78a6f3 and updated flow ↵Toni Uhlig2022-09-06
| | | | | | | | | json schema file. * export env vars AR / CMAKE_C_COMPILER_AR and RANLIB / CMAKE_C_COMPILER_RANLIB while building libnDPI * nDPId check API version during startup (macro vs. function call) and print a warning if they are different Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Split `*_l4_payload_len' into `*_src_l4_payload_len' and `*_dst_l4_payload_len'.Toni Uhlig2022-08-15
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Split `flow_packets_processed' into `flow_src_packets_processed' and ↵lns2022-08-15
| | | | | | | | | `flow_dst_packets_processed'. * no use for `flow_avg_l4_payload_len' -> removed * test/run_tests.sh does not fail if git-worktree's are used Signed-off-by: lns <matzeton@googlemail.com>
* bump libnDPI to 7c19de49047a5731f3107ff17854e9afe839cc61Toni Uhlig2022-07-14
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* bump libnDPI to 8f6a006e36eef0ae386f7e663d3ebecfad6a2dc9Toni Uhlig2022-07-01
| | | | | | | * try to use same wording wherever possible e.g. renamed workflow->total_l4_data_len to workflow->total_l4_payload_len Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* bump libnDPI to c287eb835b537ce64d9293a52ca13e670b6d3b0dToni Uhlig2022-06-19
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* bump libnDPI to 0b3f8ed849cdf9971224c49a3958f0904a2bbbb5lns2022-06-06
| | | | | | * README/nDPId: fixed typ0 Signed-off-by: lns <matzeton@googlemail.com>
* Small fixes.lns2022-04-26
| | | | Signed-off-by: lns <matzeton@googlemail.com>
* nDPId: Merged nDPId_flow_(info|finished) into nDPId_flowlns2022-04-24
| | | | | | | * nDPIsrvd: Fixed buffer allocation error due to missing memset() on disconnect * nDPIsrvd: Removed unused struct members Signed-off-by: lns <matzeton@googlemail.com>
* Added proper DLT_RAW dissection for IPv4 and IPv6.lns2022-04-24
| | | | | | | | | | * nDPId: Improved TCP timeout handling if FIN/RST seen which caused Midstream TCP flows when there shouldn't be any. * nDPIsrvd: Unified remote descriptor resource cleanup on disconnects/shutdown. * nDPIsrvd: Added additional error messages for remote descriptors. * py-flow-info: Better daemon status message printing. Signed-off-by: lns <matzeton@googlemail.com>
* bump libnDPI to 8b2c9860be8b0663bfe9fc3b6defc041bb90e5b21.5lns2022-04-18
| | | | Signed-off-by: lns <matzeton@googlemail.com>
* bump libnDPI to bb12837ca75efc2691ecb18fd5f56e2d097ef26bToni Uhlig2022-03-24
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Executing ./tests/run_tests.sh w/o zLib should not result in diff's anymore.Toni Uhlig2022-03-24
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Reworked nDPIsrvd.h C-API.Toni Uhlig2022-03-21
| | | | | | | | | | | | * nDPIsrvd.h: Provide nDPId thread storage. * nDPIsrvd.py: Fixed instance cleanup bug. * nDPIsrvd.h: Support for instance/thread user data and cleanup callback. * nDPIsrvd.h: Most recent flow time stored in thread ht instead of instance ht. * nDPId: Moved flow logger out the memory profilier into SIGUSR1 signal handling. * nDPId: Added signal fd to be usable within epoll's event handling (live-capture only!) * nDPId: Added information about ZLib compressions to daemon status/shutdown events. Signed-off-by: Toni Uhlig <matzeton@googlemail.com>