summaryrefslogtreecommitdiff
path: root/examples
Commit message (Collapse)AuthorAge
...
* nDPIsrvd.h: Provide two additional convenient API functions.Toni Uhlig2022-11-06
| | | | | | | * nDPIsrvd_json_buffer_string * nDPIsrvd_json_buffer_length Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Improved examples.Toni Uhlig2022-11-02
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* bump libnDPI to db9f6ec1b4018164e5bff05f115dc60711bb711bToni Uhlig2022-10-31
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Improved nDPIsrvd-collectd statistics.Toni Uhlig2022-10-31
| | | | | | * Improved RRD-Graph generation script and static WWW html files. Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Increased network buffer size to 33792 bytes.Toni Uhlig2022-10-30
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* nDPid-test: add buffer testToni Uhlig2022-10-30
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* nDPId: Added error event threshold to prevent event spamming which may be ↵Toni Uhlig2022-10-17
| | | | | | abused. Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* py-machine-learning: load and save trained modelsToni Uhlig2022-10-15
| | | | | | * added link to a pre-trained model Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Removed discontinued examples from the ReadMe.Toni Uhlig2022-10-13
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Removed example py-ja3-checker.Toni Uhlig2022-10-13
| | | | | | | * renamed sklearn-ml.py to sklearn-random-forest.py (there is more to come!) * force all protocol classes to lower case Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Improved py-machine-learning example.Toni Uhlig2022-10-11
| | | | | | | | * colorize/prettify output * added sklearn controls/tuning options * disable IAT/Packet-Length features as default Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Improved py-machine-learning example.Toni Uhlig2022-10-10
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Improved py-machine-learning example.Toni Uhlig2022-10-09
| | | | | | | | | * c-analysed: fixed quoting bug * nDPId: fixed invalid iat storing/serialisation * nDPId: free data analysis after event was sent Signed-off-by: Toni Uhlig <matzeton@googlemail.com> Signed-off-by: lns <matzeton@googlemail.com>
* Improved OpenWrt UCI/InitscriptToni Uhlig2022-10-06
| | | | | | * c-analysed: chuser()/chgroup() Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Small fixes.lns2022-10-01
| | | | Signed-off-by: lns <matzeton@googlemail.com>
* c-analysed: improved feature extraction from "analyse" eventsToni Uhlig2022-10-01
| | | | | | | | * c-captured: update detected risks on "detection-update" events * c-collectd: added missing flow breed * c-collectd: PUTVAL macros are more flexible now Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Added nDPIsrvd-analysed to generate CSV files from analyse events.Toni Uhlig2022-09-30
| | | | | | | * nDPIsrvd.h: iterate over JSON arrays * nDPId: calculate l3 payload packet entropies for analysis Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* nDPId-test: Force collector blocking mode.Toni Uhlig2022-09-25
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Refactored client distributor C API.Toni Uhlig2022-09-25
| | | | | | | | | | | * Still not perfect, but the code before was not even able to deal with JSON arrays. Use common "speaking" function names for all functions in nDPIsrvd.h * Provide a more or less generic and easy extendable JSON walk function. * Modified C examples to align with the changed C API. * c-collectd: Reduced lot's of code duplication by providing mapping tables. * nDPId: IAT array requires one slot less (first packet has always an IAT of 0). Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* nDPIsrvd.h: Fixed bug during token parsing/hashing. Do not hash array contents.Toni Uhlig2022-09-23
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Improved flown analyse event:Toni Uhlig2022-09-22
| | | | | | | | * store packet directions * merged direction based IATs * merged direction based PKTLENs Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* flow-info.py: Command line arguments --no-color, --no-statusbar (both useful ↵Toni Uhlig2022-09-22
| | | | | | | | for tests/CI) and --print-analyse-results. * run_tests.sh: Use flow-info.py for additional DIFF tests. Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* nDPId: Reduced flow-updates for TCP flows to 1/4 of the timeout value.Toni Uhlig2022-09-19
| | | | | | | | | | | | * nDPId: Fixed broken validation tests. * nDPId: Removed TICK_RESOLUTION, not required anymore. * c-collectd: Improved total layer4 payload calculation/update handling. * c-collectd: Updated RRD Graph script according to total layer4 payload changes. * py-flow-info.py: Fixed several bugs and syntax errors. * Python scripts: Added dirname(argv[0]) as search path for nDPIsrvd.py. * nDPIsrvd&nDPId-test: Fixed missing EPOLLERR check. Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* New flow event: 'analysis'.Toni Uhlig2022-09-13
| | | | | | | | | * The goal was to provide a separate event for extracted feature that are not required and only useful for a few (e.g. someone who wants do ML). * Increased network buffer size to 32kB (8192 * 4). * Switched timestamp precision from ms to us for *ALL* timestamps. Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* nDPIsrvd-collectd: Stdout should be unbuffered.Toni Uhlig2022-09-12
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* nDPIsrvd-collectd: RRD Graph generation script and a basic static HTML5 ↵Toni Uhlig2022-09-12
| | | | | | website for viewing the generated image files. Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Added https://gitlab.com/verzulli/ndpid-rt-analyzer.git to examples.Toni Uhlig2022-09-06
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Disable timestamp generation in nDPIsrvd-collectd as default.Toni Uhlig2022-09-04
| | | | | | * collectd's rrdtool write plugin does silently fail with those ones (dunno why) Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Split `*_l4_payload_len' into `*_src_l4_payload_len' and `*_dst_l4_payload_len'.Toni Uhlig2022-08-15
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* c-collectd: fixed incorrect PUTVALToni Uhlig2022-08-15
| | | | | | * get rid of types.db Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Improve READMEDamiano Verzulli2022-08-12
| | | | | | | | - slightly improve the README to better enhance the streaming capability of `nDPId`, regardless of `nDPIsrvd` - add a screencast showing the install step and the `nDPId` usage, alone (with ncat as unix-socket listener) - add "build" to .gitignore
* c-collectd: fixed possible undefined behaviorToni Uhlig2022-07-14
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* README updateToni Uhlig2022-07-12
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* py-flow-dashboard: Improved graph axis scaling.lns2022-06-16
| | | | Signed-off-by: lns <matzeton@googlemail.com>
* CMake: do not add /usr/include/ndpi to include dirs if BUILD_NDPI or ↵lns2022-06-10
| | | | | | | | | STATIC_LIBNDPI_INSTALLDIR used. * c-collectd: fixed memory leak on failure * py-flow-info.py: fancy spinners and stats counting improved Signed-off-by: lns <matzeton@googlemail.com>
* Merge branch 'master' of github.com:lnslbrty/nDPIdToni Uhlig2022-06-07
|\
| * README updatelns2022-05-31
| | | | | | | | Signed-off-by: lns <matzeton@googlemail.com>
* | nDPIsrvd.py: Throw SocketTimeout Exception to catch both timeout exceptions ↵Toni Uhlig2022-06-07
|/ | | | | | different Python versions can throw. Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Small fixes.lns2022-04-26
| | | | Signed-off-by: lns <matzeton@googlemail.com>
* Added proper DLT_RAW dissection for IPv4 and IPv6.lns2022-04-24
| | | | | | | | | | * nDPId: Improved TCP timeout handling if FIN/RST seen which caused Midstream TCP flows when there shouldn't be any. * nDPIsrvd: Unified remote descriptor resource cleanup on disconnects/shutdown. * nDPIsrvd: Added additional error messages for remote descriptors. * py-flow-info: Better daemon status message printing. Signed-off-by: lns <matzeton@googlemail.com>
* nDPIsrvd.(h|py): Added socket read/recv timeout.lns2022-04-17
| | | | | | * nDPIsrvd.h: support for O_NONBLOCK nDPIsrvd_socket Signed-off-by: lns <matzeton@googlemail.com>
* Executing ./tests/run_tests.sh w/o zLib should not result in diff's anymore.Toni Uhlig2022-03-24
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Reworked nDPIsrvd.h C-API.Toni Uhlig2022-03-21
| | | | | | | | | | | | * nDPIsrvd.h: Provide nDPId thread storage. * nDPIsrvd.py: Fixed instance cleanup bug. * nDPIsrvd.h: Support for instance/thread user data and cleanup callback. * nDPIsrvd.h: Most recent flow time stored in thread ht instead of instance ht. * nDPId: Moved flow logger out the memory profilier into SIGUSR1 signal handling. * nDPId: Added signal fd to be usable within epoll's event handling (live-capture only!) * nDPId: Added information about ZLib compressions to daemon status/shutdown events. Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Renamed basic event to error event for the sake of the logic.Toni Uhlig2022-03-13
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Disconnect nDPIsrvd clients immediately instead waiting for a failed write().Toni Uhlig2022-03-13
| | | | | | | | | * nDPIsrvd: Collector/Distributor logging improved * nDPIsrvd: Command line option for max remote descriptors * nDPId: Stop spamming nDPIsrvd Collector with the same events over and over again * nDPId: Refactored some variable names and events Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Fixed some pyhton issues with static class members.Toni Uhlig2022-03-08
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Updated examples/README.mdToni Uhlig2022-03-06
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Removed go-dashboard example.Toni Uhlig2022-03-06
| | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Added daemon event: DAEMON_EVENT_STATUS (periodically send's daemon statistics.)Toni Uhlig2022-03-06
| | | | | | | | | | * Improved distributor timeout handling (per-thread). * flow-info.py / flow-dash.py: Distinguish between flow risk severities. * nDPId: Skip tag switch datalink packet dissection / processing. * nDPId: Fixed incorrect value for current active flows. * Improved JSON schema's. Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Serialize flow risk score / confidence.Toni Uhlig2022-02-27
| | | | | | | * bump libnDPI to 8b062295cc76a60e3905c054ce37bd17669464d1 * removed ndpi_id_struct's Signed-off-by: Toni Uhlig <matzeton@googlemail.com>