aboutsummaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAge
* Added libgcrypt20-dev dependency to handle QUICLuca Deri2020-08-22
|
* Added som GQUIC and IETF QUIC test pcapsLuca Deri2020-08-22
|
* Fixes compilation issues introduced by https://github.com/ntop/nDPI/pull/989Luca Deri2020-08-22
|
* Warning fixLuca Deri2020-08-22
|
* Merge pull request #989 from IvanNardi/quicLuca Deri2020-08-22
|\ | | | | Improve QUIC detection
| * Add sub-classification for GQUIC >= Q050 and (IETF-)QUICNardi Ivan2020-08-21
| | | | | | | | | | | | | | | | | | | | | | Add QUIC payload and header decryption: most of the crypto code has been "copied-and-incolled" from Wireshark. That code has been clearly marked as such. All credits for that code should go to the original authors. I tried to keep the Wireshark code as similar as possible to the original, comments included, to ease future backporting of fixes. Inevitably, glibc data types and data structures, tvbuff abstraction and allocation functions have been converted.
| * Update TLS dissector to handle QUIC flowsNardi Ivan2020-08-21
| | | | | | | | | | | | | | Latest QUIC versions use TLS for the encryption layer: reuse existing code to allow Client Hello parsing and sub-classification based on SNI value. Side effect: we might have J3AC, TLS negotiated version, SNI value and supported cipher list for QUIC, too.
| * Add (optional) dependency on external libraries: libgcrypt and libgpg-errorNardi Ivan2020-08-21
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | To support QUIC payload and header decryption, it is necessary to choose an external crypto library to handle the low-level crypto stuff. Since we will use some Wireshark code, it is quite natural to choose the same library used by Wireshark itself: libgcrypt. More precisely, we will use libgcrypt and libgpg-error. Both libraries have LGPL license, so there should be no issue from this point of view. These libraries are not required to build nDPI, and their usage is optional: nDPI will keep working (and compiling) even if they are not available. However, without them, QUIC sub-classification is next to impossible. The configure flag "--disable-gcrypt" forces the build system to ignore these libraries. libgpg-error is only used for debug to have meaningful error messages and its usage is trivial. The same cannot be said for libgcrypt because its initialization is a significant issue. The rest of this commit message try explaining how libgcrypt is initialized. According to the documentation https://gnupg.org/documentation/manuals/gcrypt/Initializing-the-library.html https://gnupg.org/documentation/manuals/gcrypt/Multi_002dThreading.html#Multi_002dThreading libgcrypt must be initialized before using it, but such initialization should be performed by the actual application and not by any library. Forcing the users to proper initialize libgcrypt in their own code seems unreasonable: most people using nDPI might be complete unaware of any crypto stuff and update each and every one application linking to nDPI with specific libgcrypt code should be out of question, anyway. Fortunately, it seems a workaround exists to initialize libgcrypt in a library https://lists.gnupg.org/pipermail/gcrypt-devel/2003-August/000458.html Therefore, we could provide a wrapper to this initialization stuff in a nDPI function. Unfortunately nDPI API lacks a global init function that must be called only once, before any other functions. We could add it, but that would be a major API break. AFAIK, ndpi_init_detection_module() might be called multiple times, for example to create multiple independent dpi engines in the same program. The proposed solution is to (optionally) initialize libgcrypt in ndpi_init_detection_module() anyway: * if the actual application doesn't directly use libgcrypt and only calls ndpi_init_detection_module() once, everything is formally correct and it should work out of the box [by far the most common user case]; * if the actual application already uses libgcrypt directly, it already performs the required initialization. In this case the ndpi_prefs.ndpi_dont_init_libgcrypt flag should be passed to ndpi_init_detection_module() to avoid further initializations. The only scenario not supported by this solution is when the application is unaware of libgcrypt and calls ndpi_init_detection_module() multiple times concurrently. But this scenario should be uncommon. A completely different option should be to switch to another crypto library, with a huge impact on the QUIC dissector code. Bottom line: crypto is hard, using libgcrypt is complex and the proposed initialization, even if not perfect, should cover the most frequent user cases and should work, for the time being. If anyone has some suggestions...
| * Major rework of QUIC dissectorNardi Ivan2020-08-21
|/ | | | | Improve support for GQUIC (up to Q046) and add support for Q050 and (IETF-)QUIC Still no sub-classification for Q050 and QUIC
* Added new check for detecting suspicious (too long) namesLuca Deri2020-08-21
|
* Added the ability do identigy as DGA those host/domain names with too many ↵Luca Deri2020-08-21
| | | | | | | consucutive repeated characters such as ckaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa used fr netbios reflection attacks https://www.akamai.com/uk/en/multimedia/documents/state-of-the-internet/ddos-reflection-netbios-name-server-rpc-portmap-sentinel-udp-threat-advisory.pdf
* MySQL8 updateLuca Deri2020-08-21
|
* Merge pull request #988 from lnslbrty/add/mysql-8-manipulated-pktLuca Deri2020-08-21
|\ | | | | Added (manipulated) MySQL 8 test pcap.
| * Added (manipulated) MySQL 8 test pcap.Toni Uhlig2020-08-20
|/ | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* Configure code cleanupLuca Deri2020-08-19
|
* Compilation fixLuca Deri2020-08-19
|
* Merge pull request #987 from lnslbrty/update/mysql-protocol-detectionLuca Deri2020-08-19
|\ | | | | Updated MySQL protocol detection to support server version 8.
| * Updated MySQL protocol detection to support server version 8.Toni Uhlig2020-08-19
| | | | | | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | Merge pull request #985 from lnslbrty/add/SOAPLuca Deri2020-08-19
|\ \ | | | | | | Added support for SOAP.
| * | Added support for SOAP.Toni Uhlig2020-08-18
| | | | | | | | | | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | Merge pull request #977 from adek05/devLuca Deri2020-08-19
|\ \ \ | |_|/ |/| | Enable building on OpenBSD 6.7
| * | OpenBSD: Do not redefine __LITTLE_ENDIAN__Adrian Zgorzałek2020-08-09
| | | | | | | | | | | | Will silence omnipresent compiler warnings when building ntopng.
| * | OpenBSD: Introduce pkt_timeval to deal with (bpf_)_timevalAdrian Zgorzałek2020-08-09
| | | | | | | | | | | | | | | | | | Some BSD APIs called in example/ return `struct bpf_timeval`, where nDPI APIs expect `struct timeval`. These two structs, besides having a different name, share the exact same set of fields.
* | | Updated OpenWRT instructionsLuca Deri2020-08-17
| | |
* | | Added fix for API versions starting with 0Luca Deri2020-08-17
| | |
* | | Added --with-only-libndpi configure option to build just lindpiLuca Deri2020-08-17
| | |
* | | Added README for building libndpi under OpenWRTLuca Deri2020-08-17
| | |
* | | Merge pull request #984 from lnslbrty/fix/invalid-fncall-dpdkLuca Deri2020-08-16
|\ \ \ | | | | | | | | Fixed invalid dpdk fn call.
| * | | Fixed invalid dpdk fn call.Toni Uhlig2020-08-15
| | |/ | |/| | | | | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | Merge pull request #983 from lnslbrty/fix/libpcap-obsolete-pcap_lookupdev-usageLuca Deri2020-08-16
|\ \ \ | | | | | | | | Replaced obsolete libpcap pcap_lookupdev with pcap_findalldevs.
| * | | Replaced obsolete libpcap pcap_lookupdev with pcap_findalldevs.Toni Uhlig2020-08-15
| | | | | | | | | | | | | | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | | Added support for discordLuca Deri2020-08-16
| |/ / |/| |
* | | Merge pull request #976 from lnslbrty/fix/ndpi_simpleint_builderrLuca Deri2020-08-13
|\ \ \ | | | | | | | | Fix/ndpi simpleint builderr
| * | | num_extra_packets_checked check can be 0 for some protocols and therefor ↵Toni Uhlig2020-08-13
| | | | | | | | | | | | | | | | | | | | | | | | requires lesser-or-equal condition for max_extra_packets_to_check Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
| * | | travis-ci: build ndpiSimpleIntegration as wellToni Uhlig2020-08-08
| | | | | | | | | | | | | | | | Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
| * | | Changed ndpi_ssl_version2str function call in ndpiSimpleIntegration.Toni Uhlig2020-08-08
| | |/ | |/| | | | | | | | | | | | | Fixes build error introduced with 23c072153. Signed-off-by: Toni Uhlig <matzeton@googlemail.com>
* | | Merge pull request #974 from IvanNardi/esni4Luca Deri2020-08-13
|\ \ \ | | | | | | | | Suspicious ESNI usage: add a comment and a pcap example
| * | | Suspicious ESNI usage: add a comment and a pcap exampleNardi Ivan2020-08-06
| |/ / | | | | | | | | | See: 79b89d286605635f15edfe3c21297aaa3b5f3acf
* | | Fixes invalid detection on traffic on non standard portsLuca Deri2020-08-12
| | |
* | | Improved DGA detection algoritmLuca Deri2020-08-11
| | |
* | | Added HLL notesLuca Deri2020-08-11
| | |
* | | Add Connectivity check category and blacklisted host risk.aouinizied2020-08-10
| | |
* | | Fix typo.aouinizied2020-08-10
| | |
* | | Added case-insensitive substring matchingLuca Deri2020-08-10
|/ /
* | Merge pull request #973 from IvanNardi/esni3Luca Deri2020-08-06
|\ \ | | | | | | Add risk flag about suspicious ESNI usage
| * | Add risk flag about suspicious ESNI usageNardi Ivan2020-08-05
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | In a Client Hello, the presence of both SNI and ESNI may obfuscate the real domain of an HTTPS connection, fooling DPI engines and firewalls, similarly to Domain Fronting. Such technique is reported in a presentation at DEF CON 28: "Domain Fronting is Dead, Long Live Domain Fronting: Using TLS 1.3 to evade censors, bypass network defenses, and blend in with the noise" Full credit for the idea must go the original author At the moment, the only way to get the pdf presention and related video is via https://forum.defcon.org/node/234492 Hopefully a direct link (and an example pcap) will be available soon
* | | Added note on memory managementLuca Deri2020-08-06
| | |
* | | Added new ndpi_string_sha1_hash API callLuca Deri2020-08-05
| | |
* | | Fixed possible memory leak in TLS certificate handlingLuca Deri2020-08-05
|/ /
* / Win #define fixLuca Deri2020-08-05
|/
Powered by cgit, Themed by Ted Yin.