Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Datajson v1.0 #12102

Closed
wants to merge 8 commits into from
Closed

Datajson v1.0 #12102

wants to merge 8 commits into from

Commits on Nov 7, 2024

  1. detect/datajson: introduce feature

    This patch introduces a new keyword datajson that is similar
    to dataset with a twist. Where dataset allows match from sets,
    datajson allows the same but also adds JSON data to the alert
    event. This data is comint from the set definition it self.
    For example, an ipv4 set will look like:
    
      10.16.1.11,{"test": "success","context":3}
    
    The syntax is value and json data separated by a comma.
    
    The syntax of the keyword is the following:
    
      datajson:isset,src_ip,type ip,load src.lst,key src_ip;
    
    Compare to dataset, it just have a supplementary option key
    that is used to indicate in which subobject the JSON value
    should be added.
    
    The information is added in the even under the alert.extra
    subobject:
    
      "alert": {
        "extra": {
          "src_ip": {
            "test": "success",
            "context": 3
          },
    
    The main interest of the feature is to be able to contextualize
    a match. For example, if you have an IOC source, you can do
    
     value1,{"actor":"APT28","Country":"FR"}
     value2,{"actor":"APT32","Country":"NL"}
    
    This way, a single dataset is able to produce context to the
    event where it was not possible before and multiple signatures
    had to be used.
    
    Ticket: OISF#7372
    regit committed Nov 7, 2024
    Configuration menu
    Copy the full SHA
    f1e55f6 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    997805d View commit details
    Browse the repository at this point in the history
  3. docs: basic datajson documentation

    Ticket: OISF#7372
    regit committed Nov 7, 2024
    Configuration menu
    Copy the full SHA
    a67bd9b View commit details
    Browse the repository at this point in the history
  4. detect/datajson: store json info in a list

    Previous code was using an array and introducing a limit in the
    number of datajson keywords that can be used in a signature.
    
    This patch uses a linked list instead to overcome the limit. By
    using a first element of the list that is part of the structure
    we limit the cost of the feature to a structure member added to
    PacketAlert structure. Only the PacketAlertFree function is
    impacted as we need to iterate to find potential allocation.
    
    Ticket: OISF#7372
    regit committed Nov 7, 2024
    Configuration menu
    Copy the full SHA
    0f01219 View commit details
    Browse the repository at this point in the history
  5. datajson: unix commands to add/remove

    Ticket: OISF#7372
    regit committed Nov 7, 2024
    Configuration menu
    Copy the full SHA
    7672798 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    b50b4e8 View commit details
    Browse the repository at this point in the history
  7. datajson: fix unix socket add command

    It was not handling correctly the json values with space as they
    were seen as multiple arguments.
    
    Ticket: OISF#7372
    regit committed Nov 7, 2024
    Configuration menu
    Copy the full SHA
    6061d01 View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2024

  1. Configuration menu
    Copy the full SHA
    45233ec View commit details
    Browse the repository at this point in the history