QRadar Administrador Avanzado
QRadar Administrador Avanzado
QRadar Administrador Avanzado
2 SIEM
Abstract
This introductory course to IBM Security QRadar SIEM enables administrators of QRadar to use the full
potential of QRadar reporting and offense mechanisms in their network environment. Administrators
gain knowledge on how to create new users, log sources, understand the importance of connecting
Vulnerability Scanners, configure Log retention, and the creation and fine tuning of QRadar rules.
The following topics are to be covered in details: Regular Expressions, custom properties, building
Universal DSM Log Source eXtensions (LSX), and creation of rules.
Intended auditory: IBM Security QRadar SIEM Administrators. Each trainee must be given an ID to
successfully complete the lab training session.
Course duration: 2 days.
https://qradar.scnsoft.com
1.
Go to
2.
Agenda
Day 1
1. Introduction to QRadar administration features and functionality
User roles and security profiles
Create and customize network and remote hierarchies
Reference Sets management
Configure Vulnerability Scanner
Configure Routing Rules
Configure Retention Periods
2. Security Events normalization
Regular Expressions
Common normalization fields
Creating and managing custom properties
3. Building LSX (normalization part)
LSX structure
Obligatory fields
Optional fields
Patterns and matchers
Values extraction
Timestamp formatting
LSX deployment
Testing events normalization
Agenda
Day 1
4. Building LSX (mapping part)
QRadar event categories (High and Low Level)
Proper category assignment best practice
EventCRE vs Custom QID
Creating new QIDs
Mapping events in UI
Testing events mapping
Day 2
1. Building blocks (BB) overview and specifics. Enabling custom BB.
Host definitions
Network definitions
False positives
User Tuning / User Defined False Positives Tunings
2. Rules overview
Custom Rules
o Event rule
o Flow rule
o Common rule
o Offense rule
Agenda
Day 2
Agenda
Day 2
3. Fine tuning false positives
From event properties
By Routing Rules
By rule thresholds update
Discovering Servers
Populating Building Blocks
False Positive Rule Chains
Cleaning-up fine tunings
4. Analyzing Offenses
5. QRadar Risk Manager
QRM Overview
QRM Deployment
QRM Adapters
QRM use cases
Day 1
All users that are allowed to access IBM Security QRadar SIEM must be configured first. The
following items are assigned for each user:
User role;
The role represents granted user privileges to access specific functionality and
information in QRadar. Default roles are Admin (full access) and All (limited access).
Additional user roles can be created to meet the requirements for user permissions.
The following basic operations are available for user roles management:
Create a user role;
Edit a user role;
Delete a user role.
Security profile;
The profile provides access to networks and log sources for QRadar users. Default
security profile is for administrative users and allows access to all networks and all log
sources. Additional security profiles can be created to meet the requirements for
accessing networks and log sources.
The following basic operations are available for security profiles management:
Create a security profile;
Edit a security profile;
Duplicate a security profile;
Delete a security profile.
QRadar SIEM utilizes network hierarchy to understand the network traffic and provide the
ability to view the network activity across the entire network infrastructure. Network
hierarchy needs to be defined by a range of IP addresses representing geographical
location and/or business units (i.e. Europe Office, Marketing Dept.). The following best
practices are applied:
Group units with similar behavior;
Group units with similar traffic patterns;
Separate unique units;
Top the traffic consumers;
15 units per group average;
Group subnets (Classless Inter-Domain Routings, CIDRs) into single network group:
Group
IP addresses
Accounting
10.1.1.0/25
Marketing
10.1.2.0/25
IP addresses
Databases
10.1.5.10/32
10.1.10.20/32
10.1.20.30/32
Important: Ensure all internal address spaces, both routable and non-routable, are defined
within your network hierarchy. Failure to do so could result in QRadar generating an
excessive number of false positives.
Subgroup
IP addresses
International_Offices
All
International_Offices
Germany
10.10.0.0/16
International_Offices
Germany_Berlin_Marketing
10.10.1.0/24
International_Offices
Germany_Munich_Accounting
10.10.5.0/24
International_Offices
Italy
10.20.0.0/16
International_Offices
Italy_Rome_Marketing
10.20.1.0/24
International_Offices
Italy_Milan_Accounting
10.20.5.0/24
International_Offices
France
10.30.0.0/16
International_Offices
France_Paris_Marketing
10.30.1.0/24
International_Offices
France_Lyon_Accounting
10.30.5.0/24
International_Offices
Spain
10.40.0.0/16
International_Offices
Spain_Madrid_Marketing
10.40.1.0/24
International_Offices
Spain_Barcelona_Accounting
10.40.5.0/24
International_Offices
Poland
10.50.0.0/16
International_Offices
Poland_Warsaw_Marketing
10.50.1.0/24
International_Offices
Poland_Krakow_Accounting
10.50.5.0/24
International_Offices
Austria
10.60.0.0/16
International_Offices
Austria_Vienna_Marketing
10.60.1.0/24
International_Offices
Austria_Graz_Accounting
10.60.5.0/24
10.0.0.0/8
Trainee 1
Trainee 2
Trainee 3
Trainee 4
Trainee 5
Trainee 6
QRadar uses Vulnerability Integration Services (VIS) for building vulnerability assessment
profiles. These profiles use network activity data to determine vulnerabilities and threat
level on the business network assets. Vulnerability assessment integration is build upon
QRadar interaction with various vulnerability scanners. The following two types of
integration are supported:
Direct communication through specific API
Such integration allows vulnerability scanners management through QRadar GUI:
scan schedule, IP range set, vulnerability data transfer etc. This approach allows direct
interaction with particular vulnerability scanner, which can be used on a daily basis for
the most critical network assets.
After receiving raw log data from log sources, QRadar can forward it to one or more
external systems, such as ticketing or alerting systems. Normalized event data can also be
forwarded to other QRadar systems. QRadar keeps all forwarded data unmodified. The
following items must be configured first in order for QRadar to forward the data:
Forwarding Destinations
These are external systems that QRadar will forward the data to. The following
options are available for the configurations:
Name;
Event Format (Raw or Normalized)
Destination Address;
Destination Port;
Protocol (Raw TCP/UDP, Normalized TCP only).
Routing rules
These are the rules that determine what log data is being forwarded and with what
routing options. The following types of rules are available:
Bulk event forwarding (through Admin tab);
Selective event forwarding (through Offenses->Rules tab).
The following list of retention periods is available for many QRadar configuration settings as
well as for the collected data from the log sources:
Automatic Updates
Backup Retention Period (days, 1-65535);
System Settings
Temporary Files Retention Period (6 hrs 2 years);
Management Database Settings
Accumulator Retention Minute-By-Minute (1 day 2 years);
Accumulator Retention Hourly (1 day 2 years);
Accumulator Retention Daily (1 day 2 years);
Payload Index Retention (1 day 2 years);
Offense Retention Period (1 day 2 years);
Attacker History Retention Period (1 day 2 years);
Target History Retention Period (1 day 2 years);
Ariel Database Settings
Search Results Retention Period (1 day 3 month);
Regular Expressions
A regular expression (RE, regex, regexp) is a pattern describing a certain amount of text,
against which strings can be matched. Strings either match the pattern or they don't. The
shell/cmd wildcards and question marks (* and ?) might be considered as a very primitive
type of RE. Just imagine that *.* will match any filename with the . (dot) present, however,
?.? will only match a 3-character-long filename with the . present.
The other two very import meta characters: ^ (carat) and the $ (dollar sign), which are the
start and end of a line respectively. Searching for the pattern ^test$ will find the word test,
but only if its on a line by itself.
There are also metacharacters that control how many things are being matched. These are
+ (plus) that matches one or more of the immediately preceding item; and * (asterisk) that
matches any number, including none, of the immediately preceding item.
GREEDY
LAZY
.+test vs .+?test
^ vs [^abc]
The placeholders or backreferences are used to return only a matched part of the string
instead of the whole string (Hint: Custom Properties)
Another useful metacharacter is | (pipe), which means OR. This metacharacter has to be
used with () (parentheses) identifying the scope: (T|t)est will match both Test and test
capturing T or t as a backreference #1. If we do not want to capture the backreference, the
regex has to be written as follows: (?:T|t)est
NOTE:
a? vs (?:a)
There is an infinite number of regular expressions that can be used to match a desired
string of text. The following are several common regular expressions:
Variable
Regex
Value
IPv4 Address
(\d{1,3}\.\d{1,3}\.\d{1,3}\.\d{1,3})
127.0.0.1, 192.168.10.1
Port Number
(\d{1,5})
MAC Address
((?:[0-9a-fA-F]{2}\:){5}[0-9a-fA-F]{2})
00:11:22:AA:66:DD
Protocol
(tcp|udp|icmp|gre)
tcp
Device Time
(\w{3}\s\d{2}\s\d{2}:\d{2}:\d{2})
Oct 28 10:01:10
White Space
\s
Match Anything
.+?
This is only the beginning of regular expressions that cover very basics necessary for the
QRadar integration. Mastering regular expressions cannot be thought over night and
requires additional time for reading and practicing. Advanced reading material as well as
regex related software (Regex Buddy) can be found on the internet.
QRadar includes a comprehensive list of available normalization fields for both Log Activity
and Network Activity. The following fields are considered to be common because they are
used as default fields while displaying the default views of Log Activity and Network Activity.
Common Fields for Log Activity
Field Name
Event Name
Log Source
Event Count
Time
Low Level Category
Source IP
Source Port
Destination IP
Destination Port
Username
Magnitude
Description
normalized name of the event;
Log Source that sent the event;
number of events combined into the normalized event;
date and time at which QRadar received the event;
low level category associated with this event;
source IP address of the event;
source port of the event;
destination IP address of the event;
destination port of the event;
username associated with the event;
magnitude of the event.
Standard normalization fields are not always enough to build required filters or rules.
Custom properties are properties that you can create by extracting the necessary data
from unnormalized event payload. The following are 2 types of the custom properties:
Regex Based
These properties are extracted using Java flavor RegEx statements.
Calculation Based
These properties are created by performing operations on existing numeric
properties.
The following naming convention for the custom properties is considered as a good
practice:
<Product>: <Property Name>
Good Examples
Confusing Examples
Oracle: Role
Role
SELinux: Role
Role
MS Server: Role
Role
Example: If your Trainee ID Trainee 1, you should create a custom property called
Trainee1: Affected User to extract username fake_user out of the event. Username can
potentially have only letters, numbers, _ (underscore), and (hyphen). Other trainees
should follow the suite.
LSX structure
QRadar provides Universal Device Support Module (uDSM) Log Source eXtension (LSX)
framework that allows custom development and integration for unsupported log sources.
Additionally, LSX can provide parsing enhancements to already existing DSM to cover
additional reporting requirements. The LSX uses Java flavor regular expressions to provide
parsing logic for the data extraction and further normalization with QRadar. LSX consists of
the following items:
Preprocessor
Optional. A binary for collecting/preprocessing unsupported log source data to make it
available for QRadar standard protocols. The need for preprocessor is based on the
log source data availability.
Obligatory fields
The development of any XML starts with LSX XML template. LSX XML parser consists of the
following obligatory fields:
Field Name
Description
allEventNames
EventName
The action that the event represent. The value of this field plays vital
role in the data correlation process as QRadar at least needs to
know what kind of action was performed.
Optional fields
The following LSX XML fields are optional and their presence depends on the
corresponding data availability within the event. Best practices suggest that all available
data should be parsed for better correlation and visibility.
Field Name
EventCategory
SourceIp
SourcePort
SourceIpPreNAT
SourceIpPostNAT
SourceMAC
SourcePortPreNAT
SourcePortPostNAT
DestinationIp
DestinationPort
DestinationIpPreNAT
Description
specific category the event belongs to;
IP address of the source;
port of the source;
real IP address of the source;
mapped IP address of the source;
MAC identifier of the source;
real port of the source;
mapped port of the source;
IP address of the destination;
port of the destination;
real IP address of the destination.
Optional fields
Field Name
DestinationIpPostNAT
DestinationPortPreNAT
DestinationPortPostNAT
DestinationMAC
DeviceTime
Protocol
UserName
HostName
GroupName
NetBIOSName
ExtraIdentityData
SourceIpv6
DestinationIpv6
Description
mapped IP address of the destination;
real port of the destination;
mapped port of the destination;
MAC identifier of the destination;
time at which the event has occurred;
protocol used;
user who is responsible for the event;
host name (or IP address) where the event has occurred;
name of the group that the host belongs to;
NetBIOS name of the host;
user-specific data associated with the event;
IPv6 source IP address for the message;
IPv6 destination IP address for the message.
<ID> can be any name of your choice, except for the mandatory allEventNames field
that must always be present with the default value;
<REGEX> can be any regex that is used for the purpose of extracting the
corresponding data.
Example:
<pattern id="allEventNames" xmlns=""><![CDATA[(.*)]]></pattern>
Matchers
Matchers are used to link together parsed values with QRadar normalized fields so
that the specific data gets assigned to proper QRadar variables like Username, Source
IP address, etc. The number of matchers must be the same as the number of
patterns. The structure of a matcher is as follows:
<matcher field=<FIELD_NAME>"
order=<ORDER>
pattern-id=<ID>
capture-group=<GROUP_NAME>
enable-substitutions=<ENABLE>/>
where
<FIELD_NAME> values from the obligatory and optional fields tables;
<ORDER> order of precedence, i.e. 1, 2, 3, etc. Depends on the number of similar patterns;
<ID> correspond to the name of the pattern ID used in patterns;
<GROUP_NAME> number of the regex capture group (if any) or a custom group name;
<ENABLE> true for a custom group name, otherwise false.
Values extraction
Values extraction
Values extraction
Values extraction
Remove any unused fields and their corresponding Pattern IDs from the LSX.
Values extraction
Rename the Pattern IDs to a unique name. This saves confusion if multiple patterns are
used and helps distinguish between field and Pattern ID names.
Values extraction
Field Name
Matched Text
Regex
EventName
DROP
\sDROP\s
SourceMAC
MAC=5c:31:39:c2:08:00
MAC=((?:[0-9a-fA-F]{2}\:){5}[0-9a-fA-F]{2})
SourceIp
SRC=172.29.255.121
SRC=(\d{1,3}\.\d{1,3}\.\d{1,3}\.\d{1,3})
DestinationIp
DST=192.168.100.25
DST=(\d{1,3}\.\d{1,3}\.\d{1,3}\.\d{1,3})
Protocol
PROTO=UDP
PROTO=((?:tcp|udp|icmp|gre))\s
SourcePort
SPT=67
SPT=(\d{1,5})\s
DestinationPort DPT=68
DPT=(\d{1,5})\s
Values extraction
It is important to isolate capturing groups as the value passed to QRadar fields should only
contain relevant values, but not the entire string match.
Migrating Regular Expression Patterns Into The LSX
The next step is to migrate the patterns with capture groups into the LSX.
Timestamp formatting
While logging an event, different log sources produce vast variety of timestamps at which
events were logged at the source. These timestamps do not follow a unique pattern and
therefore have to be normalized for QRadar to correctly display the time, at which the
event occurred rather than received by QRadar. This is very important for searches,
correlation rules and offenses.
LSX framework provides flexibility through the use of a corresponding pattern and a
matcher for parsing and formatting the original timestamp.
A timestamp candidate <14>Jan 06 14:31:56 test-host will produce the following pattern
and matcher for the event timestamp:
<pattern id=DeviceTime1 xmlns="">
<![CDATA[<\d+>(\w{3}\s\d{2}\s[\d:]+)\s]]>
</pattern>
<matcher field=DeviceTime
order=1
ext-data="MMM dd HH:mm:ss
pattern-id=DeviceTime1
capture-group=1/>
LSX deployment
At this point, the LSX is complete and can be used to parse the unsupported log source
within QRadar. The completed LSX must be uploaded to QRadar and applied to the
Universal DSM. The logic from the LSX is then used to parse the logs from the unsupported
log source.
The following steps must be produced within QRadar GUI to enable newly developed LSX:
Initially, all of the events from the Universal DSM will appear as unknown in the Log Activity
tab. This is normal. Correctly created Log Source with the corresponding LSX XML should at
least correctly identify the Log Source normalized field when the corresponding data is
received by QRadar. This is achieved by the Log Source Identifier value during Log Source
configuration.
How to correctly specify the Log Source Identifier (LSI)? There are two approaches to solve
this:
Automatic
LSI is automatically identified as the IP address of the source host that send the
system. This approach is good for the Log Sources autodiscovery feature identifying
supported out-of-the-box Log Sources.
Manual
LSI can be manually set depending on the presence of the corresponding value
(hostname or IP address) in the incoming event. LSI for unsupported Log Sources
should always be specified manually.
Prior LSX development finalization, identified Event IDs must be correctly mapped to the
corresponding Event Names. Although the event names might appear as understandable
values in the logs, e.g. DROP, DENY, and ACCEPT, QRadar has no understanding of what
these values actual represent.
From QRadar perspective, these value are strings of text that are not mapped to any known
values. It is necessary to map all unknown events to their equivalents in the QRadar ID
(QID) map. The value will then appear as expected and treated as normalized events.
All QIDs are unique within QRadar and belong to specific categories. Categories are fixed
and cannot be modified by user. These categories are classified as follows:
High-Level Category
Top level category of the QID identifying generic area that QID belongs to.
i.e. Authentication, Access, DoS, Recon, System, etc.
Low-Level Category
Bottom level category of the QID identifying specific section of a particular area that
QID belongs to. One High-Level Category can have many Low-Level Categories, which,
in turn, can have many QIDs.
i.e. Admin Login Successful, Admin Login Failure, Host Logout. As of current QRadar
release, there are 1180 Low-Level Categories.
Any successful Event ID mapping lies within understanding of what exactly the Event ID
represents, i.e. the action behind it. If the action is determined correctly, the appropriate
High-Level Category and then Low-Level Category is chosen for the event out of the list of
available categories. The Low-Level Category must be as close as possible to the meaning
of the action.
Example:
Analysis of the following event
<23>Oct 20 08:33:48 fakeware src=10.10.1.2 uid=root success=yes msg=user fake_user
was created on the system
yields the action of creating a user within the system. Therefore, the appropriate High-Level
and Low-Level Category would be as follows:
Event ID
User_Created_Success
High-Level Category
Authentication
Low-Level Category
User Account Added
Mapping process of Event ID to QID involves the following two completely different
approaches:
Mapping to Event CRE
Event CRE is an event template that is used by QRadar to generate new events. Event
CRE templates already being present on QRadar system. Each Low-Level Category
may have Event CRE templates representing a particular kind of action. Event CRE are
not being associated with any Log Source and therefore can be used for a generic
mapping purpose.
Mapping to Custom QID
Custom QID mapping is a more advanced technique that involves creation of a new
QID first for a specific purpose only and then using this Custom QID for mapping a
particular Event ID. This technique requires knowledge of QRadar CLI tools.
New QIDs creation involves the use of QRadar CLI QID map utility, which can create, export,
import, or modify user-defined QID map entries. The utility provides the following options:
qidmap_cli.sh [-l|-c|-m|-i[-f <filename>]|-e[-f <filename>]|-d]
Options
Description
-l
-c
-m
-i
-e
-f
-d
-h
Mapping events in UI
After the mapping is successful, all new events that are identified by the corresponding
Event IDs will automatically be normalized and will participate in the correlation logic and
rules.
Day 2
Host definitions
A Building Block (BB) is a reusable component that can be included in QRadar rules. BBs
can be created or edited to satisfy specific requirements. In simple words, BBs are testing
conditions for the rules, thus BBs are the rules themselves, but without a specific action or
rule respond defined. QRadar includes a comprehensive set of default predefined BBs to
cover various IT, networking, and computing areas, i.e.:
Definitions, Devices, Databases, Networks, Policies, Threats, etc.
The most common family of BBs used in rules creation is BB:HostDefinition family that
contain vast variety of predefined host assets that can be edited to reflect any
environment. Host definitions family includes many categories, i.e.:
Database Server, LDAP Servers, DMZ Servers, Mail Servers, Proxy Servers and many others.
Missing categories can be easily created and exported as new BBs.
BB:HostDefinition are created taking into the account IP addresses and ports of the
required assets.
After creating a new member of any BB family, its name has to be included into the
System: Load Building Blocks rule in order for the BB to work correctly.
Network definitions
Another frequently used in rules creation family of BBs is BB:NetworkDefinition family that
contain vast variety of predefined network assets that can be edited to reflect any network
environment. This BB can be regarded as a soft copy of the Network Hierarchy. Missing
networks can be easily created and exported as new BBs.
BB:NetworkDefinition are created taking into the account CIDRs of the required network
assets.
Best practices suggest that it is advisable to use the Network Hierarchy definitions rather
than Building Blocks for rules checking IP addresses for networks.
False positives
Like any other BBs, BB:FalsePositive family is used to match incoming events based on
certain conditions. However, the purpose of the false-positive identification through BBs is
to exclude matched events from contributing to the other rules that create offenses. This
approach is used to bulk-identify false-positive events with similar conditions, i.e. Low-Level
Category.
After creating a new false-positive BB, its name has to be included into the FalsePositive:
False Positive Rules and Building Blocks rule in order for the BB to work correctly.
To reduce the number of offenses, the following BBs needs to be edited since they are
producing a lot of traffic:
BB:HostDefinition: VA Scanner Source IP
BB:HostDefinition: Network Management Servers
BB:HostDefinition: Virus Definition and Other Update Servers
BB:HostDefinition: Proxy Servers
BB:NetworkDefinition: NAT Address Range
BB:NetworkDefinition: TrustedNetwork
False Positive Tuning function can be used to tune out false positive events and flows from
creating offenses. The user must have appropriate permissions for creating customized
rules to tune false positives.
The following best practices tuning methodology is applicable:
Disable rules that produce numerous unwanted offenses.
Consider modifying rules to include local rather than remote network context.
When you edit a rule with the attach events for the next 300 seconds option enabled,
wait 300 seconds before closing the related offenses.
Rules overview
Custom Rules
A rule is a collection of tests that perform an action when certain conditions are met. Each
rule can be configured to capture and respond to a specific event, sequence of events, flow
sequence, or offense. The actions which can be triggered can include sending an email or
generating a syslog message. A rule can reference multiple building blocks by using the
tests found in the function sections of the test groups within the Rule Editor.
The following rules exist in QRadar:
Event Rule
This rule is only applicable on incoming events as it tests the conditions for event
properties.
Flow Rule
This rule is only applicable on incoming flows as it tests the conditions for flow
properties.
Common Rule
This rule is applicable for both events and flows as it tests the conditions for events
and flows simultaneously.
Offense Rule
This rule is applicable for offenses only as it tests the conditions for already created
offenses.
Rules overview
QRadar also offers a functionality of testing the conditions on aggregated fields thus
creating anomaly rules. In order to enable the anomaly rules creation, the search must
contain a Group By field, be of Time series type, Capture Time Series data, and must also
be saved.
The following anomaly rules exist in QRadar:
Anomaly Rule
This rule performs tests on aggregated fields for anomalous network activity.
Behavioral Rule
This rule type performs tests on aggregated fields to alert on volume changes in
network activity that occurs in regular seasonal patterns.
Threshold Rule
This rule type performs tests on aggregated fields to alert on network activity that
exceeds a defined threshold.
Rules overview
Rules overview
Creating Rules
QRadar provides a comprehensive set of already predefined rule tests that can be used
when constructing a rule. These tests are written in human language so that the meaning
of the test condition can be easily understood. The tests are grouped into the categories
for a better related to a particular category overview. These categories are:
All
Common Property
Date / Time
Event Property
Functions
Host Profile
IP / Ports
Log Source
Network Property
Creating Rules
Creating Rules
The following rules are suitable for working with Custom Properties and Reference Sets
conditional testing:
when the event matches this search filter
when any of these event properties are contained in any of these reference set(s)
Creating Rules
Rule Responses
During rule configuration wizard, QRadar provides the ability to configure the rule
response. The following responses can be set up:
Classic responses (SNMP, Syslog, E-Mail, IF-MAP)
This type of response generates outgoing SNMP trap, e-mail or IF-MAP.
To enable SNMP trap configuration, edit /opt/qradar/conf/offenseCRE.snmp.xml
To enable sending the data to IF-MAP server, system settings must be modified to
allow such kind of data transfer.
Specific responses (Reference Set, Reference Map, Trigger Scan)
This type of response updates reference set/map, or trigger the IP address scan
(destination, source, or both).
Including events into offense
This type of response allows to include the original event into generated offense.
Naming convention. Renaming offenses
Creating Rules
Rule Responses
Tuning Rules
When building custom rules, it is highly recommended that you optimize the order of the
testing. This ensures that the rules do not slow down the Common Rule Engine (CRE). The
tests in a rule are executed in the order in which they are displayed in the user interface.
The most memory intensive tests for the CRE are the payload and regular expression
searches. To ensure these tests run against a smaller subset of data and execute faster, it
is strongly recommend you first include one of the following tests:
when the event(s) were detected by one or more of these log source types
when the event QID is one of the following QIDs
when the source IP is one of the following IP addresses
when the destination IP is one of the following IP addresses
when the local IP is one of the following IP addresses
when the remote IP is one of the following IP addresses
when either the source or destination IP is one of the following IP addresses
when the event(s) were detected by one of more of these log sources
Tuning Rules
When adding more tests to a rule, each test can only be an AND or AND NOT conditional
test. To create an OR condition within the CRE put each separate set of conditions into a
building block and then create a new rule or building block that utilizes the following rule:
when an event matches any of the following rules
This will ensure both Building Blocks are loaded when the test is applied.
Tuning Rules
When the tuning process is complete, it is recommended that you clean the SIM model.
This ensures that QRadar only displays recent offenses. This function ensures that offenses
are based on the most current rules, discovered servers, and network hierarchy. When you
clean the SIM model, all existing offenses are closed, but this does not affect existing events
and flows.
Tuning Rules
Category
Building Block
NAT Address
BB-HostDefinition:Network Management
Servers
Proxy Servers
Server Networks
Vulnerability Scanners
By Routing Rules
Discovering Servers
QRadar automatically discovers and classifies servers in your network, providing a faster
initial deployment and easier tuning when network changes occur.
The Server Discovery function uses the asset profile database to discover many types of
servers on your network. This function lists automatically discovered servers and enables
you to select which servers you want to include in building blocks.
Building blocks use the same tests as rules, however they do not have any actions
associated with them. Building blocks group together commonly used tests, to build
complex logic, so they can be used in rules. Building blocks are often configured to test
groups of IP addresses, privileged usernames, or collections of event names. For example,
you might create a building block that includes the IP addresses of all mail servers in your
network, then use that building block in another rule, to exclude those hosts. The building
block defaults are provided as guidelines, which should be reviewed and edited based on
the needs of your network.
The rule FalsePositive: False Positive Rules and Building Blocks is a special QRadar rule
because it is the first rule to execute in the CRE. When it loads, all of its dependencies are
loaded and tested.
If the rule is successfully matched in QRadar, the rule will drop the detected event or flow.
This action will stop the event or flow from progressing through the CRE. Since this rule
happens first, the event or flow will not match any other rules and will not create an
offense.
When creating false positive BBs, the following approach is recommended:
Name building blocks according to the established naming convention;
Building blocks should contain the test
when a flow or an event matches any of the following rules
This is used as a collection point for all the false positive building blocks and will
enable you to quickly find and identify the customizations within your site.
Analyzing Offenses
Offenses
As event and flow data passes through the CRE, it is correlated using the rules setup on the
customers QRadar system. Depending on how each rule is configured, an offense can be
generated based on this correlation. These Offenses are displayed using the Offenses tab.
Offense investigation is a time consuming process and requires understanding of the
subject of the offense as well as the common-sense knowledge of networking, computing
and Information Technology (IT).
Use most important information from event content to create Offense index. Note that
when index matches for different offenses in a short time period then only one offense
will be created from several rules.
Fill in all BBs (hosts definitions, port definitions, etc.) with proper information
corresponding to infrastructure.
Payload matching is slow. Use indexed custom property instead, when possible.
Creating offense from a single event isn't a good practice and may lead to excessive
number of false-positive offenses to be created. For such rules offense creation could
be omitted, and quick searches could be used for reporting (e.g. one search for all such
suspicious rules triggered). It's OK to have single-event rules which are not generating
offenses. Other option is to include timeframe or number of events seen.
Analyzing Offenses
IMPORTANT: Make sure the rule "System: Load Building Blocks" includes all the custom
BBs you have created and want to utilize.
IMPORTANT: Make sure the rule FalsePositive: False Positive Rules and Building Blocks
includes all the custom BBs you have created for identifying false positives and want to
utilize.
Rename Offense with new event creation using special naming convention.
Check the rules which are not creating offenses. A new rule(s) may need to be created
to include those and create offense, or custom search could be used for reporting.
Use event category as a matching condition instead of specific QID when possible.
Use Log Source Group instead of listing specific Log Sources. Some of the rules will get
broken because of removed Log Sources. Hence the use of Log Source Group is highly
advised.
Use network hierarchy element(s) or BB instead of specifying exact IP addresses.
Use dynamic reference set or BB with users allowed to perform actions instead of listing
names.
Add annotations for each and every Offense.
Review all rules with disabled offense creation. Most likely some of them will need to be
enabled.
Analyzing Offenses
Task 13: Create a rule corresponding to your Trainee ID that matches your trainee ID,
name or surname in custom event property from the reference set Trainee X from the
relevant log. Rule response should be configured to generate on offense including
original events. The offense should have the same name as the rule.
Example: If your Trainee ID is Trainee 1, you should create an Event Rule that will generate
an offense as a rule response, called Trainee 1.Offense: Reference Set Match and add a
condition with the reference set Trainee1 to match your Trainee ID, name or surname out
of the custom property Trainee1: Custom Property. Other trainees should follow the suite.
Analyzing Offenses
Offenses
QRM Overview
QRadar Risk Manager is an internal component of QRadar SIEM solution that proactively
helps in assessing the risks from vulnerabilities, correlating the network topology
information with data from QRadar SIEM, including assets configuration, events and flow
patterns. QRM also helps in detecting configuration errors in firewalls and IPS systems to
build a complete picture of a possible intrusion path.
QRM Overview
QRadar Risk Manager provides simulation capabilities that can check network
connectivity before and after a proposed network configuration change, such as
adding a firewall rule to one or more devices.
QRM Deployment
IBM Security QRadar Risk Manager deployment includes a IBM Security QRadar SIEM
Console and QRadar Risk Manager appliance as a managed host. QRM can be supplied
either as a hardware appliance or a software image to be installed on existing hardware
that meets certain requirements. During the installation, QRM requires the following
parameters in order to be properly initiated:
Network Mask - Type the network mask address for the system.
Once the initial installation and configuration are completed, QRM needs to be added as a
managed host to QRadar SIEM. This is achieved through the Deployment Editor in QRadar
Console Admin tab.
QRM Adapters
QRM uses adapters to integrate the network devices into QRadar SIEM. With the help of
adapters, QRM collects and imports configuration information from the network devices
like firewalls, routers and switches.
The following adapters are supported:
The adapters need to be installed on the QRM in order to provide the support for the
required devices.
QRM Adapters
The following methods of adding devices are available in QRadar Console through Admin
tab (Plugins->QRM):
Discover NSM - Add devices that are managed by a Juniper Networks NSM console.
Discover CPSMS - Add devices that are managed by a Check Point Security Manager
Server (CPSMS).
For more details, please, consult the user documentation for QRM Adapters.
The following use cases are identified with QRM key capabilities:
Configuration Audit
Collected by QRM configuration information for network devices, can be used for
audit compliance and to schedule configuration backups. The configuration
information for your devices is collected from device backups in Configuration Source
Management. Each time QRadar Risk Manager backs up your device list, it archives a
copy of your device configuration to provide a historical reference.
View network paths in the topology
The topology in QRadar Risk Manager displays a graphical representation of your
network devices. A topology path search can determine how your network devices are
communicating and the network path that they use to communicate. Path searching
allows QRadar Risk Manager to visibly display the path between a source and
destination, along with the ports, protocols, and rules.
Visualize the attack path of an offense
Attack path visualization ties offenses with topology searches. This visualization
allows security operators to view the offense detail and the path the offense took
through your network. The visual representation shows you the assets in your
network that are communicating to allow an offense to travel through the network.
The following use cases are identified with QRM key capabilities:
Monitor policies
Use Policy Monitor to define tests that are based on the risk indicators, and then
restrict the test results to filter the query for specific results, violations, protocols,
or vulnerabilities.
Assess assets that have suspicious configurations and communications
Organizations use corporate security policies to define risks and the communications
that are allowed between assets and networks. To assist with compliance and
corporate policy breaches, organizations use Policy Monitor to assess and monitor
risks that might be unknown.
Simulate attacks on network assets
You can use a simulation to test your network for vulnerabilities from various sources.
Simulate the risk of network configuration changes
You can use a topology model to determine the effect of configuration changes on
your network using a simulation.
ScienceSofts Identity
WHO WE ARE:
WHAT WE DO:
SIEM expertise
Two major releases of IBM TCIM (2007-2008), three major releases of IBM
Tivoli Security Information and Event Manager (TSIEM) major releases
(2009-2011)
More than 120 completed CISM, TCIM, and TSIEM Event Sources and
Compliance Management Modules projects, over 40 device rules and
core bug-fixing for TSOM
SCIENCESOFT, INC.
2 Bedy Str.
220040 Minsk, Belarus
Phone: + 375 17 293 3736
Email: contact@scnsoft.com
Web: www.scnsoft.com
SCIENCESOFT OY
Hitsaajankatu 22
00810 Helsinki, Finland
Phone: +358 50 388 3000
Email: contact@scnsoft.fi
Web: www.scnsoft.fi
www.scnsoft.com