ČERMÁK, Milan, Martin LAŠTOVIČKA and Tomáš JIRSÍK. Real-time Pattern Detection in IP Flow Data using Apache Spark. Online. In 2019 IFIP/IEEE Symposium on Integrated Network and Service Management (IM). Washington DC, USA: IEEE, 2019, p. 521-526. ISBN 978-1-7281-0618-2.
Other formats:   BibTeX LaTeX RIS
Basic information
Original name Real-time Pattern Detection in IP Flow Data using Apache Spark
Authors ČERMÁK, Milan (203 Czech Republic, guarantor, belonging to the institution), Martin LAŠTOVIČKA (203 Czech Republic, belonging to the institution) and Tomáš JIRSÍK (203 Czech Republic, belonging to the institution).
Edition Washington DC, USA, 2019 IFIP/IEEE Symposium on Integrated Network and Service Management (IM), p. 521-526, 6 pp. 2019.
Publisher IEEE
Other information
Original language English
Type of outcome Proceedings paper
Country of publisher United States of America
Confidentiality degree is not subject to a state or trade secret
Publication form electronic version available online
WWW URL URL URL
RIV identification code RIV/00216224:14610/19:00108993
Organization Ústav výpočetní techniky – Repository – Repository
ISBN 978-1-7281-0618-2
ISSN 1573-0077
UT WoS 000469937200092
Keywords in English Anomaly Detection;IP Flow;Apache Spark;Stream Processing
Links EF16_019/0000822, research and development project.
Changed by Changed by: RNDr. Daniel Jakubík, učo 139797. Changed: 26/4/2022 03:08.
Abstract
Detection of network attacks is a challenging task, especially concerning detection coverage and timeliness. The defenders need to be able to detect advanced types of attacks and minimize the time gap between the attack detection and its mitigation. To meet these requirements, we present a stream-based IP flow data processing application for real-time attack detection using similarity search techniques. Our approach extends capabilities of traditional detection systems and allows to detect not only anomalies and attacks that match exactly to predefined patterns but also their variations. The approach is demonstrated on detection of SSH authentication attacks. We describe a process of patterns definition and illustrate their usage in a real-world deployment. We show that our approach provides sufficient performance of IP flow data processing for real-time detection while maintaining versatility and ability to detect network attacks that have not been recognized by traditional approaches.
Type Name Uploaded/Created by Uploaded/Created Rights
2019-IM-real-time-pattern-detection-in-ip-flow-data-using-apache-spark-paper.pdf   File version 19/4/2019

Properties

Name
2019-IM-real-time-pattern-detection-in-ip-flow-data-using-apache-spark-paper.pdf
Address within IS
https://repozitar.cz/auth/repo/34606/649346/
Address for the users outside IS
https://repozitar.cz/repo/34606/649346/
Address within Manager
https://repozitar.cz/auth/repo/34606/649346/?info
Address within Manager for the users outside IS
https://repozitar.cz/repo/34606/649346/?info
Uploaded/Created
Fri 19/4/2019 00:58

Rights

Right to read
  • anyone on the Internet
Right to upload
 
Right to administer:
  • a concrete person Mgr. Lucie Vařechová, uco 106253
  • a concrete person RNDr. Daniel Jakubík, uco 139797
  • a concrete person Mgr. Jolana Surýnková, uco 220973
Attributes
 
2019-IM-real-time-pattern-detection-in-ip-flow-data-using-apache-spark-paper.pdf   File version 15/8/2020

Properties

Name
2019-IM-real-time-pattern-detection-in-ip-flow-data-using-apache-spark-paper.pdf
Address within IS
https://repozitar.cz/auth/repo/34606/871092/
Address for the users outside IS
https://repozitar.cz/repo/34606/871092/
Address within Manager
https://repozitar.cz/auth/repo/34606/871092/?info
Address within Manager for the users outside IS
https://repozitar.cz/repo/34606/871092/?info
Uploaded/Created
Sat 15/8/2020 03:36

Rights

Right to read
  • anyone on the Internet
Right to upload
 
Right to administer:
  • a concrete person Mgr. Lucie Vařechová, uco 106253
  • a concrete person RNDr. Daniel Jakubík, uco 139797
  • a concrete person Mgr. Jolana Surýnková, uco 220973
Attributes
 
2019-IM-real-time-pattern-detection-in-ip-flow-data-using-apache-spark-presentation.pdf Licence Creative Commons 19/4/2019

Properties

Name
2019-IM-real-time-pattern-detection-in-ip-flow-data-using-apache-spark-presentation.pdf
Address within IS
https://repozitar.cz/auth/repo/34606/649347/
Address for the users outside IS
https://repozitar.cz/repo/34606/649347/
Address within Manager
https://repozitar.cz/auth/repo/34606/649347/?info
Address within Manager for the users outside IS
https://repozitar.cz/repo/34606/649347/?info
Uploaded/Created
Fri 19/4/2019 00:58

Rights

Right to read
  • anyone on the Internet
Right to upload
 
Right to administer:
  • a concrete person Mgr. Lucie Vařechová, uco 106253
  • a concrete person RNDr. Daniel Jakubík, uco 139797
  • a concrete person Mgr. Jolana Surýnková, uco 220973
Attributes
 
2019-IM-real-time-pattern-detection-in-ip-flow-data-using-apache-spark-presentation.pdf  15/8/2020

Properties

Name
2019-IM-real-time-pattern-detection-in-ip-flow-data-using-apache-spark-presentation.pdf
Address within IS
https://repozitar.cz/auth/repo/34606/871091/
Address for the users outside IS
https://repozitar.cz/repo/34606/871091/
Address within Manager
https://repozitar.cz/auth/repo/34606/871091/?info
Address within Manager for the users outside IS
https://repozitar.cz/repo/34606/871091/?info
Uploaded/Created
Sat 15/8/2020 03:36

Rights

Right to read
  • anyone on the Internet
Right to upload
 
Right to administer:
  • a concrete person Mgr. Lucie Vařechová, uco 106253
  • a concrete person RNDr. Daniel Jakubík, uco 139797
  • a concrete person Mgr. Jolana Surýnková, uco 220973
Attributes
 
Print
Add to clipboard Displayed: 19/5/2024 20:43