D
2018
Stream4Flow: Real-time IP Flow Host Monitoring using Apache Spark
JIRSÍK, Tomáš
Základní údaje
Originální název
Stream4Flow: Real-time IP Flow Host Monitoring using Apache Spark
Vydání
Taipei, Taiwan, NOMS 2018 - 2018 IEEE/IFIP Network Operations and Management Symposium, od s. 1-2, 2 s. 2018
Další údaje
Typ výsledku
Stať ve sborníku
Utajení
není předmětem státního či obchodního tajemství
Forma vydání
elektronická verze "online"
Označené pro přenos do RIV
Ano
Kód RIV
RIV/00216224:14610/18:00106894
Organizace
Ústav výpočetní techniky – Masarykova univerzita – Repozitář
Klíčová slova anglicky
host monitoring; situation awareness; real-time; Stream4Flow
Návaznosti
VI20162019014, projekt VaV.
V originále
In this paper, we present Stream4Flow, a framework for cyber situational awareness based on Apache Spark Streaming. We demonstrate utilization of Stream4Flow for real-time IP flow host monitoring in a large campus network. Contemporary IP flow analysis systems are not designed for the continuous host monitoring. Gaining the detailed overview of each host is not straightforward with these systems due to connection-based paradigm and performance challenges. We show that distributed stream processing is a natural solution for detailed IP flow host monitoring. Moreover, we describe a real-time host monitoring workflow in data streams in detail and present advantages of flow-based host monitoring in Apache Spark including real-time host profiling, dynamic level of detail and granularity.
Zobrazeno: 9. 5. 2026 06:00