D 2018

Stream4Flow: Real-time IP Flow Host Monitoring using Apache Spark

JIRSÍK, Tomáš

Basic information

Original name

Stream4Flow: Real-time IP Flow Host Monitoring using Apache Spark

Authors

JIRSÍK, Tomáš

Edition

Taipei, Taiwan, NOMS 2018 - 2018 IEEE/IFIP Network Operations and Management Symposium, p. 1-2, 2 pp. 2018

Publisher

IEEE

Other information

Language

English

Type of outcome

Proceedings paper

Confidentiality degree

is not subject to a state or trade secret

Publication form

electronic version available online

References:

Marked to be transferred to RIV

Yes

RIV identification code

RIV/00216224:14610/18:00106894

Organization

Ústav výpočetní techniky – Repository – Repository

ISBN

978-1-5386-3416-5

EID Scopus

Keywords in English

host monitoring; situation awareness; real-time; Stream4Flow

Links

VI20162019014, research and development project.
Changed: 31/3/2023 04:06, RNDr. Daniel Jakubík

Abstract

In the original language

In this paper, we present Stream4Flow, a framework for cyber situational awareness based on Apache Spark Streaming. We demonstrate utilization of Stream4Flow for real-time IP flow host monitoring in a large campus network. Contemporary IP flow analysis systems are not designed for the continuous host monitoring. Gaining the detailed overview of each host is not straightforward with these systems due to connection-based paradigm and performance challenges. We show that distributed stream processing is a natural solution for detailed IP flow host monitoring. Moreover, we describe a real-time host monitoring workflow in data streams in detail and present advantages of flow-based host monitoring in Apache Spark including real-time host profiling, dynamic level of detail and granularity.

Files attached