TOVARŇÁK, Daniel and Tomáš PITNER. Normalization of Unstructured Log Data into Streams of Structured Event Objects. Online. In 2019 IFIP/IEEE Symposium on Integrated Network and Service Management (IM). Washington DC, USA: IEEE, 2019, p. 671-676. ISBN 978-1-72810-618-2.
Other formats:   BibTeX LaTeX RIS
Basic information
Original name Normalization of Unstructured Log Data into Streams of Structured Event Objects
Authors TOVARŇÁK, Daniel (203 Czech Republic, guarantor, belonging to the institution) and Tomáš PITNER (203 Czech Republic, belonging to the institution).
Edition Washington DC, USA, 2019 IFIP/IEEE Symposium on Integrated Network and Service Management (IM), p. 671-676, 6 pp. 2019.
Publisher IEEE
Other information
Original language English
Type of outcome Proceedings paper
Country of publisher United States of America
Confidentiality degree is not subject to a state or trade secret
Publication form electronic version available online
WWW URL URL
RIV identification code RIV/00216224:14610/19:00109532
Organization Ústav výpočetní techniky – Repository – Repository
ISBN 978-1-72810-618-2
ISSN 1573-0077
UT WoS 000469937200120
Keywords in English log management; logging; data integration; normalization; stream processing; monitoring
Links EF16_019/0000822, research and development project.
Changed by Changed by: RNDr. Daniel Jakubík, učo 139797. Changed: 8/9/2020 01:46.
Abstract
Monitoring plays a crucial role in the operation of any sizeable distributed IT infrastructure. Whether it is a university network or cloud datacenter, monitoring information is continuously used in a wide spectrum of ways ranging from mission-critical jobs, e.g. accounting or incident handling, to equally important development-related tasks, e.g. debugging or fault-detection. Whilst pursuing a novel vision of new-generation event-driven monitoring systems, we have identified that a particularly rich source of monitoring information, computer logs, is also one of the most problematic in terms of automated processing. Log data are predominantly generated in an ad-hoc manner using a variety of incompatible formats with the most important pieces of information, i.e. log messages, in the form of unstructured strings. This clashes with our long-term goal of designing a system enabling its users to transparently define real-time continuous queries over homogeneous streams of properly defined monitoring event objects with explicitly described structure. Our goal is to bridge this gap by normalizing the poorly structured log data into streams of structured event objects. The combined challenge of this goal is structuring the log data, whilst considering the high velocity with which they are generated in modern IT infrastructures. This paper summarizes the contributions of a dissertation thesis "Normalization of Unstructured Log Data into Streams of Structured Event Objects" dealing with the matter at hand in detail.
Type Name Uploaded/Created by Uploaded/Created Rights
2019-IM-normalization-of-unstructured-log-data-into-streams-of-structured-event-objects-paper.pdf Licence Creative Commons  File version 27/4/2019

Properties

Name
2019-IM-normalization-of-unstructured-log-data-into-streams-of-structured-event-objects-paper.pdf
Address within IS
https://repozitar.cz/auth/repo/34797/652510/
Address for the users outside IS
https://repozitar.cz/repo/34797/652510/
Address within Manager
https://repozitar.cz/auth/repo/34797/652510/?info
Address within Manager for the users outside IS
https://repozitar.cz/repo/34797/652510/?info
Uploaded/Created
Sat 27/4/2019 00:56

Rights

Right to read
  • anyone on the Internet
Right to upload
 
Right to administer:
  • a concrete person Mgr. Lucie Vařechová, uco 106253
  • a concrete person RNDr. Daniel Jakubík, uco 139797
  • a concrete person Mgr. Jolana Surýnková, uco 220973
Attributes
 
2019-IM-normalization-of-unstructured-log-data-into-streams-of-structured-event-objects-paper.pdf Licence Creative Commons  File version 15/8/2020

Properties

Name
2019-IM-normalization-of-unstructured-log-data-into-streams-of-structured-event-objects-paper.pdf
Address within IS
https://repozitar.cz/auth/repo/34797/871603/
Address for the users outside IS
https://repozitar.cz/repo/34797/871603/
Address within Manager
https://repozitar.cz/auth/repo/34797/871603/?info
Address within Manager for the users outside IS
https://repozitar.cz/repo/34797/871603/?info
Uploaded/Created
Sat 15/8/2020 04:18

Rights

Right to read
  • anyone on the Internet
Right to upload
 
Right to administer:
  • a concrete person Mgr. Lucie Vařechová, uco 106253
  • a concrete person RNDr. Daniel Jakubík, uco 139797
  • a concrete person Mgr. Jolana Surýnková, uco 220973
Attributes
 
2019-IM-normalization-of-unstructured-log-data-into-streams-of-structured-event-objects-presentation.pdf Licence Creative Commons  File version 27/4/2019

Properties

Name
2019-IM-normalization-of-unstructured-log-data-into-streams-of-structured-event-objects-presentation.pdf
Address within IS
https://repozitar.cz/auth/repo/34797/652509/
Address for the users outside IS
https://repozitar.cz/repo/34797/652509/
Address within Manager
https://repozitar.cz/auth/repo/34797/652509/?info
Address within Manager for the users outside IS
https://repozitar.cz/repo/34797/652509/?info
Uploaded/Created
Sat 27/4/2019 00:56

Rights

Right to read
  • anyone on the Internet
Right to upload
 
Right to administer:
  • a concrete person Mgr. Lucie Vařechová, uco 106253
  • a concrete person RNDr. Daniel Jakubík, uco 139797
  • a concrete person Mgr. Jolana Surýnková, uco 220973
Attributes
 
2019-IM-normalization-of-unstructured-log-data-into-streams-of-structured-event-objects-presentation_rxcwwvtz.pdf Licence Creative Commons  File version 15/8/2020

Properties

Name
2019-IM-normalization-of-unstructured-log-data-into-streams-of-structured-event-objects-presentation_rxcwwvtz.pdf
Address within IS
https://repozitar.cz/auth/repo/34797/871602/
Address for the users outside IS
https://repozitar.cz/repo/34797/871602/
Address within Manager
https://repozitar.cz/auth/repo/34797/871602/?info
Address within Manager for the users outside IS
https://repozitar.cz/repo/34797/871602/?info
Uploaded/Created
Sat 15/8/2020 04:18

Rights

Right to read
  • anyone on the Internet
Right to upload
 
Right to administer:
  • a concrete person Mgr. Lucie Vařechová, uco 106253
  • a concrete person RNDr. Daniel Jakubík, uco 139797
  • a concrete person Mgr. Jolana Surýnková, uco 220973
Attributes
 
Print
Add to clipboard Displayed: 19/5/2024 23:44