The result is a software that enables distributed ingestion, transformation, processing, and storage of selected categories of security telemetry and contextual data. The data are transformed according to their intended use and then persistently stored in defined data models across multiple types of data stores. The base transformation step consists of adapting and converting the ingested semi-structured data into weakly structured data. Data with this default structure can be further structured, processed, and enriched so that they can be stored in primary data models according to the specific analytical needs of other project results. Data flows are based on logically interconnected distributed tasks for initial data ingestion, adaptation, and manipulation, as well as batch and streaming jobs and specialized ETL/ELT tasks.