A Log Parsing Framework for ALICE O2 Facilities

Journal article


Authors/Editors

No matching items found.


Strategic Research Themes


Publication Details

Author listTINNAKORN MARLAITHONG , VASCO CHIBANTE BARROSO AND PHOND PHUNCHONGHARN

PublisherInstitute of Electrical and Electronics Engineers

Publication year2023

Volume number11

Start page69439

End page69457

Number of pages19

eISSN2169-3536

URLhttps://ieeexplore.ieee.org/document/10176271


View in Web of Science | View on publisher site | View citing articles in Web of Science


Abstract

The ALICE (A Large Ion Collider Experiment) detector at the European Organization for
Nuclear Research (CERN) generates a substantial volume of experimental data, demanding efficient online
and offline processing. To enhance the stability and reliability of the ALICE computing system, this study
introduces an Artificial Intelligence-based logging system designed to detect, identify, and resolve issues
through the analysis of system runtime information contained in logs. Existing online log parsing methods,
however, often lack full automation and generality, relying instead on manual parameter definition and
regular expressions that are better suited for static logs. In this study, we propose a novel and fully automated
online log parsing framework for ALICE O2
(Online-Offline). To overcome key challenges, we employ
the Term Frequency-Inverse Document Frequency (TF-IDF) algorithm to create ground truth, employ
genetic programming to generate regular expressions, utilize the Artificial Bee Colony (ABC) algorithm
for hyperparameter optimization, and implement a log template reduction algorithm to reduce similarity
among log templates. Our framework’s effectiveness is validated through experiments on 5 benchmark log
datasets and ALICE application logs, comparing its performance with the state-of-art online log parsing
framework, Drain. The empirical results demonstrate the automated nature of our approach and its ability to
achieve accurate parsing with high accuracy (i.e., 99.89% on the ALICE application log).


Keywords

No matching items found.


Last updated on 2023-23-09 at 07:43