Intelli-log : A real-time log analyzer

Conference proceedings article


Authors/Editors


Strategic Research Themes

No matching items found.


Publication Details

Author listKiatwonghong N., Maneewongvatana S.

PublisherHindawi

Publication year2010

Volume number1

Start pageV1383

End pageV1388

ISBN9781424463688

ISSN0146-9428

eISSN1745-4557

URLhttps://www.scopus.com/inward/record.uri?eid=2-s2.0-77956026075&doi=10.1109%2fICETC.2010.5529226&partnerID=40&md5=35a07355b8bc237bc4371192166b34bc

LanguagesEnglish-Great Britain (EN-GB)


View on publisher site


Abstract

In this paper, we present a technique to analyze and correlate the different types of computer log files. Log files are generated from servers and network devices to record operations that occur in the computers and networks. As log files are too enormous to manualize, we develop a tool to maximize accuracy as well as efficiency while high speed processing is the goal. Firstly, we must improve the accuracy by using learning algorithms to classify the normal operations from the abnormal ones such algorithms include tf-idf, association rules, k-means clustering, and decision tree. Secondly, we may adapt for less accuracy in order to gain speed for both with and/or without parallel processing techniques. We also construct an adaptive learning algorithm to update the model. Then we flush out out-of-date model while the logs are being captured and processed. The result can achieve the goal as they can reach about 30-40% in real-time processing with nearly zero false positive results. ฉ 2010 IEEE.


Keywords

Computer log analysisData streamLearning algorithm


Last updated on 2023-20-09 at 07:35