Seminars and Events at automatic control
All seminars are held at the Department of Automatic Control, in the seminar room M 3170-73 on the third floor in the M-building, unless stated otherwise.
Master thesis presentation by Tobias Johansson & Ishaaq Khan: Enhancing a Log-analyzer with Graph-RAG
Disputation
From:
2025-06-09 13:00
to
14:00
Place: Seminar Room M 3170-73 in the M-building, LTH
Contact: karl-erik [dot] arzen [at] control [dot] lth [dot] se
Date & Time: June 9th, 13:00-14:00
Location: Seminar Room M 3170-73 in the M-building, LTH
Author: Tobias Johansson & Ishaaq Khan
Title: Enhancing a Log-analyzer with Graph-RAG
Supervisor: Johan Eker, Fredrik Johansson (Bosch)
Examiner: Karl-Erik Årzén
Abstract: Sifting through complex software logs for the root cause of errors can be a daunting and time-consuming task. This thesis explores a novel approach using knowledge graphs and GraphRAG to empower Large Language Models (LLMs) for more efficient and accurate analysis. The methodology involves utilizing log template mining and a build system information to build a knowledge graph, which is then queried for contextual paths to augment LLM prompts. To evaluate our GraphRAG implementation, various LLMs were tested, and performance was measured using F1-score, accuracy, precision, and recall based on the predicted root cause lines. Additionally, a developer survey was conducted to assess the quality of the generated descriptions and solutions. Our evaluation demonstrates that the GraphRAG implementation can significantly improve root cause line identification, increasing the F1-score by up to 58.9% for CMake-related errors and up to 23.56% on a randomized test set, depending on the LLM.