Dataset for Log Parsing: How Far Can Llama-2 and ChatGpt Go?

We present the results of our method on a new version of this benchmark, which has 2,000 log messages with manual annotations. we choose Loghub as it is a public resource of system logs for AI-based log analysis research. It contains logs from real and lab systems, without any changes or modifications. We use datasets from LogPAI, a research platform for log anomaly detection and analysis. LogPAI provides the most comprehensive collection of log datasets, covering different systems such as distributed, supercomputer, operating system, mobile, server and software systems.