Replication Package for the paper "Conversing with business process-aware Large Language Models: the BPLLM framework"

Replication Package for the research paper "Conversing with business process-aware Large Language Models: the BPLLM framework". The package includes the process models, the questions (and expected answers), the results of the qualitative evaluation, and the Hugging Face links to the fine-tuned versions of Llama 3.1 8B employed in the quantitative evaluation of the framework. In particular, the process models are: The natural language Directly-follows graph (DFG) of the Food Delivery process: food_delivery_activities.txt for the definition of the activities and food_delivery_flow.txt for the sequence flow. The BPMN model of the Food Delivery, E-commerce, and Reimbursement processes: ecommerce.bpmn, food_delivery.bpmn, and reimbursement.bpmn. The datasets with the questions and the expected answers are: 1_questions_answers_not_refined_for_DFG.csv ; 1.1_questions_answers_refined_for_DFG.csv ; 2_questions_answers_not_refined.csv ; 3_questions_answers_refined.csv ; 4_questions_answers_different_processes.csv ; 5_questions_answers_similar_processes.csv ; 6_questions_answers_refined_ft.csv . The complete results of the qualitative evaluation are contained in the file qualitative_experiments_results.pdf. The Hugging Face links to the fine-tuned versions of Llama 3.1 8B are reported in hf_links_finetuned_models.pdf.