A Reproducible POI Recommendation Framework: Works Mapping and Benchmark Evaluation

In the last years, most works have been concerned with proposing new methods and strategies to improve the points-of-interest (POI) recommendation. However, despite all their advances, there is not a uniform methodology to evaluate these proposed methods by a fair evaluation with metrics that cover different aspects besides accuracy. In this sense, our previous paper (Werneck et al., 2021) have studied the most recent works and proposed a specific framework to simulate and evaluate POI recommendations. Thus, here, we present a reproducibility framework of our previous experiments and results. This framework is composed of: (1) a package to perform analysis over a systematic mapping of the POI recommendation literature; and (2) an extensible benchmark to support research aiming to properly evaluate POI recommendations proposals. While the first contains all collected data and insightful views on current advances and opened challenges, the second addresses these problems by considering different datasets, metrics, and the strongest baselines in the literature. Moreover, this work also demonstrates all processes required to instantiate its framework and reproduces the results of the previous paper, leading us to the same conclusions.