A comprehensive dataset of website traffic

The dataset contains traffic collected for 96 websites located in three popular CDNs. For each CDN, the top 30 websites based on the Alexa Top 1000 ranking were selected. For each website, a random subset of 50 sub-pages was retrieved using a javascript- enabled web-crawler. Thus, the data set consists of 4 800 webpages. Traces of every webpage were collected daily for 70 days starting in April 2021. Every website was accessed with Chromium and the Firefox browser in headless mode. This resulted in 100 samples for each website, and a total of 9 600 traces per day.