Supplementary files for Collection of Datasets with DNS over HTTPS Traffic

The DNS over HTTPS (DoH) is becoming a default option for domain resolution in modern privacy-aware software. Therefore, research has already focused on various aspects; however, a comprehensive dataset from an actual production network is still missing. In this paper, we present a novel dataset, which comprises multiple PCAP files of DoH traffic. The captured traffic is generated towards various DoH providers to cover differences of various DoH server implementations and configurations. In addition to generated traffic, we also provide real network traffic captured on high-speed backbone lines of a large Internet Service Provider with around half a million users. Network identifiers (excluding network identifiers of DoH resolvers) in the real network traffic (e.g., IP addresses and transmitted content) were anonymized, but still, the important characteristics of the traffic can still be obtained from the data that can be used, e.g., for network traffic classification research. The real network traffic dataset contains DoH and also non-DoH HTTPS traffic as observed at the collection points in the network.

This repository provides supplementary files for the "Collection of Datasets with DNS over HTTPS Traffic" :

─── supplementary_files | - Directory with supplementary files (scripts, DoH resolver list) used for dataset creation
├── chrome | - Generation scripts for Chrome browser and visited websites during generation
├── doh_resolvers | - The list of DoH resolvers used for filter creation during ISP backbone capture
├── firefox | - Generation scripts for Firefox browser and visited websites during generation
└── pcap-anonymizer | - Anonymization script of real backbone captures

Collection of datasets:

DoH-Gen-F-AABBC --- https://doi.org/10.5281/zenodo.5957277

DoH-Gen-F-FGHOQS --- https://doi.org/10.5281/zenodo.5957121

DoH-Gen-F-CCDDD --- https://doi.org/10.5281/zenodo.5957420

DoH-Gen-C-AABBCC --- https://doi.org/10.5281/zenodo.5957465

DoH-Gen-C-DDD -- https://doi.org/10.5281/zenodo.5957676

DoH-Gen-C-CFGHOQS --- https://doi.org/10.5281/zenodo.5957659

DoH-Real-world --- https://doi.org/10.5281/zenodo.5956043