CODECO Energy Demand Management Datasets

Dataset Description This dataset contains HTTP request and response traces generated during video streaming sessions in the P3 Media Delivery Service (MDS) use case of the CODECO project. The data originates from HAR (HTTP Archive) network captures exported from browser developer tools during demonstrations of a distributed Content Delivery Network (CDN) architecture. In the experiment, the central CDN origin server was deployed in a data centre in Greece, hosting the master copy of the media content. An edge cache node was deployed in Madrid (Spain) on a compute cluster orchestrated through the CODECO platform. When a user accessed the streaming service, the request was initially handled by the central CDN endpoint and subsequently redirected to the edge cache, allowing media segments to be delivered locally from the Madrid cluster rather than the origin server. The dataset therefore captures streaming traffic served by both central cloud infrastructure and edge nodes, reflecting realistic content delivery behaviour across distributed edge-cloud deployments. Each row represents a single HTTP transaction associated with media streaming, including: media segment requests (e.g., .ts, .m4s) streaming manifest files (e.g., .m3u8, .mpd) request and response metadata network timing and performance metrics The dataset enables analysis of: media streaming performance edge caching efficiency distributed CDN architectures network latency and throughput Quality of Experience (QoE) monitoring Use Cases and Intended Audience This dataset is intended for researchers and engineers working on: edge-cloud media delivery Content Delivery Networks (CDN) edge caching and orchestration network performance analysis distributed video streaming systems Typical analyses include: chunk delivery latency throughput estimation edge vs origin node performance comparison streaming session reconstruction network bottleneck analysis Data Origin and Generation Methodology Origin: Network traffic captured during CODECO Media Delivery Service demonstrations. Capture method: Browser developer tools network inspector with HAR export. Processing pipeline Streaming sessions were executed using the CODECO media delivery service. Browser network traffic was recorded as HAR files. A Python extraction pipeline parsed HAR entries and anonymized IP addresses. Relevant request, response, and timing fields were extracted and exported to CSV. The resulting dataset represents real HTTP streaming traffic observed during playback sessions. File Structure Smart Cities MDS/README.mdHEU-101092696-CODECO-P3-MDS-MediaConsumptionTraffic.csvanonymize-raw-traffic-file-madrid-cluster.har CSV Schema File: HEU-101092696-CODECO-P3-MDS-MediaConsumptionTraffic.csv ColumnSourceDescriptionstartedDateTimeHARTimestamp when request startedurlHARFull request URLhostnameDerivedHost extracted from URLpathDerivedURL pathfile_extDerivedFile extensionasset_typeDerivedResource type (manifest, chunk, other)chunk_idDerivedMedia segment identifierstatusHARHTTP response status codestatusTextHARHTTP response messageserverIPAddressHARServer/cache node IPconnectionHARConnection identifiercontent_sizeHARDecoded content sizecontent_encodingHAREncoding usedbodySizeHARTransferred body sizeresponse_headersSizeHARResponse headers sizerequest_headersSizeHARRequest headers sizetime_msHARTotal request durationblocked_msHARTime waiting for network slotconnect_msHARTCP connection timewait_msHARServer processing timereceive_msHARResponse download timethroughput_BpsDerivedEstimated throughputis_successDerived1 if 200 ≤ status