CICIoMT2024 Cleaned Dataset and EDA Outputs

Description

This repository contains the processed datasets and exploratory data analysis (EDA) outputs generated as part of the research paper <TBC>. The artefacts in this repository serve as the empirical foundation for the <TBC>.

The source dataset, CICIoMT2024, was originally published by Dadkhah et al. (2024) at the Canadian Institute for Cybersecurity, University of New Brunswick, and is available at https://www.unb.ca/cic/datasets/iomt-dataset-2024.html. The raw dataset comprises 8,775,013 flow records collected from 40 IoMT devices across three communication protocols (WiFi, MQTT, and Bluetooth Low Energy), covering 18 labeled attack types across five categories.

The files in this repository are not the raw CICIoMT2024 files. These are the cleaned, structured, and analytically processed derivatives produced through a four-phase EDA pipeline executed in Python 3.11. All outputs were produced using Python 3.11 (scikit-learn 1.4, pandas 2.1, NumPy 1.26, matplotlib 3.8, seaborn 0.13, scipy 1.12) in a Jupyter Notebook environment.

Core Processed Data (Essential)

These are the cleaned outputs from cleaning process of the original CICIoMT2024 dataset. These data are the primary reproducibility artifacts:

wifimqtt_clean.parquet contains 9,128,910 rows, cleaned & labelled WiFi/MQTT flows

bluetooth_clean.parquet contains cleaned & labelled Bluetooth packet-level records

cleaning_summary.csv contains row counts, column counts, unique label counts for both subsets

For Framework Development

Phase 1 - Traffic Distribution

benign_attack_ratio.csv

traffic_by_protocol.csv

protocol_contribution.csv

Phase 2 - Attack Category Profiling

wifimqtt_subtype_counts.csv

wifi_attack_category_profile.csv

bluetooth_category_counts.csv

Phase 3 - Feature Correlation & Redundancy

wifimqtt_correlation_matrix.csv

wifimqtt_high_corr_pairs.csv

wifimqtt_feature_tier_assignments.csv

bluetooth_correlation_matrix.csv

bluetooth_high_corr_pairs.csv

bluetooth_feature_tier_assignments.csv

Phase 4 - Class Imbalance

wifimqtt_imbalance.csv

wifimqtt_entropy_summary.csv

bluetooth_imbalance.csv

bluetooth_entropy_summary.csv

entropy_comparison.csv