CRAWDAD ilesansfil/wifidog

Dataset of user session traces collected from Wi-Fi hotspots for six years. This data set contains user session traces which were collected from a large number of free Wi-Fi hotspots in Montreal, Quebec, Canada for six years.date/time of measurement start: 2004-08-28date/time of measurement end: 2010-03-07collection environment: User session traces which were collected from a large number of free Wi-Fi hotspots in Montreal, Quebec, Canada for six years.network configuration: WifiDog is composed of the following 2 components: - the gateway is a daemon process that gets installed on every wireless router on a hotspot. - the auth server is a web application that gets installed in a central location. WifiDog enables a new hotspot site to configure the equipment by just plugging it in the existing network and entering the new router password. Existing networks, such as DSL and cable connections, have proven rather unreliable, so WifiDog makes monitoring easier in the following ways:- it graphically displays the status and location of each hotspot (see http://carte.ilesansfil.org/). - in case of fault, it sends mail to local support resources assigned to that hotspot. - it is completely unaffected by network address translation or firewalls upstream. - finally it does all this without any extra software (VPN, SNMP, etc).data collection methodology: The ISF team collects user session (i.e., between login and logout) data such as account (user) id, MAC address, login and logout time, hotspot id, and amount of data transferred incoming and outgoing. They also logs content display and click-through, but only for content being displayed on the auth server, and therefore the data are not included in this data set.sanitization: The ISF team anonymized account id (user_id), connection id (conn_id), user MAC address (user_mac), and hotspot id (node_id). They performed hashing with a different random seed for every value. The code that generated the anonymised data can be found athttp://dev.wifidog.org/browser/trunk/wifidog-auth/wifidog/classes/StatisticReport/AnonymisedDataExport.phpTracesetilesansfil/wifidog/sessionThis traceset contains user sessions which were collected from a large number of free Wi-Fi hotspots in Montreal, Quebec, Canada for six years.file: isf_wifidog_anonymised_data_nogeo_2004-08-27_2010-03-07.csv.gz, isf_wifidog_anonymised_data_nogeo_2004-08-27_2010-03-07.sql.gzmeasurement purpose: Usage Characterizationmethodology: When a user connects to a gateway installed on a wireless router, the gateway opens a session on the auth server (that knows what hotspot the user is connecting from), the auth server assigns a session number (connection id) and gives it to the gateway. The gateway then counts the in and out traffic transferred during that session, and periodically sends it to the auth server for each connected user. Therefore, no merge of data from different hotspots is necessary, the only place data is logged is on the auth server.ilesansfil/wifidogTrace session/04_10 : User session traces which were collected from a large number of free Wi-Fi hotspots in Montreal, Quebec, Canada for six years.format: The trace includes postgresql compatible file of SQL statements. The table created has the same column names, and the same datatype as the real data. The table schema is as follows:CREATE TABLE connections_anonymised(conn_id text NOT NULL,timestamp_in timestamp,node_id text,timestamp_out timestamp,user_id text NOT NULL DEFAULT '',user_mac text,incoming int8,outgoing int8);where conn_id : connection idtimestamp_in : login time node_id : hotspot id timestamp_out : logout time user_id : user account id user_mac : user MAC address incoming : incoming data transferred (Bytes) outgoing : outgoing data transferred (Bytes)本数据集为采集自加拿大魁北克省蒙特利尔市大量免费Wi-Fi热点的六年用户会话追踪数据集，采集时段为2004年8月28日至2010年3月7日。 网络配置：WifiDog由以下两个组件构成： - 网关（gateway）：部署于每个热点无线路由器上的守护进程。 - 认证服务器（auth server）：部署于中心化位置的Web应用程序。 WifiDog可使新热点站点仅需将设备接入现有网络并输入新路由器密码，即可完成设备配置。现有网络（如DSL、线缆连接）可靠性欠佳，因此WifiDog可通过以下方式简化监控工作： 1. 以图形化方式展示每个热点的状态与位置（详见http://carte.ilesansfil.org/）； 2. 当出现故障时，向分配至该热点的本地支持资源发送告警邮件； 3. 完全不受上游网络地址转换（Network Address Translation, NAT）或防火墙的影响； 4. 全程无需额外软件（如虚拟专用网络（Virtual Private Network, VPN）、简单网络管理协议（Simple Network Management Protocol, SNMP）等）即可完成上述功能。 数据采集方法：ISF团队采集用户会话（即登录与登出之间的会话周期）数据，具体包括用户账户ID、媒体访问控制地址（Media Access Control Address, MAC）、登录时间、登出时间、热点ID以及传入/传出的数据传输量。该团队同时会记录认证服务器上的内容展示与点击行为，但此类数据未纳入本数据集。 数据匿名化处理：ISF团队已对用户账户ID（user_id）、会话ID（conn_id）、用户MAC地址（user_mac）及热点ID（node_id）进行匿名化处理，为每个字段值使用不同的随机种子进行哈希运算。生成匿名化数据的代码可于http://dev.wifidog.org/browser/trunk/wifidog-auth/wifidog/classes/StatisticReport/AnonymisedDataExport.php获取。 追踪集ilesansfil/wifidog/session：该追踪集包含加拿大魁北克省蒙特利尔市六年期间采集的大量免费Wi-Fi热点用户会话数据。 数据集文件包括：isf_wifidog_anonymised_data_nogeo_2004-08-27_2010-03-07.csv.gz、isf_wifidog_anonymised_data_nogeo_2004-08-27_2010-03-07.sql.gz。 采集目的：用户使用特征刻画（Usage Characterization）。 采集流程：当用户连接至部署于无线路由器的网关时，网关将在认证服务器上开启会话（认证服务器可获知用户连接的热点信息），认证服务器会分配会话编号（connection id, conn_id）并将其发送至网关。随后网关统计该会话期间的传入与传出流量，并定期将每个已连接用户的流量数据发送至认证服务器。因此无需合并来自不同热点的数据，唯一的日志记录位置即为认证服务器。 追踪集ilesansfil/wifidogTrace session/04_10：该追踪集同样包含加拿大魁北克省蒙特利尔市六年期间采集的大量免费Wi-Fi热点用户会话数据。 数据格式：本追踪集包含兼容PostgreSQL的SQL语句文件，所创建的表与真实数据拥有完全一致的列名与数据类型。表结构如下： CREATE TABLE connections_anonymised( conn_id text NOT NULL, timestamp_in timestamp, node_id text, timestamp_out timestamp, user_id text NOT NULL DEFAULT '', user_mac text, incoming int8, outgoing int8 ); 各字段含义如下： - conn_id：会话ID - timestamp_in：登录时间 - node_id：热点ID - timestamp_out：登出时间 - user_id：用户账户ID - user_mac：用户MAC地址 - incoming：传入数据传输量（单位：字节） - outgoing：传出数据传输量（单位：字节）