GAW URLs and time stamps 2013-12
收藏资源简介:
The dataset comprises the URLs and corresponding time stamps of the GAW snapshot harvested in 2013-12. Download the files into a new directory and reassemble the files by running from inside the dir: <em>zip -F 2013-12_part.zip --out 2013-12.zip</em> Now decompress the the file by running: <em>unzip 2013-12.zip</em> The directory <em>2013-12</em> contains 100 files, a total of 16 GB. Each file contains two columns delimited by a tab. The time stamps are given in the format of the java equivalent yyyyMMddHHmmss and are parsed as: <pre>DateTime.parse(timeStamp, DateTimeFormat.forPattern("yyyyMMddHHmmss")).getMillis</pre>
本数据集收录了2013年12月采集的GAW快照的统一资源定位符(Uniform Resource Locator,URL)及其对应时间戳。请将下载的文件存放至新建目录,并于该目录内执行如下命令以重组分片文件:<em>zip -F 2013-12_part.zip --out 2013-12.zip</em>。完成重组后,执行以下命令解压文件:<em>unzip 2013-12.zip</em>。解压后得到的<em>2013-12</em>目录共包含100个文件,总大小为16 GB。每个文件均包含以制表符分隔的两列数据。时间戳采用与Java兼容的yyyyMMddHHmmss格式,其解析代码为:<pre>DateTime.parse(timeStamp, DateTimeFormat.forPattern("yyyyMMddHHmmss")).getMillis</pre>



