遇见数据集

Solal9/polymarket-crypto-updown-binary

收藏
Hugging Face2026-05-24 更新2026-05-31 收录
官方服务:

资源简介:

--- language: - en license: cc-by-4.0 task_categories: - time-series-forecasting tags: - prediction-markets - polymarket - cryptocurrency - bitcoin - ethereum - binary-options - finance - market-microstructure pretty_name: Polymarket Crypto Up/Down Binary Markets by Kresmion.com size_categories: - 1M<n<10M --- # Polymarket Crypto Up/Down Binary Markets Historical orderbook and market snapshot data from Polymarket's short-duration binary "Up or Down" prediction markets for BTC, ETH, SOL, and XRP. Collected continuously over approximately two months at 60-second polling intervals. This dataset captures something genuinely uncommon in publicly available crypto data: minute-resolution implied probabilities for 5-minute, 15-minute, hourly, and daily directional outcomes, with full top-of-book pricing and 5-level orderbook depth. This dataset was collected while building [Kresmion](https://kresmion.com), a financial intelligence platform ## What's in this dataset **4 assets:** BTC, ETH, SOL, XRP **4 timeframes:** 5m, 15m, 1h, 1d (1h and 1d markets are BTC-only on Polymarket) **Total markets covered:** thousands of resolved binary markets **Collection cadence:** 60-second polls **Time period:** [FILL IN: e.g. 2026-03-14 to 2026-05-20, with documented gaps] Two files per asset-timeframe pair: - **`<asset>_<timeframe>_snapshots.parquet`** — one row per poll: market metadata, top-of-book pricing, implied probability, depth summary, market-wide volume and liquidity - **`<asset>_<timeframe>_orderbook.parquet`** — one row per orderbook level per poll: full 5-level depth on both sides with cumulative size and USDC value ## Schema ### Snapshots | Column | Type | Description | |---|---|---| | `collection_timestamp_utc` | datetime | When this row was collected | | `market_id` | string | Polymarket internal market identifier | | `event_id` | string | Parent event identifier | | `condition_id` | string | Polymarket condition identifier (used on the CLOB) | | `slug` | string | Human-readable market slug, e.g. `btc-updown-5m-1773315900` | | `asset` | string | `btc`, `eth`, `sol`, `xrp` | | `question` | string | Full market question text | | `description` | string | Market description from Polymarket | | `market_category` | string | Polymarket category tag | | `window_start_unix` | int | Unix timestamp of the prediction window start | | `window_start_utc` | datetime | Window start in UTC | | `window_end_utc` | datetime | Window end in UTC | | `end_time` | datetime | Market end as reported by Gamma API | | `resolution_time` | datetime | UMA resolution time from Gamma API | | `active_status` | bool | Whether the market was active at collection time | | `closed_status` | bool | Whether the market was closed at collection time | | `market_type` | string | `5m`, `15m`, `1h`, `1d` | | `outcomes` | json | Outcome labels, e.g. `["Up","Down"]` | | `outcome_prices` | json | Outcome prices, e.g. `["0.54","0.46"]` | | `best_bid` | float | Top bid on the Yes/Up token | | `best_ask` | float | Top ask on the Yes/Up token | | `last_price` | float | Last traded price on the Yes/Up token | | `implied_probability` | float | Probability of the Up outcome | | `spread` | float | Bid-ask spread on the Yes/Up token | | `bid_depth_shares` | float | Total share depth across top-5 bid levels | | `ask_depth_shares` | float | Total share depth across top-5 ask levels | | `bid_depth_usdc` | float | USDC notional depth across top-5 bid levels | | `ask_depth_usdc` | float | USDC notional depth across top-5 ask levels | | `bid_levels_count` | int | Bid levels actually present (≤ 5) | | `ask_levels_count` | int | Ask levels actually present (≤ 5) | | `bid_vwap` | float | VWAP across captured bid depth | | `ask_vwap` | float | VWAP across captured ask depth | | `volume` | float | All-time market volume from Gamma API | | `volume_24h` | float | Trailing 24h market volume from Gamma API | | `liquidity` | float | Market liquidity from Gamma API | ### Orderbook | Column | Type | Description | |---|---|---| | `collection_timestamp_utc` | datetime | When this row was collected | | `market_id` | string | Polymarket internal market identifier | | `asset` | string | `btc`, `eth`, `sol`, `xrp` | | `market_type` | string | `5m`, `15m`, `1h`, `1d` | | `slug` | string | Human-readable market slug | | `token_id` | string | CLOB token identifier (Up or Down side) | | `side` | string | `bid` or `ask` | | `level` | int | 1 = best price, increasing toward worse prices | | `price` | float | Price at this level | | `size` | float | Shares available at this level | | `usdc_value` | float | `price × size` | | `cumulative_size` | float | Running total of shares from level 1 to this level | | `cumulative_usdc` | float | Running total of USDC from level 1 to this level | ## How the data was collected A Python collector polled two of Polymarket's public APIs every 60 seconds: - **Gamma API** (`https://gamma-api.polymarket.com`) — market metadata, volume, liquidity - **CLOB API** (`https://clob.polymarket.com`) — live orderbook depth Both endpoints are public and require no authentication. The collector respected standard HTTP retry-after headers and used connection pooling to minimize load. ### Market identification Polymarket uses two different slug formats for Up/Down markets depending on timeframe: **Format A** — unix timestamp suffix (5m and 15m markets): btc-updown-5m-1773315900 btc-updown-15m-1773315900 The window start is computable as `floor(now / window_seconds) * window_seconds`. No API discovery is needed because slugs are fully deterministic. **Format B** — human-readable date/time suffix (1h and 1d markets): bitcoin-up-or-down-march-14-10am-et (1h) bitcoin-up-or-down-on-march-14 (1d) 1h markets use Eastern Time with 12-hour clock and no leading zero. 1d markets use UTC date of the market end day. Both formats pre-create multiple future windows, so the collector generated current + next N window slugs per cycle to capture the transition when one market resolves and the next becomes active. ### Polling behavior For each market, the collector fetched: 1. Market metadata and volume from Gamma 2. Live orderbook (5 levels each side) from CLOB 3. Computed depth aggregates (total shares, USDC, VWAP per side) Snapshots were appended to per-asset, per-timeframe CSV files. The original CSVs have been converted to Parquet for this release. ## Known limitations and gaps Honest disclosure of what this dataset is and isn't. **Gaps in collection.** The collector was not running continuously. Approximate gap periods: - [FILL IN: e.g. 2026-04-02 to 2026-04-08 (collector downtime)] - [FILL IN: e.g. 2026-04-19 to 2026-04-21 (network issue)] - [FILL IN: any other gaps] To identify gaps programmatically, look for periods where `collection_timestamp_utc` skips by more than ~120 seconds. **Orderbook depth limited to 5 levels per side.** Microstructure research requiring full book reconstruction will find this dataset insufficient. The depth captures the typical Polymarket orderbook well for short-duration markets but doesn't include deep tails. **Resolution outcomes.** [FILL IN: state whether the dataset includes final resolution outcomes for closed markets. If yes, describe which column holds it. If no, document the gap and suggest pulling from Polymarket's resolution endpoint via the `market_id` column.] **Coverage by asset.** ETH, SOL, and XRP only have 5m and 15m markets on Polymarket as of the collection period. Only BTC has 1h and 1d markets. The dataset reflects this — there are no `eth_1h_*`, `sol_1d_*`, etc. files. **Single collector.** Data was collected from a single source point. There is no cross-validation against an independent collector. **API rate limits.** During brief periods of high market activity, individual polls may have failed and retried. These show up as occasional gaps of 60-180 seconds rather than the standard 60-second cadence. ## Suggested analyses Things this dataset can support: - Information aggregation efficiency in very short-duration prediction markets (5-15 minute windows are particularly novel) - Comparing Polymarket implied probabilities against realized BTC/ETH/SOL/XRP returns at matching timeframes - Cross-asset correlation of binary market pricing during volatility regimes - Microstructure analysis: spread dynamics, depth resilience, response to underlying spot moves - Calibration studies: how well do market-implied probabilities match observed frequencies of Up vs Down outcomes - Bid-ask spread term structure across 5m, 15m, 1h, 1d horizons - Trading bot research and backtesting against historical orderbook state ## Loading the data ```python import pandas as pd # Single file snapshots = pd.read_parquet("btc_5m_snapshots.parquet") orderbook = pd.read_parquet("btc_5m_orderbook.parquet") # Or load via the Hugging Face datasets library from datasets import load_dataset ds = load_dataset("kresmion/polymarket-crypto-updown-binary") ``` ## License and use Released under **CC-BY-4.0**. You're free to use, modify, and redistribute this data for any purpose including commercial use, provided you give appropriate credit. The data was collected from Polymarket's public APIs which do not require authentication. Polymarket's Terms of Service apply to any downstream redistribution of the data they originated. If you redistribute this dataset or derivatives of it, please: 1. Credit the original collection ("Dataset collected via Polymarket public APIs") 2. Link back to this Hugging Face dataset page 3. Review Polymarket's current ToS for your specific use case ## Citation If you use this dataset in research or publication: ```bibtex @misc{kresmion2026polymarket, title = {Polymarket Crypto Up/Down Binary Markets Dataset}, author = {Kresmion}, year = {2026}, url = {https://huggingface.co/datasets/kresmion/polymarket-crypto-updown-binary} } ``` ## About This dataset was collected while building [Kresmion](https://kresmion.com), a financial intelligence platform that surfaces cross-asset signals from public filings, on-chain activity, derivatives positioning, and prediction markets. The collector ran as part of an experimental arbitrage research project; the dataset is being released because the underlying data is more broadly useful to researchers working on prediction market efficiency, short-duration directional pricing, and crypto microstructure. Kresmion publishes its full methodology at [kresmion.com/about/methodology](https://kresmion.com/about/methodology) and is free during beta.

Polymarket Crypto Up/Down Binary Markets is a historical orderbook and market snapshot dataset from Polymarkets short-duration binary Up or Down prediction markets for BTC, ETH, SOL, and XRP. Collected continuously over approximately two months at 60-second polling intervals, it provides minute-resolution implied probabilities for 5-minute, 15-minute, hourly, and daily directional outcomes, with full top-of-book pricing and 5-level orderbook depth. The dataset includes two files per asset-timeframe pair: snapshots (one row per poll with market metadata, top-of-book pricing, implied probability, depth summary, market-wide volume and liquidity) and orderbook (one row per orderbook level per poll with full 5-level depth on both sides, cumulative size and USDC value). It supports research on prediction market efficiency, crypto microstructure, implied probability calibration, and more, and is released on Hugging Face under the CC-BY-4.0 license.

提供机构:
Solal9
搜集汇总
数据集介绍
Solal9/polymarket-crypto-updown-binary 数据集图片
构建方式
数据集构建依托Polymarket公开API的自动化采集流程,采集器以60秒为固定轮询周期,同步调用Gamma与CLOB两个无需鉴权的接口,分别获取市场元数据、交易量、流动性信息以及实时订单簿深度。针对5分钟与15分钟市场,采集器依据Unix时间戳确定性生成市场标识;对于1小时与1日市场,则根据美东时间与UTC日期规则预先构造多个未来窗口的市场标识,以完整捕捉市场切换过程。每轮采集均计算买卖两侧前五档的份额总量、USDC名义价值及VWAP,快照数据按资产与时间框架分文件追加存储,原始CSV经格式转换后以Parquet形式发布。
特点
该数据集聚焦于短周期二元方向性预测市场,独特之处在于提供了分钟级隐含概率序列,覆盖比特币、以太坊、Solana与瑞波币四种资产在5分钟、15分钟、1小时及1日窗口下的上/下行结果。数据同时包含最优买卖报价、五档订单簿深度、价差、成交量与流动性等多维度指标,时间跨度约两个月,涉及数千个已结算市场。其微结构粒度与多资产、多时间框架的组合方式,为研究短时效预测市场的价格发现效率与流动性动态提供了稀缺的实证素材。
使用方法
研究人员可通过Pandas直接读取Parquet文件,或借助Hugging Face datasets库加载完整数据集。快照表适用于分析隐含概率的校准性、买卖价差期限结构以及跨资产相关性;订单簿表则支持订单簿韧性、深度对现货价格变动的响应等微结构研究。使用者需注意采集器存在偶发中断,连续时间戳间隔超过120秒即标识数据缺口,且订单簿深度仅限五档,难以支撑全簿重建。数据集采用CC-BY-4.0许可,下游使用应适当引用原始采集来源并遵守Polymarket服务条款。
背景与挑战
背景概述
预测市场作为群体智慧的聚合机制,近年来在加密资产领域获得显著关注。Polymarket-Crypto-Updown-Binary数据集由Kresmion团队在构建金融情报平台过程中采集,覆盖BTC、ETH、SOL、XRP四种资产的5分钟至日度二元方向性预测市场,以60秒轮询频率持续约两个月,提供分钟级隐含概率、最优买卖报价及五档订单簿深度。该数据集填补了公开加密数据中短周期高频预测市场微观结构的空白,为信息聚合效率、市场校准及跨资产信号研究提供了独特素材,对预测市场效率与加密微观结构领域具有重要推动意义。
当前挑战
该数据集所应对的核心领域问题在于:极短窗口(5至15分钟)预测市场的价格发现效率与校准性尚缺乏高频实证检验,而此类市场因结算迅速、信息反馈密集,对市场微观结构理论构成独特挑战。构建过程中,采集器面临多重困难:Polymarket对5分钟与15分钟市场采用确定性Unix时间戳标识,而对小时与日度市场使用人类可读日期格式,需动态生成当前及未来窗口标识以捕捉市场切换;公共API在交易活跃期可能触发速率限制,导致轮询间隔由60秒扩展至180秒;订单簿深度仅限五档,无法支持全簿重构;单点采集缺乏交叉验证,且采集器非连续运行造成时段性数据缺口,对时间序列完整性构成挑战。
常用场景
经典使用场景
在预测市场与加密资产交叉的研究领域中,捕捉高频隐含概率与订单簿微观结构数据始终是一项稀缺而关键的挑战。该数据集以60秒轮询粒度,系统性记录了Polymarket平台上BTC、ETH、SOL与XRP四类资产在5分钟、15分钟、1小时及1日四种时间窗口下的二元涨跌预测市场快照与五档订单簿深度,其最经典的使用场景在于构建分钟级隐含概率时间序列,并据此对短周期方向性定价效率开展实证检验,尤其适用于5至15分钟窗口这类极短期限市场的信息聚合与价格发现研究。
解决学术问题
该数据集有效缓解了预测市场研究中长期存在的数据可得性困境,即缺乏兼具高频粒度、完整订单簿深度与多时间窗口对照的公开数据集。其学术意义在于为检验市场隐含概率的校准性、信息效率与微观结构韧性提供了可复现的经验基础,使研究者得以在统一框架下比较不同资产与不同期限的定价偏差,进而推动关于预测市场能否有效汇聚分散信息这一经典命题的量化讨论,并为加密货币与传统金融市场的跨市场信息传导研究提供新的实证入口。
衍生相关工作
围绕该数据集已衍生出一系列与预测市场效率及加密微观结构相关的研究方向,包括跨资产二元市场定价相关性分析、价差期限结构建模以及隐含概率与实际收益率的匹配检验等。这些工作进一步催生了对短期限预测市场价格发现机制的讨论,并为交易策略回测框架、校准度评估工具及订单簿重建方法的开发提供了实证素材,逐步形成从数据采集到模型验证的完整研究链条。
以上内容由遇见数据集搜集并总结生成
二维码
社区交流群
二维码
科研交流群
商业服务