StephanAkkerman/crypto-stock-tweets

---
license: cc-by-4.0
language:
- en
tags:
- finance
- twitter
- tweets
- crypto
- stocks
pretty_name: Crypto & Stock Tweets
size_categories:
- 1M<n<10M
---

# Crypto & Stock Tweets

## Overview
This dataset is a combination of publically available financial tweets.

## Datset Size
- Stock Tweets: 2,624,314
- Crypto Tweets: 5,748,725
- Bitcoin Tweets: 4,820,915

## Sources
This dataset is a combination of data from various reputable sources, each contributing a unique perspective on financial tweets:
- [Stock Market Tweets Data](https://ieee-dataport.org/open-access/stock-market-tweets-data): 923,673 rows of stock tweets
- [Stock Market Tweets](https://huggingface.co/datasets/mjw/stock_market_tweets): 1,700,641 rows of stock tweets
- [Crypto Tweets](https://www.kaggle.com/datasets/leoth9/crypto-tweets): 10,438 rows of cryptocurrency tweets
- [Influencers' Tweets In Cryptocurrency](https://data.mendeley.com/datasets/8fbdhh72gs/5): 16,512 rows of cryptocurrency tweets
- [Bitcoin Tweets](https://data.mendeley.com/datasets/x7yvshrnxy/1): 76,797 of bitcoin tweets
- [Bitcoin Tweets](https://www.kaggle.com/datasets/kaushiksuresh147/bitcoin-tweets): 4,863,751 rows of bitcoin tweets
- [Crypto Tweets](https://www.kaggle.com/datasets/tleonel/crypto-tweets-80k-in-eng-aug-2022): 80,000 rows of cryptocurrency tweets
- [Cryptocurreny Sentiment Tweets](https://www.kaggle.com/datasets/rezasemyari/crypto-sentiment-tweets): 824,908 rows of cryptocurrency tweets
- [Financial Tweets](https://huggingface.co/datasets/StephanAkkerman/financial-tweets): 263,119 rows of financial tweets
- [Cryptocurrency Tweets](https://github.com/am15h/CrypTop12): 576,836 rows of cryptocurrency tweets

## Usage
This dataset can be used for pre-training language models on financial tweets.

## Pre-processing Steps
Originally the combined datasets consist of 9,336,675 rows. However, there are some duplicates and not useful tweets in there. The dataset has been cleaned of `t.co` URLs, duplicate text, empty text, and tweets that end with '...'.
As a result the cleaned dataset consist of 8,024,269 rows, which is the one available here.

## Acknowledgements

We extend our heartfelt gratitude to all the authors and contributors of the original datasets. Their efforts in data collection and curation have been pivotal in creating this comprehensive resource.

## License

This dataset is made available under the CC-BY-4.0 license, adhering to the licensing terms of the original datasets.

license: CC-BY-4.0
language:
- en
tags:
- 金融 (Finance)
- 推特 (Twitter)
- 推文 (Tweet)
- 加密货币 (Cryptocurrency)
- 股票 (Stock)
pretty_name: 加密货币与股票推文
size_categories:
- 100万<条目数<1000万

# 加密货币与股票推文

## 数据集概览
本数据集整合了公开可获取的金融 (Finance) 推文 (Tweet)。

## 数据集规模
- 股票 (Stock) 推文：2,624,314条
- 加密货币 (Cryptocurrency) 推文：5,748,725条
- 比特币 (Bitcoin) 推文：4,820,915条

## 数据源
本数据集整合自多个权威数据源，各数据源为金融 (Finance) 推文 (Tweet) 相关研究提供了独特视角：
- [股票 (Stock) 市场推文 (Tweet) 数据集](https://ieee-dataport.org/open-access/stock-market-tweets-data)：923,673条股票 (Stock) 推文 (Tweet)
- [股票 (Stock) 市场推文 (Tweet)](https://huggingface.co/datasets/mjw/stock_market_tweets)：1,700,641条股票 (Stock) 推文 (Tweet)
- [加密货币 (Cryptocurrency) 推文 (Tweet)](https://www.kaggle.com/datasets/leoth9/crypto-tweets)：10,438条加密货币 (Cryptocurrency) 推文 (Tweet)
- [加密货币 (Cryptocurrency) 领域影响者推文 (Tweet)](https://data.mendeley.com/datasets/8fbdhh72gs/5)：16,512条加密货币 (Cryptocurrency) 推文 (Tweet)
- [比特币 (Bitcoin) 推文 (Tweet)](https://data.mendeley.com/datasets/x7yvshrnxy/1)：76,797条比特币 (Bitcoin) 推文 (Tweet)
- [比特币 (Bitcoin) 推文 (Tweet)](https://www.kaggle.com/datasets/kaushiksuresh147/bitcoin-tweets)：4,863,751条比特币 (Bitcoin) 推文 (Tweet)
- [加密货币 (Cryptocurrency) 推文 (Tweet)](https://www.kaggle.com/datasets/tleonel/crypto-tweets-80k-in-eng-aug-2022)：80,000条加密货币 (Cryptocurrency) 推文 (Tweet)
- [加密货币 (Cryptocurrency) 情感推文 (Tweet)](https://www.kaggle.com/datasets/rezasemyari/crypto-sentiment-tweets)：824,908条加密货币 (Cryptocurrency) 推文 (Tweet)
- [金融 (Finance) 推文 (Tweet)](https://huggingface.co/datasets/StephanAkkerman/financial-tweets)：263,119条金融 (Finance) 推文 (Tweet)
- [加密货币 (Cryptocurrency) 推文 (Tweet)](https://github.com/am15h/CrypTop12)：576,836条加密货币 (Cryptocurrency) 推文 (Tweet)

## 使用场景
本数据集可用于针对金融 (Finance) 推文 (Tweet) 的语言模型预训练任务。

## 预处理流程
原始整合后的数据集共计9,336,675条条目，但其中包含部分重复及无效推文 (Tweet)。本数据集已完成清洗，移除了`t.co`短链接、重复文本、空文本以及以‘...’结尾的推文 (Tweet)。经清洗后的有效数据集共计8,024,269条条目，即当前提供的版本。

## 致谢
我们谨向所有原始数据集的作者与贡献者致以诚挚谢意。他们在数据收集与整理过程中付出的努力，是构建本综合资源的核心基础。

## 许可证
本数据集遵循CC-BY-4.0许可证发布，同时遵守各原始数据集的许可条款。

原始信息汇总

Crypto & Stock Tweets 数据集概述

概览

该数据集是公开可用的金融推文的组合。

数据集大小

• 股票推文: 2,624,314
• 加密货币推文: 5,748,725
  • 比特币推文: 4,820,915

数据来源

该数据集结合了来自多个可信来源的数据，每个来源都为金融推文提供了独特的视角：

• Stock Market Tweets Data: 923,673 条股票推文
• Stock Market Tweets: 1,700,641 条股票推文
• Crypto Tweets: 10,438 条加密货币推文
• Influencers Tweets In Cryptocurrency: 16,512 条加密货币推文
• Bitcoin Tweets: 76,797 条比特币推文
• Bitcoin Tweets: 4,863,751 条比特币推文
• Crypto Tweets: 80,000 条加密货币推文
• Cryptocurreny Sentiment Tweets: 824,908 条加密货币推文
• Financial Tweets: 263,119 条金融推文
• Cryptocurrency Tweets: 576,836 条加密货币推文

使用

该数据集可用于在金融推文上预训练语言模型。

预处理步骤

原始合并数据集包含 9,336,675 条推文。然而，其中存在一些重复和不相关的推文。数据集已清理掉 t.co 链接、重复文本、空文本和以 ... 结尾的推文。清理后的数据集包含 8,024,269 条推文，即当前可用的数据集。

许可证

该数据集在 CC-BY-4.0 许可证下提供，遵循原始数据集的许可条款。