StephanAkkerman/crypto-stock-tweets

---
license: cc-by-4.0
language:
- en
tags:
- finance
- twitter
- tweets
- crypto
- stocks
pretty_name: Crypto & Stock Tweets
size_categories:
- 1M<n<10M
---

# Crypto & Stock Tweets

## Overview
This dataset is a combination of publically available financial tweets.

## Datset Size
- Stock Tweets: 2,624,314
- Crypto Tweets: 5,748,725
- Bitcoin Tweets: 4,820,915

## Sources
This dataset is a combination of data from various reputable sources, each contributing a unique perspective on financial tweets:
- [Stock Market Tweets Data](https://ieee-dataport.org/open-access/stock-market-tweets-data): 923,673 rows of stock tweets
- [Stock Market Tweets](https://huggingface.co/datasets/mjw/stock_market_tweets): 1,700,641 rows of stock tweets
- [Crypto Tweets](https://www.kaggle.com/datasets/leoth9/crypto-tweets): 10,438 rows of cryptocurrency tweets
- [Influencers' Tweets In Cryptocurrency](https://data.mendeley.com/datasets/8fbdhh72gs/5): 16,512 rows of cryptocurrency tweets
- [Bitcoin Tweets](https://data.mendeley.com/datasets/x7yvshrnxy/1): 76,797 of bitcoin tweets
- [Bitcoin Tweets](https://www.kaggle.com/datasets/kaushiksuresh147/bitcoin-tweets): 4,863,751 rows of bitcoin tweets
- [Crypto Tweets](https://www.kaggle.com/datasets/tleonel/crypto-tweets-80k-in-eng-aug-2022): 80,000 rows of cryptocurrency tweets
- [Cryptocurreny Sentiment Tweets](https://www.kaggle.com/datasets/rezasemyari/crypto-sentiment-tweets): 824,908 rows of cryptocurrency tweets
- [Financial Tweets](https://huggingface.co/datasets/StephanAkkerman/financial-tweets): 263,119 rows of financial tweets
- [Cryptocurrency Tweets](https://github.com/am15h/CrypTop12): 576,836 rows of cryptocurrency tweets

## Usage
This dataset can be used for pre-training language models on financial tweets.

## Pre-processing Steps
Originally the combined datasets consist of 9,336,675 rows. However, there are some duplicates and not useful tweets in there. The dataset has been cleaned of `t.co` URLs, duplicate text, empty text, and tweets that end with '...'.
As a result the cleaned dataset consist of 8,024,269 rows, which is the one available here.

## Acknowledgements

We extend our heartfelt gratitude to all the authors and contributors of the original datasets. Their efforts in data collection and curation have been pivotal in creating this comprehensive resource.

## License

This dataset is made available under the CC-BY-4.0 license, adhering to the licensing terms of the original datasets.

原始信息汇总

Crypto & Stock Tweets 数据集概述

概览

该数据集是公开可用的金融推文的组合。

数据集大小

• 股票推文: 2,624,314
• 加密货币推文: 5,748,725
  • 比特币推文: 4,820,915

数据来源

该数据集结合了来自多个可信来源的数据，每个来源都为金融推文提供了独特的视角：

• Stock Market Tweets Data: 923,673 条股票推文
• Stock Market Tweets: 1,700,641 条股票推文
• Crypto Tweets: 10,438 条加密货币推文
• Influencers Tweets In Cryptocurrency: 16,512 条加密货币推文
• Bitcoin Tweets: 76,797 条比特币推文
• Bitcoin Tweets: 4,863,751 条比特币推文
• Crypto Tweets: 80,000 条加密货币推文
• Cryptocurreny Sentiment Tweets: 824,908 条加密货币推文
• Financial Tweets: 263,119 条金融推文
• Cryptocurrency Tweets: 576,836 条加密货币推文

使用

该数据集可用于在金融推文上预训练语言模型。

预处理步骤

原始合并数据集包含 9,336,675 条推文。然而，其中存在一些重复和不相关的推文。数据集已清理掉 t.co 链接、重复文本、空文本和以 ... 结尾的推文。清理后的数据集包含 8,024,269 条推文，即当前可用的数据集。

许可证

该数据集在 CC-BY-4.0 许可证下提供，遵循原始数据集的许可条款。