fineweb_CC-MAIN-2024-18_100k_output_UncovAI_83362
收藏数据集概述
基本信息
- 许可证: odc-by
- 任务类别: 文本生成
- 语言: 英语
- 数据量: 10K<n<100K
数据集描述
该数据集是从Fineweb数据集中提取的前100,000行数据，专注于CC-MAIN-2024-18的转储。使用UncovAI模型进行文本分析后，发现超过16%的数据被检测为AI生成的。经过筛选，最终得到83,362行数据，总令牌数接近5500万。
数据字段
- text (string): 主要文本内容
- id (string): 原始唯一标识符，来自CommonCrawl
- dump (string): 该样本所属的CommonCrawl转储
- url (string): 原始页面URL
- date (string): 抓取日期（来自CommonCrawl）
- file_path (string): 包含该样本的CommonCrawl warc文件的s3路径
- language (string): 所有样本的语言，均为英语
- language_score (float): 语言预测分数（0.0-1.0），由fastText语言分类器报告
- token_count (int): 应用gpt2分词器后的令牌数量
使用注意事项
请阅读FineWeb数据集的使用注意事项。
数据集下载与使用
python from datasets import load_dataset ds = load_dataset("UncovAI/fineweb_CC-MAIN-2024-18_100k_output_UncovAI_83362")
示例
以下是两个被检测为AI生成并从数据集中移除的文本示例：
示例一:
Jérémy Langlois-Longtin is an experienced retail manager with over 10+ years of expertise. Renowned for his exceptional knowledge Jérémy has established himself as a top-notch fitting specialist. William is a driven and dedicated young retail associate with impressive goalie fitting skills and an exceptional eye for detail. His strong work ethic and meticulous approach guarantee exceptional customer service and impeccable results in the retail industry. Marc Poirier, an accomplished Pro Shop Director with over 15+ years of expertise in the hockey industry. Known for his exceptional skill as a skate specialist, Marc has honed his knowledge through years of experience, and an insatiable desire to make hockey players comfortable in their equipment. Liam is a diligent and dedicated young retail manager with exceptional fitting skills and an unwavering attention to detail. His hard work, combined with his keen eye for perfection, ensures excellent customer experiences and outstanding results in the retail industry. With a successful 10+ year career as a professional hockey player, he brings a wealth of experience and understanding to his role. Jérémys attention to detail, precision, and passion for customer service make him a dedicated and attentive professional, always striving to provide the best possible experience for his clients. Jérémys passion for customer service is truly remarkable. He genuinely cares about the satisfaction and well-being of his clients, going above and beyond to ensure they receive the best possible experience. His commitment to exceeding expectations is evident in his willingness to listen attentively, understand individual needs, and tailor his approach accordingly. Jérémys dedication to customer service creates a welcoming and personalized environment, making clients feel valued and appreciated. Overall, Jérémys combination of experience, attention to detail, precision, and passion for customer service make him a dedicated and attentive professional. Whether on the ice or in his current role, he consistently strives to provide the best possible experience for his clients, ensuring that they receive exceptional service and achieve their desired outcomes. Having played hockey his whole life, William possesses a deep understanding of the sport and its equipment. This firsthand experience allows him to offer expert advice and guidance to customers seeking the perfect goalie gear. His knowledge extends beyond the basic features, enabling him to make accurate recommendations tailored to each individuals playing style and preferences. His meticulous approach extends to his exceptional attention to detail. William leaves no stone unturned when it comes to checking inventory, verifying product quality, and maintaining the overall presentation of the retail space. By paying careful attention to every aspect, he ensures a seamless and visually appealing shopping experience for customers. Prior to his role as Pro-Shop Director, Marcs professional journey included a significant tenure as a Senior Analyst at Bauer, a prominent company in the hockey industry. This experience provided him with valuable insights and a comprehensive understanding of the dynamics and nuances of the hockey market. With firsthand exposure to market trends, customer preferences, and industry best practices, Marc brings a unique perspective to his current role. Marcs experience as a Senior Analyst at Bauer, combined with his extensive retail hockey sales background, positions him as a knowledgeable and insightful professional. His exceptional service and meticulous attention to detail set him apart, while his passion for the industry fuels his commitment to exceeding expectations. With Marcs expertise, dedication, and customer-centric approach, clients can trust that they are receiving top-notch support and guidance for their hockey-related endeavors. Marc goes above and beyond to ensure that his clients receive nothing short of outstanding support and satisfaction. Whether its assisting with product selection, addressing concerns, or providing tailored recommendations, Marc actively engages with his clients to understand their unique needs and preferences. By doing so, he can deliver personalized solutions that meet and exceed their expectations. From an early age, Liam has been deeply passionate about hockey, playing the sport throughout his entire life. This experience has honed his ability to understand the importance of proper fit and tailored solutions. Whether its assisting customers with finding the perfect hockey equipment or ensuring that merchandise is displayed flawlessly, Liams expertise in fitting is second to none. Liams commitment to providing exceptional customer experiences is evident in his interactions. He actively listens to customers needs and preferences, ensuring that everyone receives personalized attention and finds the right products to meet their specific requirements. His genuine care for customers fosters trust and loyalty, resulting in long-lasting relationships and repeat business.
示例二:
There are many types of projects, but every project needs an acknowledgment to show gratitude to the persons who helped and supported the project’s completion. I am going to share samples of Acknowledgment for your math projects. What should be included in the maths school project acknowledgment? Typically, you are expected to recognize and appreciate the efforts and contributions of those who have assisted you in your project. This includes your math teacher, school, classmates, family, and friends, among others. How to write an Acknowledgement for a maths project? - Identify Key Supporters: Think about who played a significant role in your project. - Express Gratitude: Thank them sincerely in simple words. - Be Specific: Mention their contributions briefly. - Keep It Short: Keep your acknowledgment concise. Acknowledgement for Maths Project I wish to extend my heartfelt gratitude to my math instructor, Ms. Sinth, and our esteemed school principal, Mr. Jagdish. Their unwavering support granted me the invaluable opportunity to delve into the captivating realm of the Visual Proof of Pythagoras’ Theorem. Through their guidance, I embarked on a journey of research that unveiled a plethora of new insights. I am profoundly appreciative of their mentorship. Additionally, my sincere thanks go out to my parents and dear friends, whose unwavering assistance ensured the completion of this project within our stringent time constraints. Acknowledgment for Maths Class 6 & 7 Project I humbly extend my thanks and appreciation to my dedicated math teacher, [Teacher’s Name], whose unwavering guidance has been instrumental throughout the course of this project. I am equally Thankful to my parents for their unwavering support during this experiment, as well as to my friends and all those who directly or indirectly contributed to the successful culmination of this school project. Class 9th 10th 11th 12th CBSE Maths Project I’d like to sincerely thank my dedicated math teacher, [Teacher’s Name], for their unwavering guidance, which played a pivotal role in the success of this project. I also extend my gratitude to our school principal, [Principal’s Name], for providing the excellent opportunity to work on this project. My heartfelt appreciation also goes out to my parents for their constant support throughout this project, as well as to my friends and all those who contributed directly or indirectly to the successful completion of this school project. Acknowledgment for Maths Group Project We would like to express our sincere appreciation and heartfelt gratitude to the dedicated individuals who played a pivotal role in the successful culmination of our college group project. We extend our deepest thanks to our esteemed professor, [Teacher’s Name], for their unwavering guidance and steadfast support. Their profound expertise and mentorship have been instrumental in shaping our project and propelling us towards a path of excellence. We are also profoundly grateful to our esteemed principal, [Principal Name], for affording us the invaluable opportunity to collaborate on this significant project. We extend our appreciation to all of our fellow group members, without whose collaboration and hard work, this project would not have been possible. Each member contributed significantly to our collective success. Another Sample Acknowledgment I wish to extend my heartfelt gratitude to my dedicated mathematics teacher, [Teacher’s Name], for their unwavering and invaluable guidance, which served as the cornerstone of this project’s success. I am equally appreciative of our esteemed school principal, [Principal name], for affording me the exceptional opportunity to embark on this project. In addition, my profound appreciation extends to my parents, whose unwavering support has been a constant source of inspiration during this experimental journey. I am also deeply thankful to my friends and all those who, through their direct or indirect contributions, played an integral role in the triumphant culmination of this school project. Final Words: For a standard mathematics project that doesn’t involve extensive research, it’s best to keep your acknowledgment concise. Just a few sentences will suffice. However, if your math project requires more in-depth research and involves a larger group of individuals, then your acknowledgment should be more comprehensive.
