pushshift-reddit

public : 2,776,279 ( 12.70%) restricted : 1,923,526 ( 8.80%) private : 182,045 ( 0.83%) user : 16,982,966 ( 77.67%) other : 100 ( 0.00%) Filtered out: 236 records Kept: 21,864,916 records ================================================================================ Subscriber distribution (all records): ---------------------------------------- 0 : 19,554,742 ( 89.43%) 1-99 : 1,914,086 ( 8.75%) 100-999 : 257,613 ( 1.18%) 100k+ : 9,407 ( 0.04%) 10k-99k : 32,649 ( 0.15%) 1k-9k : 96,655 ( 0.44%) ================================================================================ Output files: ---------------------------------------- public : /mnt/test/subreddits_2025-01_type_public.jsonl Size: 7819.75 MB, Records: 2,776,279 restricted : /mnt/test/subreddits_2025-01_type_restricted.jsonl Size: 5367.15 MB, Records: 1,923,526 private : /mnt/test/subreddits_2025-01_type_private.jsonl Size: 494.01 MB, Records: 182,045 user : /mnt/test/subreddits_2025-01_type_user.jsonl Size: 47017.35 MB, Records: 16,982,966 other : /mnt/test/subreddits_2025-01_type_other.jsonl Size: 0.30 MB, Records: 100 filtered_out: /mnt/test/subreddits_2025-01_filtered_out.jsonl Size: 0.65 MB, Records: 236 ================================================================================ Processing complete! ``` ```log Analyzing subreddits_2025-01_type_other.jsonl... ============================================================ ANALYSIS RESULTS: subreddits_2025-01_type_other.jsonl ============================================================ Total records: 100 Records with null subscribers: 78 (78.0%) Records with 0 subscribers: 0 (0.0%) Records with subscriber data: 22 ============================================================ SUBSCRIBER DISTRIBUTION: ============================================================ 100-999 : 2 ( 9.09%) 1k-9,999 : 4 ( 18.18%) 10k-99,999 : 7 ( 31.82%) 100k-999,999: 4 ( 18.18%) 1M+ : 5 ( 22.73%) ============================================================ DETAILED COUNTS (subscribers ≤ 100): ============================================================ ============================================================ LARGEST PRIVATE SUBREDDIT: ============================================================ Name: announcements Subscribers: 305,601,639 Analyzing subreddits_2025-01_type_private.jsonl... ============================================================ ANALYSIS RESULTS: subreddits_2025-01_type_private.jsonl ============================================================ Total records: 182,045 Records with null subscribers: 182,045 (100.0%) Records with 0 subscribers: 0 (0.0%) ============================================================ ANALYSIS RESULTS: subreddits_2025-01_type_public.jsonl ============================================================ Total records: 2,776,279 Records with null subscribers: 1,507,696 (54.3%) Records with 0 subscribers: 54,596 (2.0%) Records with subscriber data: 1,268,583 ============================================================ SUBSCRIBER DISTRIBUTION: ============================================================ 0 : 54,596 ( 4.30%) 1-9 : 772,490 ( 60.89%) 10-99 : 186,517 ( 14.70%) 100-999 : 149,251 ( 11.77%) 1k-9,999 : 67,126 ( 5.29%) 10k-99,999 : 29,597 ( 2.33%) 100k-999,999: 7,880 ( 0.62%) 1M+ : 1,126 ( 0.09%) ============================================================ DETAILED COUNTS (subscribers ≤ 100): ============================================================ 0 subscribers: 54,596 1 subscribers: 404,588 2 subscribers: 134,452 3 subscribers: 72,103 4 subscribers: 47,842 5 subscribers: 35,533 6 subscribers: 27,385 7 subscribers: 21,623 8 subscribers: 17,159 9 subscribers: 11,805 10 subscribers: 3,709 11 subscribers: 4,430 12 subscribers: 4,612 13 subscribers: 4,882 14 subscribers: 4,601 15 subscribers: 4,725 16 subscribers: 4,643 17 subscribers: 4,519 18 subscribers: 4,352 19 subscribers: 4,157 20 subscribers: 4,092 21 subscribers: 3,911 22 subscribers: 3,658 23 subscribers: 3,573 24 subscribers: 3,460 25 subscribers: 3,315 26 subscribers: 3,214 27 subscribers: 3,149 28 subscribers: 3,117 29 subscribers: 2,915 30 subscribers: 2,825 31 subscribers: 2,808 32 subscribers: 2,687 33 subscribers: 2,707 34 subscribers: 2,558 35 subscribers: 2,549 36 subscribers: 2,574 37 subscribers: 2,494 38 subscribers: 2,332 39 subscribers: 2,272 40 subscribers: 2,245 41 subscribers: 2,188 42 subscribers: 2,151 43 subscribers: 2,057 44 subscribers: 2,010 45 subscribers: 1,979 46 subscribers: 1,881 47 subscribers: 1,913 48 subscribers: 1,845 49 subscribers: 1,902 50 subscribers: 1,763 51 subscribers: 1,763 52 subscribers: 1,742 53 subscribers: 1,764 54 subscribers: 1,654 55 subscribers: 1,567 56 subscribers: 1,613 57 subscribers: 1,582 58 subscribers: 1,556 59 subscribers: 1,528 60 subscribers: 1,488 61 subscribers: 1,454 62 subscribers: 1,425 63 subscribers: 1,428 64 subscribers: 1,297 65 subscribers: 1,332 66 subscribers: 1,339 67 subscribers: 1,313 68 subscribers: 1,282 69 subscribers: 1,334 70 subscribers: 1,278 71 subscribers: 1,233 72 subscribers: 1,259 73 subscribers: 1,165 74 subscribers: 1,211 75 subscribers: 1,194 76 subscribers: 1,165 77 subscribers: 1,117 78 subscribers: 1,090 79 subscribers: 1,136 80 subscribers: 1,116 81 subscribers: 1,092 82 subscribers: 1,063 83 subscribers: 1,013 84 subscribers: 1,006 85 subscribers: 1,005 86 subscribers: 997 87 subscribers: 1,028 88 subscribers: 945 89 subscribers: 955 90 subscribers: 1,002 91 subscribers: 954 92 subscribers: 957 93 subscribers: 961 94 subscribers: 938 95 subscribers: 873 96 subscribers: 926 97 subscribers: 864 98 subscribers: 876 99 subscribers: 863 100 subscribers: 797 ============================================================ LARGEST SUBREDDIT: ============================================================ Name: funny Subscribers: 66,363,925 ============================================================ SUMMARY: ============================================================ Most common subscriber count: 1 (404,588 occurrences) Subreddits with ≤100 subscribers: 1,014,400 Subreddits with ≤10 subscribers: 830,795 (81.9%) ============================================================ ANALYSIS RESULTS: subreddits_2025-01_type_restricted.jsonl ============================================================ Total records: 1,923,526 Records with null subscribers: 693,878 (36.1%) Records with 0 subscribers: 133,483 (6.9%) Records with subscriber data: 1,229,648 ============================================================ SUBSCRIBER DISTRIBUTION: ============================================================ 0 : 133,483 ( 10.86%) 1-9 : 831,789 ( 67.64%) 10-99 : 123,054 ( 10.01%) 100-999 : 108,360 ( 8.81%) 1k-9,999 : 29,525 ( 2.40%) 10k-99,999 : 3,045 ( 0.25%) 100k-999,999: 370 ( 0.03%) 1M+ : 22 ( 0.00%) ============================================================ DETAILED COUNTS (subscribers ≤ 100): ============================================================ 0 subscribers: 133,483 1 subscribers: 539,345 2 subscribers: 124,684 3 subscribers: 57,132 4 subscribers: 35,492 5 subscribers: 25,109 6 subscribers: 18,389 7 subscribers: 13,863 8 subscribers: 10,845 9 subscribers: 6,930 10 subscribers: 1,779 11 subscribers: 2,533 12 subscribers: 2,736 13 subscribers: 2,890 14 subscribers: 2,925 15 subscribers: 2,925 16 subscribers: 2,713 17 subscribers: 2,726 18 subscribers: 2,810 19 subscribers: 2,608 20 subscribers: 2,556 21 subscribers: 2,462 22 subscribers: 2,436 23 subscribers: 2,335 24 subscribers: 2,225 25 subscribers: 2,177 26 subscribers: 2,166 27 subscribers: 2,178 28 subscribers: 2,023 29 subscribers: 2,039 30 subscribers: 1,953 31 subscribers: 1,857 32 subscribers: 1,817 33 subscribers: 1,683 34 subscribers: 1,732 35 subscribers: 1,660 36 subscribers: 1,608 37 subscribers: 1,673 38 subscribers: 1,556 39 subscribers: 1,593 40 subscribers: 1,483 41 subscribers: 1,465 42 subscribers: 1,394 43 subscribers: 1,315 44 subscribers: 1,323 45 subscribers: 1,311 46 subscribers: 1,214 47 subscribers: 1,326 48 subscribers: 1,225 49 subscribers: 1,248 50 subscribers: 1,258 51 subscribers: 1,233 52 subscribers: 1,164 53 subscribers: 1,151 54 subscribers: 1,196 55 subscribers: 1,082 56 subscribers: 1,129 57 subscribers: 1,129 58 subscribers: 1,056 59 subscribers: 1,021 60 subscribers: 1,067 61 subscribers: 1,059 62 subscribers: 960 63 subscribers: 1,029 64 subscribers: 950 65 subscribers: 904 66 subscribers: 958 67 subscribers: 932 68 subscribers: 906 69 subscribers: 922 70 subscribers: 886 71 subscribers: 913 72 subscribers: 843 73 subscribers: 821 74 subscribers: 879 75 subscribers: 874 76 subscribers: 841 77 subscribers: 842 78 subscribers: 818 79 subscribers: 755 80 subscribers: 759 81 subscribers: 798 82 subscribers: 761 83 subscribers: 799 84 subscribers: 726 85 subscribers: 738 86 subscribers: 706 87 subscribers: 731 88 subscribers: 693 89 subscribers: 733 90 subscribers: 692 91 subscribers: 643 92 subscribers: 689 93 subscribers: 641 94 subscribers: 639 95 subscribers: 613 96 subscribers: 609 97 subscribers: 641 98 subscribers: 614 99 subscribers: 573 100 subscribers: 539 ============================================================ LARGEST SUBREDDIT: ============================================================ Name: XboxSeriesX Subscribers: 5,329,718 ============================================================ SUMMARY: ============================================================ Most common subscriber count: 1 (539,345 occurrences) Subreddits with ≤100 subscribers: 1,088,865 Subreddits with ≤10 subscribers: 967,051 (88.8%)``` ```