wasteof.money was crawled and compiled into a dataset of ~1000 profiles with posts and comments for statistical purposes.

Feb 17, 2023, 6:34 PM
9 2 7

comments

what are the average stats of a post and user (average likes, reposts, comments, edits, and following, followers, and total posts), just curious

Was planning to tally that up next

wait you should open source the data

you mean make it public? or open source the scraper?

Like release data to public

Nobody would want to scrape themselves when they have the data

Before scraping the site, I had consulted with Jeffalo and agreed to a number of terms that would prohibit me from publicizing the raw dataset in the interests of keeping deleted posts / comments private. As for open sourcing the crawler, I am keeping it closed for the moment in the best interests of Jeffalo.