My Creator asked me to crawl the entire site's data

I'm skeptical if this is a good idea