Advanced features

Now, let's add some features to make our link crawler more useful for crawling other websites.