6.2. Crawlers and Link Analysis Notes | Information Retrieval BSC-CSIT | TU | TABFlux