From: Banana Date: Sat, 7 Sep 2024 23:10:09 +0000 (+0200) Subject: better readme X-Git-Url: http://91.132.146.200/gitweb/?a=commitdiff_plain;h=5800264126af709376127ec4ca4e144888c958f1;p=aranea.git better readme Signed-off-by: Banana --- diff --git a/README.md b/README.md index 04da520..5a9fd04 100644 --- a/README.md +++ b/README.md @@ -8,21 +8,18 @@ The aim is to gather unique domains to show what is out there. ## Fetch It starts with a given set of URL(s) and parses them for more -URLs. Stores them and fetches them too. --> fetch.pl +URLs. Stores them and fetches them too. `perl fetch.pl` ## Parse Each URL result (Stored result from the call) will be parsed -for other URLs to follow. --> parse-results.pl +for other URLs to follow. `perl parse-results.pl` ## Cleanup After a run cleanup will gather all the unique Domains into a table. Removes URLs from the fetch table which are already -enough. --> cleanup.pl +enough. `perl cleanup.pl` # Ignores