rotbluff

Crawler:

1.Get the list of URLs of .lol and .com from ICANN CZDS - done
2.Find good way determine if site is up or down - I have setup yacy instead
            Check it out her> 3.Find good way to crawl site
4.Setup wireguard thru vps in the event sites ban IPs - in progress