This repo holds source codes for:
scrape.py: for scrapping websites from webpagesplit.py: for splitting csv file into ggiven number of rows per fileduplicate.py: for finding and removivng duplicate entries from csv file
- Contains an actively tracked list of 3500+ unique websites listed by the indian Govenment