siulkilulki 9b76f4e8aa Add robust recrawling of not completed data. ... Add annotator.py (highlighing hout within context done) Enhance parish2text.py (enable more flags, convert button)		2018-04-16 23:54:03 +02:00
..
parishwebsites	Add robust recrawling of not completed data.	2018-04-16 23:54:03 +02:00
commands-wrapper.sh	Prototype rule based masses extractor.	2018-03-01 14:40:13 +01:00
deal-with-not-completed.sh	Add robust recrawling of not completed data.	2018-04-16 23:54:03 +02:00
domain-blacklist.txt	Add domain-blacklist.txt, domain filter, modify crawler.	2018-04-09 23:53:36 +02:00
find-not-completed.sh	Add robust recrawling of not completed data.	2018-04-16 23:54:03 +02:00
generate_spider_commands.sh	Tune download settings. Enable dummy cache with 7 days of expiration.	2018-04-15 12:17:35 +02:00
parish2text.py	Add robust recrawling of not completed data.	2018-04-16 23:54:03 +02:00
remove_blacklisted.py	Fix checking if response is a binary string.	2018-04-13 21:45:20 +02:00
remove_duplicate_commands.py	Add robust recrawling of not completed data.	2018-04-16 23:54:03 +02:00
scrapy.cfg	Prototype rule based masses extractor.	2018-03-01 14:40:13 +01:00