mass-scraper/parishwebsites
siulkilulki 1f6b1e6ffe Working utterances getting/pickling
Working converting parishes from html2text.
Add makefile parish2text goal.
Change to non-html(text) parishes in extract_rule_based and get_utterances
Enhance find_hours.py
Wrap render_template in make_response in webapp/app.py
2018-05-14 01:51:40 +02:00
..
parishwebsites Add robust recrawling of not completed data. 2018-04-16 23:54:03 +02:00
commands-wrapper.sh Prototype rule based masses extractor. 2018-03-01 14:40:13 +01:00
deal-with-not-completed.sh Add robust recrawling of not completed data. 2018-04-16 23:54:03 +02:00
domain-blacklist.txt Add domain-blacklist.txt, domain filter, modify crawler. 2018-04-09 23:53:36 +02:00
find-not-completed.sh Add robust recrawling of not completed data. 2018-04-16 23:54:03 +02:00
generate_spider_commands.sh Tune download settings. Enable dummy cache with 7 days of expiration. 2018-04-15 12:17:35 +02:00
parish2text.py Working utterances getting/pickling 2018-05-14 01:51:40 +02:00
remove_blacklisted.py Fix checking if response is a binary string. 2018-04-13 21:45:20 +02:00
remove_duplicate_commands.py Add robust recrawling of not completed data. 2018-04-16 23:54:03 +02:00
scrapy.cfg Prototype rule based masses extractor. 2018-03-01 14:40:13 +01:00