Commit Graph

10 Commits

Author SHA1 Message Date
Dawid Jurkiewicz
f9c5690657 Modifiy error logging in get_parishes_url. Enhance crawl_deon.py
Fix Makefile - append instead of rewrite.
2018-04-06 23:33:18 +02:00
Dawid Jurkiewicz
ccc4af3d51 Fix get parishes urls script. 2018-04-04 20:29:48 +02:00
Dawid Jurkiewicz
b433a5e297 Code refactorings. 2018-03-01 18:16:11 +01:00
Dawid Jurkiewicz
8b72d0b351 Prototype rule based masses extractor.
Added spider.
Started working on testsets.
2018-03-01 14:40:13 +01:00
siulkilulki
7161193169 Add prototype basic crawl 2017-11-21 22:51:09 +01:00
siulkilulki
9f1423b362 fixed url checking 2017-06-21 22:51:53 +02:00
Dawid Jurkiewicz
5ad2a36499 urlschecker alpha & sync 2017-06-21 21:52:20 +02:00
siulkilulki
b17fe9b5c2 fix varaible name 2017-06-19 08:13:08 +02:00
siulkilulki
4ae6cd24c0 fix proxy conditional statement 2017-06-18 21:44:12 +02:00
siulkilulki
f54e01581c code refactorings and improvements 2017-06-18 21:33:44 +02:00