5 Commits

Author	SHA1	Message	Date
siulkilulki	382666c563	Add test.py for data gathering (data for annotation) ... Small changes to annotator.py (to be deleted in near future) Add utils/iterator Add redis to enviroment.yml Rename, adapt and move rule based extractor. Adapt find_hours. Yapify webapp app (probalby nothing more) Rename buttons in index.html	2018-05-11 23:12:21 +02:00
siulkilulki	6982ac2e59	Add basic wsgi app. Rename extractors, change directories. ... Add gunicorn and flask to environment.yml Update .gitignore	2018-04-27 22:44:15 +02:00
Dawid Jurkiewicz	21ba56a8fa	Add domain-blacklist.txt, domain filter, modify crawler. ... Add binary or not checker.	2018-04-09 23:53:36 +02:00
Dawid Jurkiewicz	3027e1e7cc	Switch to pure html download. Enhanced urls filtering. ... Update Makefile.	2018-03-11 18:02:31 +01:00
Dawid Jurkiewicz	8b72d0b351	Prototype rule based masses extractor. ... Added spider. Started working on testsets.	2018-03-01 14:40:13 +01:00