Commit Graph

30 Commits

Author SHA1 Message Date
zzombely
da0e4f3263 crawler classes and image downloader 2023-03-12 15:57:35 +00:00
Michał Kozłowski
680c3d000c fixing 2023-01-10 22:57:22 +01:00
Michał Kozłowski
fe144a70b9 readme and update for mb lock 2023-01-10 19:05:56 +01:00
Michał Kozłowski
fe6f47122a gitignore update 2023-01-07 15:48:45 +01:00
Michał Kozłowski
2f648da50d notebooks folder 2023-01-07 15:47:02 +01:00
Michał Kozłowski
ea2ecf454c Merge branch 'master' of https://git.wmi.amu.edu.pl/s444415/wikisource-crawler 2023-01-07 15:45:16 +01:00
Michał Kozłowski
9ccb251801 output_folder fix 2023-01-07 15:45:14 +01:00
162aae6958 requirements update 2023-01-07 14:41:47 +00:00
Michał Kozłowski
61f83dd7e4 gitignore 2023-01-07 15:31:51 +01:00
Michał Kozłowski
9088a3dc10 fix in notebooks plus join 2023-01-07 15:21:57 +01:00
Michał Kozłowski
1f08432fbf crawler fix 2023-01-07 14:59:07 +01:00
Michał Kozłowski
9ee285cf95 fix 2023-01-07 14:41:26 +01:00
Michał Kozłowski
0f3a6eb9da qol update 2023-01-07 14:39:53 +01:00
Michał Kozłowski
bf6014ba98 header update 2023-01-07 14:32:45 +01:00
Michał Kozłowski
5c3611f972 gitignore 2023-01-07 14:23:59 +01:00
Michał Kozłowski
cc76e894fd headers fix 2023-01-07 14:23:16 +01:00
Michał Kozłowski
f55125f447 image download script 2023-01-07 14:19:01 +01:00
Michał Kozłowski
526eb7d5e4 fix save 2023-01-07 11:42:54 +01:00
Michał Kozłowski
68231dce0a counter update 2023-01-07 11:39:22 +01:00
Michał Kozłowski
6d7c08a9af fix 2023-01-07 11:37:32 +01:00
Michał Kozłowski
0a39807fec crawler update with continuation, files removed 2023-01-07 11:34:27 +01:00
683bc9e6fc green partial done 2023-01-07 09:12:06 +00:00
a16d660cf7 yellow data, crawler fixes, .gitignore added out files 2023-01-04 20:32:26 +00:00
Michał Kozłowski
f7ff1acec3 gitignore 2023-01-03 16:13:33 +01:00
mkozlowskiAzimuthe
b904e64f01 update of crawler 2023-01-03 16:11:50 +01:00
mkozlowskiAzimuthe
73857d897d Merge branch 'master' into data 2023-01-03 15:26:13 +01:00
Michał Kozłowski
7af7794766 data and req 2023-01-03 15:15:04 +01:00
Michał Kozłowski
a9f7929fc6 full text fix 2023-01-03 14:50:37 +01:00
Michał Kozłowski
bdf5732b70 edit in config 2023-01-03 14:12:57 +01:00
Michał Kozłowski
c68c41e9b5 crawler init 2023-01-03 10:53:34 +01:00