s444415/wikisource-crawler
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

Merge branch 'master' into data

Browse Source
This commit is contained in:
mkozlowskiAzimuthe 2023-01-03 15:26:13 +01:00
commit 73857d897d
2 changed files with 47 additions and 13 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

59
crawler.ipynb
View File

File diff suppressed because one or more lines are too long

1
crawler.py
View File

@ -4,6 +4,7 @@ from bs4 import BeautifulSoup
import re import re
from tqdm import tqdm from tqdm import tqdm
import time import time
import argparse
def main(): def main():
MAIN_URL = "https://pl.wikisource.org/" MAIN_URL = "https://pl.wikisource.org/"