s500042/webscraper
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
main
webscraper/README.md
paprykdev 053a9b20de
Some checks failed
Docker Image CI / build (push) Has been cancelled
Details
docs: update README.md 
Signed-off-by: paprykdev <58005447+paprykdev@users.noreply.github.com>
2025-01-28 17:17:10 +01:00

913 B
Raw Permalink Blame History

Web scraper 🔍

Description

This project is a web scraper designed to extract data from websites.

How to use

  1. Clone the repository
  2. cd webscraper
  3. cd app
  4. pip3 install -r requirements.txt
  5. python3 scripts/monet.py for the monet scraper
  6. python3 scripts/torres.py for the torres scraper

How to use with Docker

  1. Clone the repository
  2. cd webscraper/app
  3. docker compose up -d
  4. docker exec -it docker exec -it scraper xvfb-run --auto-servernum --server-num=1 --server-args='-screen 0, 1920x1080x24' python3 scripts/monet.py for the monet scraper
  5. docker exec -it docker exec -it scraper xvfb-run --auto-servernum --server-num=1 --server-args='-screen 0, 1920x1080x24' python3 scripts/torres.py for the torres scraper
  6. docker compose down

Video

Watch the video