Go to file
2024-11-15 22:39:49 +01:00
.github/workflows fix: update Docker image CI workflow to use correct script path 2024-11-14 03:40:57 +01:00
app refactor: remove unused import of time module in main.py 2024-11-14 03:38:53 +01:00
scripts refactor: reorganize command handling and introduce new path retrieval logic 2024-11-15 22:39:49 +01:00
.gitignore feat: initial commit 2024-11-12 05:16:21 +01:00
LICENSE docs: add MIT LICENSE 2024-11-12 05:17:24 +01:00
README.md docs: update README to simplify usage instructions and remove outdated content 2024-11-15 17:13:29 +01:00

Web scraper 🔍

Description

This project is a web scraper designed to extract data from websites.

Features

☑️ Extracts data from web pages

Usage

With Docker

  1. Clone the repository:
git clone  https://git.wmi.amu.edu.pl/s500042/webscraper
  1. Navigate to the project directory:
cd webscraper
  1. Build the Docker image and run it using start.py script:
python start.py

On Mac, you'll have to use

python3 start.py

Without Docker

  1. Clone the repository:
git clone  https://github.com/yourusername/webscraper.git
  1. Install the required dependencies:
pip install  -r  requirements.txt

If you're on Arch Linux, you'll need to create a virtual environment. Here's is a Step by step guide that will help you create it.

  1. Run run-with-no-docker.py script:
python run-with-no-docker.py

On Mac you'll, need to use:

python3 run-with-no-dcoker.py

License

This project is licensed under the MIT License. See the LICENSE file for details.