s444341/Przetwarzanie_tekstu
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

GPT2 custom & dataset metrics

Browse Source
This commit is contained in:
Jakub Adamski 2023-02-18 10:25:07 +01:00
parent bb87963601
commit dc373e55a8
6 changed files with 18510 additions and 12979 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6521
projekt/BERT_sms_spam.ipynb
View File

File diff suppressed because it is too large Load Diff

7230
projekt/FLAN_T5_sms_spam.ipynb
View File

File diff suppressed because it is too large Load Diff

5359
projekt/GPT2_custom_sms_spam.ipynb Normal file
View File

File diff suppressed because one or more lines are too long

6517
projekt/GPT2_sms_spam.ipynb
View File

File diff suppressed because it is too large Load Diff

14
projekt/README.md
View File

@ -62,6 +62,20 @@ Najważniejsze cechy:
- Accuracy: 99% - Accuracy: 99%
- MCC: 0.960 - MCC: 0.960
### Transformer Decoder - GPT2 - modyfikacja
Najważniejsze cechy:
- wytrenowany model gpt2
- typ modelu zmodyfikowany transformers.GPT2ForSequenceClassification - dodatkowe dwie warstwy liniowe
- input modelu - treść smsa
- output modelu - klasa 1 lub 2
- finetuning na zbiorze treningowym
- adamW optimizer
- learning rate 2e-5
- 8 batch size
- 4 epoch
- Accuracy: 99.1%
- MCC: 0.958
### Transformer Encoder-Decoder - T5 ### Transformer Encoder-Decoder - T5
Najważniejsze cechy: Najważniejsze cechy:
- wytrenowany model t5-base - wytrenowany model t5-base

5848
projekt/T5_sms_spam.ipynb
View File

File diff suppressed because it is too large Load Diff