s444465/projekt-glebokie
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

GPT2 head

Browse Source
This commit is contained in:
Andrzej Preibisz 2023-02-12 19:33:45 +01:00
parent 024ad6aae5
commit afc950ac36
1 changed files with 3 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
gpt2.py
View File

@ -84,6 +84,9 @@ class GPT2ClassificationHeadCustom(nn.Module):
x = torch.relu(x) x = torch.relu(x)
x = self.dropout(x) x = self.dropout(x)
x = torch.relu(x)
x = self.dropout(x)
x = torch.relu(x) x = torch.relu(x)
x = self.dropout(x) x = self.dropout(x)