challenging-america-word-gap-prediction-alpha/fine_tuning.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "id": "binding-contribution",
   "metadata": {},
   "source": [
    "## Alpha  fine-tuning"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "colored-chaos",
   "metadata": {},
   "source": [
    "Fine-tuning parametru wygładzania alpha. Tylko 10000 linii ze zbioru trenującego, aby oszczędzić czas. <br>\n",
    "Ostatecznie trening na całym zbiorze z wybranym parametrem."
   ]
  },
  {
   "cell_type": "markdown",
   "id": "environmental-session",
   "metadata": {},
   "source": [
    "#### Alpha 0.001"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "id": "coordinated-ratio",
   "metadata": {},
   "outputs": [],
   "source": [
    "!py run.py 0.001"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "id": "revolutionary-designation",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "597.71\r\n"
     ]
    }
   ],
   "source": [
    "!./geval -t dev-0"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "molecular-civilian",
   "metadata": {},
   "source": [
    "#### Alpha 0.005"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "id": "coral-silver",
   "metadata": {},
   "outputs": [],
   "source": [
    "!py run.py 0.005"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "id": "powered-webcam",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "717.87\r\n"
     ]
    }
   ],
   "source": [
    "!./geval -t dev-0"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "broadband-heating",
   "metadata": {},
   "source": [
    "#### Alpha 0.01"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "id": "moderate-bearing",
   "metadata": {},
   "outputs": [],
   "source": [
    "!py run.py 0.01"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "id": "guilty-committee",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "774.42\r\n"
     ]
    }
   ],
   "source": [
    "!./geval -t dev-0"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "defensive-amount",
   "metadata": {},
   "source": [
    "#### Alpha 0.05"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "id": "senior-government",
   "metadata": {},
   "outputs": [],
   "source": [
    "!py run.py 0.05"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "id": "maritime-father",
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "892.35\r\n"
     ]
    }
   ],
   "source": [
    "!./geval -t dev-0"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "practical-dinner",
   "metadata": {},
   "source": [
    "#### Alpha 0.1"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "id": "sonic-hayes",
   "metadata": {},
   "outputs": [],
   "source": [
    "!py run.py 0.1"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "recent-malaysia",
   "metadata": {},
   "outputs": [],
   "source": [
    "!./geval -t dev-0"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "twelve-teddy",
   "metadata": {},
   "source": [
    "#### Alpha 0.0001"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "accessible-myrtle",
   "metadata": {},
   "outputs": [],
   "source": [
    "!py run.py 0.0001"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "later-aircraft",
   "metadata": {},
   "outputs": [],
   "source": [
    "!./geval -t dev-0"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "understanding-bandwidth",
   "metadata": {},
   "source": [
    "#### Alpha 0.0005"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "blond-arthritis",
   "metadata": {},
   "outputs": [],
   "source": [
    "!py run.py 0.0005"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "id": "regulation-creator",
   "metadata": {},
   "outputs": [],
   "source": [
    "!./geval -t dev-0"
   ]
  },
  {
   "cell_type": "markdown",
   "id": "blank-coordinate",
   "metadata": {},
   "source": [
    "| alpha | dev-0 score |\n",
    "|-------|-------------|\n",
    "| 0.0001 |  |\n",
    "| 0.0005 |  |\n",
    "| 0.001 | 597.71 |\n",
    "| 0.005 | 717.87 |\n",
    "| 0.01 | 774.42 |\n",
    "| 0.05 | 892.35 |\n",
    "| 0.1 |   |"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.9.2"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 5
}