"MLflow składa się z czterech niezależnych komponentów:\n",
" - **MLflow Tracking** - pozwala śledzić zmiany parametrów, kodu, środowiska i ich wpływ na metryki. Jest to funkcjonalność bardzo zbliżona do tej, którą zapewnia Sacred\n",
" - **MLflow Projects** - umożliwia \"pakowanie\" kodu ekserymentów w taki sposób, żeby mogłby być w łatwy sposób zreprodukowane przez innych\n",
" - **MLflow Models** - ułatwia \"pakowanie\" modeli uczenia maszynowego\n",
" - **MLflow Registry** - zapewnia centralne miejsce do przechowywania i współdzielenia modeli. Zapewnia narzędzia do wersjonowania i śledzenia pochodzenia tych modeli.\n",
" \n",
"Komponenty te mogą być używane razem bądź oddzielnie."
]
},
{
"cell_type": "markdown",
"metadata": {
"slideshow": {
"slide_type": "slide"
}
},
"source": [
"## MLflow Tracking - przykład\n",
"(poniższe przykłady kodu trenującego pochodzą z tutoriala MLflow: https://mlflow.org/docs/latest/tutorials-and-examples/tutorial.html)"
"INFO: 's123456' does not exist. Creating a new experiment\n",
"MLflow run experiment_id: 2\n",
"MLflow run artifact_uri: /tmp/mlruns/2/c15feb5df335490ba990ddd4dd977c1b/artifacts\n",
"Elasticnet model (alpha=0.500000, l1_ratio=0.500000):\n",
" RMSE: 0.7931640229276851\n",
" MAE: 0.6271946374319586\n",
" R2: 0.10862644997792614\n",
"Registered model 'ElasticnetWineModel' already exists. Creating a new version of this model...\n",
"2021/05/19 22:34:48 INFO mlflow.tracking._model_registry.client: Waiting up to 300 seconds for model version to finish creation. Model name: ElasticnetWineModel, version 2\n",
"Created version '2' of model 'ElasticnetWineModel'.\n"
"WARNING:urllib3.connectionpool:Retrying (Retry(total=4, connect=4, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f14d0c7e520>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=3, connect=3, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f14d0c7e340>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=2, connect=2, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f14d0c7ed00>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=1, connect=1, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f14d0c7ecd0>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=0, connect=0, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f14d0ce8640>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 174, in _new_conn\n",
" conn = connection.create_connection(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 95, in create_connection\n",
" raise err\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 85, in create_connection\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1040, in _send_output\n",
" self.send(msg)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 980, in send\n",
" self.connect()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 205, in connect\n",
" conn = self._new_conn()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 186, in _new_conn\n",
" raise NewConnectionError(\n",
"urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7f14d0ce8430>: Failed to establish a new connection: [Errno 111] Connection refused\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 440, in send\n",
" resp = conn.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" [Previous line repeated 2 more times]\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 785, in urlopen\n",
" retries = retries.increment(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/retry.py\", line 592, in increment\n",
" raise MaxRetryError(_pool, url, error or ResponseError(cause))\n",
"urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f14d0ce8430>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 174, in http_request\n",
" return _get_http_response_with_retries(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 105, in _get_http_response_with_retries\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 529, in request\n",
" resp = self.send(prep, **send_kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 645, in send\n",
" r = adapter.send(request, **kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 519, in send\n",
" raise ConnectionError(e, request=request)\n",
"requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f14d0ce8430>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/repos/aitech-ium/IUM_08/examples/sklearn_elasticnet_wine/train.py\", line 24, in <module>\n",
" mlflow.set_experiment(\"s123456\")\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/fluent.py\", line 113, in set_experiment\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 283, in call_endpoint\n",
" response = http_request(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 192, in http_request\n",
" raise MlflowException(f\"API request to {url} failed with exception {e}\")\n",
"mlflow.exceptions.MlflowException: API request to http://localhost:5000/api/2.0/mlflow/experiments/get-by-name failed with exception HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f14d0ce8430>: Failed to establish a new connection: [Errno 111] Connection refused'))\n"
]
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"WARNING:urllib3.connectionpool:Retrying (Retry(total=4, connect=4, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fb9a5088280>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=3, connect=3, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fb9a5088970>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=2, connect=2, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fb9a5088a00>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=1, connect=1, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fb9a5088d30>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=0, connect=0, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fb9a50ef3a0>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 174, in _new_conn\n",
" conn = connection.create_connection(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 95, in create_connection\n",
" raise err\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 85, in create_connection\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1040, in _send_output\n",
" self.send(msg)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 980, in send\n",
" self.connect()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 205, in connect\n",
" conn = self._new_conn()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 186, in _new_conn\n",
" raise NewConnectionError(\n",
"urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7fb9a50ef340>: Failed to establish a new connection: [Errno 111] Connection refused\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 440, in send\n",
" resp = conn.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" [Previous line repeated 2 more times]\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 785, in urlopen\n",
" retries = retries.increment(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/retry.py\", line 592, in increment\n",
" raise MaxRetryError(_pool, url, error or ResponseError(cause))\n",
"urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fb9a50ef340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 174, in http_request\n",
" return _get_http_response_with_retries(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 105, in _get_http_response_with_retries\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 529, in request\n",
" resp = self.send(prep, **send_kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 645, in send\n",
" r = adapter.send(request, **kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 519, in send\n",
" raise ConnectionError(e, request=request)\n",
"requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fb9a50ef340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/repos/aitech-ium/IUM_08/examples/sklearn_elasticnet_wine/train.py\", line 24, in <module>\n",
" mlflow.set_experiment(\"s123456\")\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/fluent.py\", line 113, in set_experiment\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 283, in call_endpoint\n",
" response = http_request(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 192, in http_request\n",
" raise MlflowException(f\"API request to {url} failed with exception {e}\")\n",
"mlflow.exceptions.MlflowException: API request to http://localhost:5000/api/2.0/mlflow/experiments/get-by-name failed with exception HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fb9a50ef340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n"
]
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"WARNING:urllib3.connectionpool:Retrying (Retry(total=4, connect=4, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f6b4a6b5280>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=3, connect=3, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f6b4a6b5970>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=2, connect=2, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f6b4a6b5a00>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=1, connect=1, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f6b4a6b5d30>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=0, connect=0, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f6b4a71c3a0>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 174, in _new_conn\n",
" conn = connection.create_connection(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 95, in create_connection\n",
" raise err\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 85, in create_connection\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1040, in _send_output\n",
" self.send(msg)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 980, in send\n",
" self.connect()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 205, in connect\n",
" conn = self._new_conn()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 186, in _new_conn\n",
" raise NewConnectionError(\n",
"urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7f6b4a71c340>: Failed to establish a new connection: [Errno 111] Connection refused\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 440, in send\n",
" resp = conn.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" [Previous line repeated 2 more times]\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 785, in urlopen\n",
" retries = retries.increment(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/retry.py\", line 592, in increment\n",
" raise MaxRetryError(_pool, url, error or ResponseError(cause))\n",
"urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f6b4a71c340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 174, in http_request\n",
" return _get_http_response_with_retries(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 105, in _get_http_response_with_retries\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 529, in request\n",
" resp = self.send(prep, **send_kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 645, in send\n",
" r = adapter.send(request, **kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 519, in send\n",
" raise ConnectionError(e, request=request)\n",
"requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f6b4a71c340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/repos/aitech-ium/IUM_08/examples/sklearn_elasticnet_wine/train.py\", line 24, in <module>\n",
" mlflow.set_experiment(\"s123456\")\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/fluent.py\", line 113, in set_experiment\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 283, in call_endpoint\n",
" response = http_request(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 192, in http_request\n",
" raise MlflowException(f\"API request to {url} failed with exception {e}\")\n",
"mlflow.exceptions.MlflowException: API request to http://localhost:5000/api/2.0/mlflow/experiments/get-by-name failed with exception HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f6b4a71c340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n"
]
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"WARNING:urllib3.connectionpool:Retrying (Retry(total=4, connect=4, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7feff2503280>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=3, connect=3, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7feff2503970>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=2, connect=2, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7feff2503a00>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=1, connect=1, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7feff2503d30>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=0, connect=0, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7feff256a3a0>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 174, in _new_conn\n",
" conn = connection.create_connection(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 95, in create_connection\n",
" raise err\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 85, in create_connection\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1040, in _send_output\n",
" self.send(msg)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 980, in send\n",
" self.connect()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 205, in connect\n",
" conn = self._new_conn()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 186, in _new_conn\n",
" raise NewConnectionError(\n",
"urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7feff256a340>: Failed to establish a new connection: [Errno 111] Connection refused\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 440, in send\n",
" resp = conn.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" [Previous line repeated 2 more times]\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 785, in urlopen\n",
" retries = retries.increment(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/retry.py\", line 592, in increment\n",
" raise MaxRetryError(_pool, url, error or ResponseError(cause))\n",
"urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7feff256a340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 174, in http_request\n",
" return _get_http_response_with_retries(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 105, in _get_http_response_with_retries\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 529, in request\n",
" resp = self.send(prep, **send_kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 645, in send\n",
" r = adapter.send(request, **kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 519, in send\n",
" raise ConnectionError(e, request=request)\n",
"requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7feff256a340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/repos/aitech-ium/IUM_08/examples/sklearn_elasticnet_wine/train.py\", line 24, in <module>\n",
" mlflow.set_experiment(\"s123456\")\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/fluent.py\", line 113, in set_experiment\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 283, in call_endpoint\n",
" response = http_request(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 192, in http_request\n",
" raise MlflowException(f\"API request to {url} failed with exception {e}\")\n",
"mlflow.exceptions.MlflowException: API request to http://localhost:5000/api/2.0/mlflow/experiments/get-by-name failed with exception HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7feff256a340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n"
]
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"WARNING:urllib3.connectionpool:Retrying (Retry(total=4, connect=4, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f6f6fec5280>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=3, connect=3, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f6f6fec5970>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=2, connect=2, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f6f6fec5a00>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=1, connect=1, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f6f6fec5d30>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=0, connect=0, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f6f6ff2c3a0>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 174, in _new_conn\n",
" conn = connection.create_connection(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 95, in create_connection\n",
" raise err\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 85, in create_connection\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1040, in _send_output\n",
" self.send(msg)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 980, in send\n",
" self.connect()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 205, in connect\n",
" conn = self._new_conn()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 186, in _new_conn\n",
" raise NewConnectionError(\n",
"urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7f6f6ff2c340>: Failed to establish a new connection: [Errno 111] Connection refused\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 440, in send\n",
" resp = conn.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" [Previous line repeated 2 more times]\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 785, in urlopen\n",
" retries = retries.increment(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/retry.py\", line 592, in increment\n",
" raise MaxRetryError(_pool, url, error or ResponseError(cause))\n",
"urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f6f6ff2c340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 174, in http_request\n",
" return _get_http_response_with_retries(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 105, in _get_http_response_with_retries\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 529, in request\n",
" resp = self.send(prep, **send_kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 645, in send\n",
" r = adapter.send(request, **kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 519, in send\n",
" raise ConnectionError(e, request=request)\n",
"requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f6f6ff2c340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/repos/aitech-ium/IUM_08/examples/sklearn_elasticnet_wine/train.py\", line 24, in <module>\n",
" mlflow.set_experiment(\"s123456\")\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/fluent.py\", line 113, in set_experiment\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 283, in call_endpoint\n",
" response = http_request(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 192, in http_request\n",
" raise MlflowException(f\"API request to {url} failed with exception {e}\")\n",
"mlflow.exceptions.MlflowException: API request to http://localhost:5000/api/2.0/mlflow/experiments/get-by-name failed with exception HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f6f6ff2c340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n"
]
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"WARNING:urllib3.connectionpool:Retrying (Retry(total=4, connect=4, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f870312a280>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=3, connect=3, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f870312a970>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=2, connect=2, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f870312aa00>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=1, connect=1, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f870312ad30>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=0, connect=0, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f87031913a0>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 174, in _new_conn\n",
" conn = connection.create_connection(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 95, in create_connection\n",
" raise err\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 85, in create_connection\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1040, in _send_output\n",
" self.send(msg)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 980, in send\n",
" self.connect()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 205, in connect\n",
" conn = self._new_conn()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 186, in _new_conn\n",
" raise NewConnectionError(\n",
"urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7f8703191340>: Failed to establish a new connection: [Errno 111] Connection refused\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 440, in send\n",
" resp = conn.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" [Previous line repeated 2 more times]\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 785, in urlopen\n",
" retries = retries.increment(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/retry.py\", line 592, in increment\n",
" raise MaxRetryError(_pool, url, error or ResponseError(cause))\n",
"urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f8703191340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 174, in http_request\n",
" return _get_http_response_with_retries(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 105, in _get_http_response_with_retries\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 529, in request\n",
" resp = self.send(prep, **send_kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 645, in send\n",
" r = adapter.send(request, **kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 519, in send\n",
" raise ConnectionError(e, request=request)\n",
"requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f8703191340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/repos/aitech-ium/IUM_08/examples/sklearn_elasticnet_wine/train.py\", line 24, in <module>\n",
" mlflow.set_experiment(\"s123456\")\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/fluent.py\", line 113, in set_experiment\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 283, in call_endpoint\n",
" response = http_request(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 192, in http_request\n",
" raise MlflowException(f\"API request to {url} failed with exception {e}\")\n",
"mlflow.exceptions.MlflowException: API request to http://localhost:5000/api/2.0/mlflow/experiments/get-by-name failed with exception HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f8703191340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n"
]
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"WARNING:urllib3.connectionpool:Retrying (Retry(total=4, connect=4, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f48842ea280>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=3, connect=3, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f48842ea970>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=2, connect=2, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f48842eaa00>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=1, connect=1, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f48842ead30>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=0, connect=0, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f48843513a0>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 174, in _new_conn\n",
" conn = connection.create_connection(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 95, in create_connection\n",
" raise err\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 85, in create_connection\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1040, in _send_output\n",
" self.send(msg)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 980, in send\n",
" self.connect()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 205, in connect\n",
" conn = self._new_conn()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 186, in _new_conn\n",
" raise NewConnectionError(\n",
"urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7f4884351340>: Failed to establish a new connection: [Errno 111] Connection refused\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 440, in send\n",
" resp = conn.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" [Previous line repeated 2 more times]\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 785, in urlopen\n",
" retries = retries.increment(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/retry.py\", line 592, in increment\n",
" raise MaxRetryError(_pool, url, error or ResponseError(cause))\n",
"urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f4884351340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 174, in http_request\n",
" return _get_http_response_with_retries(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 105, in _get_http_response_with_retries\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 529, in request\n",
" resp = self.send(prep, **send_kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 645, in send\n",
" r = adapter.send(request, **kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 519, in send\n",
" raise ConnectionError(e, request=request)\n",
"requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f4884351340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/repos/aitech-ium/IUM_08/examples/sklearn_elasticnet_wine/train.py\", line 24, in <module>\n",
" mlflow.set_experiment(\"s123456\")\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/fluent.py\", line 113, in set_experiment\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 283, in call_endpoint\n",
" response = http_request(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 192, in http_request\n",
" raise MlflowException(f\"API request to {url} failed with exception {e}\")\n",
"mlflow.exceptions.MlflowException: API request to http://localhost:5000/api/2.0/mlflow/experiments/get-by-name failed with exception HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f4884351340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n"
]
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"WARNING:urllib3.connectionpool:Retrying (Retry(total=4, connect=4, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fbabcb03280>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=3, connect=3, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fbabcb03970>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=2, connect=2, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fbabcb03a00>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=1, connect=1, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fbabcb03d30>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=0, connect=0, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fbabcb6a3a0>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 174, in _new_conn\n",
" conn = connection.create_connection(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 95, in create_connection\n",
" raise err\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 85, in create_connection\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1040, in _send_output\n",
" self.send(msg)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 980, in send\n",
" self.connect()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 205, in connect\n",
" conn = self._new_conn()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 186, in _new_conn\n",
" raise NewConnectionError(\n",
"urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7fbabcb6a340>: Failed to establish a new connection: [Errno 111] Connection refused\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 440, in send\n",
" resp = conn.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" [Previous line repeated 2 more times]\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 785, in urlopen\n",
" retries = retries.increment(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/retry.py\", line 592, in increment\n",
" raise MaxRetryError(_pool, url, error or ResponseError(cause))\n",
"urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fbabcb6a340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 174, in http_request\n",
" return _get_http_response_with_retries(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 105, in _get_http_response_with_retries\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 529, in request\n",
" resp = self.send(prep, **send_kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 645, in send\n",
" r = adapter.send(request, **kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 519, in send\n",
" raise ConnectionError(e, request=request)\n",
"requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fbabcb6a340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/repos/aitech-ium/IUM_08/examples/sklearn_elasticnet_wine/train.py\", line 24, in <module>\n",
" mlflow.set_experiment(\"s123456\")\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/fluent.py\", line 113, in set_experiment\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 283, in call_endpoint\n",
" response = http_request(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 192, in http_request\n",
" raise MlflowException(f\"API request to {url} failed with exception {e}\")\n",
"mlflow.exceptions.MlflowException: API request to http://localhost:5000/api/2.0/mlflow/experiments/get-by-name failed with exception HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fbabcb6a340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n"
]
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"WARNING:urllib3.connectionpool:Retrying (Retry(total=4, connect=4, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fa41326d280>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=3, connect=3, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fa41326d970>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=2, connect=2, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fa41326da00>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=1, connect=1, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fa41326dd30>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=0, connect=0, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fa4132d43a0>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 174, in _new_conn\n",
" conn = connection.create_connection(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 95, in create_connection\n",
" raise err\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 85, in create_connection\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1040, in _send_output\n",
" self.send(msg)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 980, in send\n",
" self.connect()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 205, in connect\n",
" conn = self._new_conn()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 186, in _new_conn\n",
" raise NewConnectionError(\n",
"urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7fa4132d4340>: Failed to establish a new connection: [Errno 111] Connection refused\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 440, in send\n",
" resp = conn.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" [Previous line repeated 2 more times]\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 785, in urlopen\n",
" retries = retries.increment(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/retry.py\", line 592, in increment\n",
" raise MaxRetryError(_pool, url, error or ResponseError(cause))\n",
"urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fa4132d4340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 174, in http_request\n",
" return _get_http_response_with_retries(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 105, in _get_http_response_with_retries\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 529, in request\n",
" resp = self.send(prep, **send_kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 645, in send\n",
" r = adapter.send(request, **kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 519, in send\n",
" raise ConnectionError(e, request=request)\n",
"requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fa4132d4340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/repos/aitech-ium/IUM_08/examples/sklearn_elasticnet_wine/train.py\", line 24, in <module>\n",
" mlflow.set_experiment(\"s123456\")\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/fluent.py\", line 113, in set_experiment\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 283, in call_endpoint\n",
" response = http_request(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 192, in http_request\n",
" raise MlflowException(f\"API request to {url} failed with exception {e}\")\n",
"mlflow.exceptions.MlflowException: API request to http://localhost:5000/api/2.0/mlflow/experiments/get-by-name failed with exception HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fa4132d4340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n"
]
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"WARNING:urllib3.connectionpool:Retrying (Retry(total=4, connect=4, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f3d52df5280>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=3, connect=3, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f3d52df5970>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=2, connect=2, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f3d52df5a00>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=1, connect=1, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f3d52df5d30>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=0, connect=0, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f3d52e5c3a0>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 174, in _new_conn\n",
" conn = connection.create_connection(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 95, in create_connection\n",
" raise err\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 85, in create_connection\n",