aitech-ium/IUM_08.MLFlow.ipynb

9081 lines
804 KiB
Plaintext
Raw Normal View History

2021-05-10 12:53:57 +02:00
{
"cells": [
{
"cell_type": "markdown",
"metadata": {
"slideshow": {
"slide_type": "slide"
}
},
"source": [
2023-04-20 11:28:19 +02:00
"## ![Logo 1](https://git.wmi.amu.edu.pl/AITech/Szablon/raw/branch/master/Logotyp_AITech1.jpg)\n",
2021-09-28 10:56:21 +02:00
"<div class=\"alert alert-block alert-info\">\n",
"<h1> Inżynieria uczenia maszynowego </h1>\n",
"<h2> 8. <i>MLFlow</i> [laboratoria]</h2> \n",
2023-04-20 12:13:19 +02:00
"<h3> Tomasz Ziętkiewicz (2023)</h3>\n",
2021-09-28 10:56:21 +02:00
"</div>\n",
"\n",
"![Logo 2](https://git.wmi.amu.edu.pl/AITech/Szablon/raw/branch/master/Logotyp_AITech2.jpg)"
2021-05-10 12:53:57 +02:00
]
},
{
"cell_type": "markdown",
"metadata": {
"slideshow": {
"slide_type": "slide"
}
},
"source": [
" ## MLflow\n",
2021-09-28 10:56:21 +02:00
" </br><img style=\"width: 50%;\" src=\"img/expcontrol/mlflow-logo-d.png\"/>\n",
"\n",
2021-05-10 12:53:57 +02:00
" - https://mlflow.org/\n",
" - Narzędzie podobne do omawianego na poprzednich zajęciach Sacred\n",
" - Nieco inne podejście: mniej ingerencji w istniejący kod\n",
" - Bardziej kompleksowe rozwiązanie: 4 komponenty, pierwszy z nich ma funkcjonalność podobną do Sacred\n",
" - Działa \"z każdym\" językiem. A tak naprawdę: Python, R, Java + CLI API + REST API\n",
" - Popularna wśród pracodawców - wyniki wyszukiwania ofert pracy: 20 ofert (https://pl.indeed.com/), 36 ofert (linkedin). Sacred: 0\n",
2022-05-09 09:54:34 +02:00
" - Integracja z licznymi bibliotekami / chmurami\n",
" - Rozwiązanie OpenSource, stworzone przez firmę Databricks\n",
" - Dostępna [odpłatna wersja \"Managed\"](https://databricks.com/product/managed-mlflow) (w ordóżnieniu od \"self-hosted\")\n"
2021-05-10 12:53:57 +02:00
]
},
{
"cell_type": "markdown",
"metadata": {
"slideshow": {
"slide_type": "slide"
}
},
"source": [
"## Komponenty\n",
"\n",
"MLflow składa się z czterech niezależnych komponentów:\n",
" - **MLflow Tracking** - pozwala śledzić zmiany parametrów, kodu, środowiska i ich wpływ na metryki. Jest to funkcjonalność bardzo zbliżona do tej, którą zapewnia Sacred\n",
" - **MLflow Projects** - umożliwia \"pakowanie\" kodu ekserymentów w taki sposób, żeby mogłby być w łatwy sposób zreprodukowane przez innych\n",
" - **MLflow Models** - ułatwia \"pakowanie\" modeli uczenia maszynowego\n",
" - **MLflow Registry** - zapewnia centralne miejsce do przechowywania i współdzielenia modeli. Zapewnia narzędzia do wersjonowania i śledzenia pochodzenia tych modeli.\n",
" \n",
"Komponenty te mogą być używane razem bądź oddzielnie."
]
},
{
"cell_type": "markdown",
"metadata": {
"slideshow": {
"slide_type": "slide"
}
},
"source": [
"## MLflow Tracking - przykład\n",
"(poniższe przykłady kodu trenującego pochodzą z tutoriala MLflow: https://mlflow.org/docs/latest/tutorials-and-examples/tutorial.html)"
]
},
{
"cell_type": "code",
2023-04-20 11:28:19 +02:00
"execution_count": 2,
2021-05-10 12:53:57 +02:00
"metadata": {
"slideshow": {
"slide_type": "slide"
}
},
"outputs": [],
"source": [
"%%capture null\n",
"!pip install mlflow\n",
"!pip install sklearn"
]
},
{
"cell_type": "code",
2023-04-20 11:28:19 +02:00
"execution_count": 2,
"metadata": {},
"outputs": [],
"source": [
"!mkdir -p IUM_08/examples/sklearn_elasticnet_wine/"
]
},
{
"cell_type": "code",
"execution_count": 4,
2021-05-10 12:53:57 +02:00
"metadata": {
"slideshow": {
"slide_type": "slide"
}
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"Overwriting IUM_08/examples/sklearn_elasticnet_wine/train.py\n"
]
}
],
"source": [
"%%writefile IUM_08/examples/sklearn_elasticnet_wine/train.py\n",
"# The data set used in this example is from http://archive.ics.uci.edu/ml/datasets/Wine+Quality\n",
"# P. Cortez, A. Cerdeira, F. Almeida, T. Matos and J. Reis.\n",
"# Modeling wine preferences by data mining from physicochemical properties. In Decision Support Systems, Elsevier, 47(4):547-553, 2009.\n",
"\n",
"import os\n",
"import warnings\n",
"import sys\n",
"\n",
"import pandas as pd\n",
"import numpy as np\n",
"from sklearn.metrics import mean_squared_error, mean_absolute_error, r2_score\n",
"from sklearn.model_selection import train_test_split\n",
"from sklearn.linear_model import ElasticNet\n",
"from urllib.parse import urlparse\n",
"import mlflow\n",
"import mlflow.sklearn\n",
"\n",
"import logging\n",
"\n",
"logging.basicConfig(level=logging.WARN)\n",
"logger = logging.getLogger(__name__)\n",
"\n",
"mlflow.set_tracking_uri(\"http://localhost:5000\")\n",
"mlflow.set_experiment(\"s123456\")\n",
2021-05-10 12:53:57 +02:00
"\n",
"def eval_metrics(actual, pred):\n",
" rmse = np.sqrt(mean_squared_error(actual, pred))\n",
" mae = mean_absolute_error(actual, pred)\n",
" r2 = r2_score(actual, pred)\n",
" return rmse, mae, r2\n",
"\n",
"\n",
"if __name__ == \"__main__\":\n",
" warnings.filterwarnings(\"ignore\")\n",
" np.random.seed(40)\n",
"\n",
" # Read the wine-quality csv file from the URL\n",
" csv_url = (\n",
" \"http://archive.ics.uci.edu/ml/machine-learning-databases/wine-quality/winequality-red.csv\"\n",
" )\n",
" try:\n",
" data = pd.read_csv(csv_url, sep=\";\")\n",
" except Exception as e:\n",
" logger.exception(\n",
" \"Unable to download training & test CSV, check your internet connection. Error: %s\", e\n",
" )\n",
"\n",
" # Split the data into training and test sets. (0.75, 0.25) split.\n",
" train, test = train_test_split(data)\n",
"\n",
" # The predicted column is \"quality\" which is a scalar from [3, 9]\n",
" train_x = train.drop([\"quality\"], axis=1)\n",
" test_x = test.drop([\"quality\"], axis=1)\n",
" train_y = train[[\"quality\"]]\n",
" test_y = test[[\"quality\"]]\n",
"\n",
" \n",
" alpha = float(sys.argv[1]) if len(sys.argv) > 1 else 0.5\n",
" #alpha = 0.5\n",
" l1_ratio = float(sys.argv[2]) if len(sys.argv) > 2 else 0.5\n",
" #l1_ratio = 0.5\n",
"\n",
" with mlflow.start_run() as run:\n",
" print(\"MLflow run experiment_id: {0}\".format(run.info.experiment_id))\n",
" print(\"MLflow run artifact_uri: {0}\".format(run.info.artifact_uri))\n",
"\n",
2021-05-10 12:53:57 +02:00
" lr = ElasticNet(alpha=alpha, l1_ratio=l1_ratio, random_state=42)\n",
" lr.fit(train_x, train_y)\n",
"\n",
" predicted_qualities = lr.predict(test_x)\n",
"\n",
" (rmse, mae, r2) = eval_metrics(test_y, predicted_qualities)\n",
"\n",
" print(\"Elasticnet model (alpha=%f, l1_ratio=%f):\" % (alpha, l1_ratio))\n",
" print(\" RMSE: %s\" % rmse)\n",
" print(\" MAE: %s\" % mae)\n",
" print(\" R2: %s\" % r2)\n",
"\n",
" mlflow.log_param(\"alpha\", alpha)\n",
" mlflow.log_param(\"l1_ratio\", l1_ratio)\n",
" mlflow.log_metric(\"rmse\", rmse)\n",
" mlflow.log_metric(\"r2\", r2)\n",
" mlflow.log_metric(\"mae\", mae)\n",
2021-05-17 12:52:53 +02:00
" \n",
" # Infer model signature to log it\n",
2023-04-20 11:28:19 +02:00
" # Więcej o sygnaturach: https://mlflow.org/docs/latest/models.html?highlight=signature#model-signature\n",
2021-05-17 12:52:53 +02:00
" signature = mlflow.models.signature.infer_signature(train_x, lr.predict(train_x))\n",
2021-05-10 12:53:57 +02:00
"\n",
" tracking_url_type_store = urlparse(mlflow.get_tracking_uri()).scheme\n",
"\n",
" # Model registry does not work with file store\n",
" if tracking_url_type_store != \"file\":\n",
"\n",
" # Register the model\n",
" # There are other ways to use the Model Registry, which depends on the use case,\n",
" # please refer to the doc for more information:\n",
" # https://mlflow.org/docs/latest/model-registry.html#api-workflow\n",
" mlflow.sklearn.log_model(lr, \"wines-model\", registered_model_name=\"ElasticnetWineModel\", signature=signature)\n",
2021-05-10 12:53:57 +02:00
" else:\n",
2021-05-17 12:52:53 +02:00
" mlflow.sklearn.log_model(lr, \"model\", signature=signature)"
2021-05-10 12:53:57 +02:00
]
},
{
"cell_type": "code",
"execution_count": 81,
2021-05-10 12:53:57 +02:00
"metadata": {
"slideshow": {
"slide_type": "slide"
}
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"total 4\n",
"drwxrwxr-x 3 tomek tomek 4096 maj 19 21:31 1\n",
"INFO: 's123456' does not exist. Creating a new experiment\n",
"MLflow run experiment_id: 2\n",
"MLflow run artifact_uri: /tmp/mlruns/2/c15feb5df335490ba990ddd4dd977c1b/artifacts\n",
"Elasticnet model (alpha=0.500000, l1_ratio=0.500000):\n",
" RMSE: 0.7931640229276851\n",
" MAE: 0.6271946374319586\n",
" R2: 0.10862644997792614\n",
"Registered model 'ElasticnetWineModel' already exists. Creating a new version of this model...\n",
"2021/05/19 22:34:48 INFO mlflow.tracking._model_registry.client: Waiting up to 300 seconds for model version to finish creation. Model name: ElasticnetWineModel, version 2\n",
"Created version '2' of model 'ElasticnetWineModel'.\n"
2021-05-10 12:53:57 +02:00
]
}
],
"source": [
"! ls -l /tmp/mlruns\n",
2021-05-10 12:53:57 +02:00
"### Wtyrenujmy model z domyślnymi wartościami parametrów\n",
"! cd ./IUM_08/examples/; python sklearn_elasticnet_wine/train.py"
]
},
{
"cell_type": "code",
2023-05-17 22:30:48 +02:00
"execution_count": 1,
2021-05-10 12:53:57 +02:00
"metadata": {
"slideshow": {
"slide_type": "slide"
}
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
2023-05-17 22:30:48 +02:00
"WARNING:urllib3.connectionpool:Retrying (Retry(total=4, connect=4, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f14d0c7e520>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=3, connect=3, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f14d0c7e340>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=2, connect=2, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f14d0c7ed00>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=1, connect=1, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f14d0c7ecd0>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=0, connect=0, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f14d0ce8640>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 174, in _new_conn\n",
" conn = connection.create_connection(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 95, in create_connection\n",
" raise err\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 85, in create_connection\n",
" sock.connect(sa)\n",
"ConnectionRefusedError: [Errno 111] Connection refused\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 703, in urlopen\n",
" httplib_response = self._make_request(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 398, in _make_request\n",
" conn.request(method, url, **httplib_request_kw)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 239, in request\n",
" super(HTTPConnection, self).request(method, url, body=body, headers=headers)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1285, in request\n",
" self._send_request(method, url, body, headers, encode_chunked)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1331, in _send_request\n",
" self.endheaders(body, encode_chunked=encode_chunked)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1280, in endheaders\n",
" self._send_output(message_body, encode_chunked=encode_chunked)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1040, in _send_output\n",
" self.send(msg)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 980, in send\n",
" self.connect()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 205, in connect\n",
" conn = self._new_conn()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 186, in _new_conn\n",
" raise NewConnectionError(\n",
"urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7f14d0ce8430>: Failed to establish a new connection: [Errno 111] Connection refused\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 440, in send\n",
" resp = conn.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" [Previous line repeated 2 more times]\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 785, in urlopen\n",
" retries = retries.increment(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/retry.py\", line 592, in increment\n",
" raise MaxRetryError(_pool, url, error or ResponseError(cause))\n",
"urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f14d0ce8430>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 174, in http_request\n",
" return _get_http_response_with_retries(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 105, in _get_http_response_with_retries\n",
" return session.request(method, url, **kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 529, in request\n",
" resp = self.send(prep, **send_kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 645, in send\n",
" r = adapter.send(request, **kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 519, in send\n",
" raise ConnectionError(e, request=request)\n",
"requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f14d0ce8430>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/repos/aitech-ium/IUM_08/examples/sklearn_elasticnet_wine/train.py\", line 24, in <module>\n",
" mlflow.set_experiment(\"s123456\")\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/fluent.py\", line 113, in set_experiment\n",
" experiment = client.get_experiment_by_name(experiment_name)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/client.py\", line 461, in get_experiment_by_name\n",
" return self._tracking_client.get_experiment_by_name(name)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/_tracking_service/client.py\", line 220, in get_experiment_by_name\n",
" return self.store.get_experiment_by_name(name)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/store/tracking/rest_store.py\", line 304, in get_experiment_by_name\n",
" response_proto = self._call_endpoint(GetExperimentByName, req_body)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/store/tracking/rest_store.py\", line 56, in _call_endpoint\n",
" return call_endpoint(self.get_host_creds(), endpoint, method, json_body, response_proto)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 283, in call_endpoint\n",
" response = http_request(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 192, in http_request\n",
" raise MlflowException(f\"API request to {url} failed with exception {e}\")\n",
"mlflow.exceptions.MlflowException: API request to http://localhost:5000/api/2.0/mlflow/experiments/get-by-name failed with exception HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f14d0ce8430>: Failed to establish a new connection: [Errno 111] Connection refused'))\n"
]
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"WARNING:urllib3.connectionpool:Retrying (Retry(total=4, connect=4, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fb9a5088280>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=3, connect=3, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fb9a5088970>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=2, connect=2, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fb9a5088a00>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=1, connect=1, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fb9a5088d30>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=0, connect=0, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fb9a50ef3a0>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 174, in _new_conn\n",
" conn = connection.create_connection(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 95, in create_connection\n",
" raise err\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 85, in create_connection\n",
" sock.connect(sa)\n",
"ConnectionRefusedError: [Errno 111] Connection refused\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 703, in urlopen\n",
" httplib_response = self._make_request(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 398, in _make_request\n",
" conn.request(method, url, **httplib_request_kw)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 239, in request\n",
" super(HTTPConnection, self).request(method, url, body=body, headers=headers)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1285, in request\n",
" self._send_request(method, url, body, headers, encode_chunked)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1331, in _send_request\n",
" self.endheaders(body, encode_chunked=encode_chunked)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1280, in endheaders\n",
" self._send_output(message_body, encode_chunked=encode_chunked)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1040, in _send_output\n",
" self.send(msg)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 980, in send\n",
" self.connect()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 205, in connect\n",
" conn = self._new_conn()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 186, in _new_conn\n",
" raise NewConnectionError(\n",
"urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7fb9a50ef340>: Failed to establish a new connection: [Errno 111] Connection refused\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 440, in send\n",
" resp = conn.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" [Previous line repeated 2 more times]\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 785, in urlopen\n",
" retries = retries.increment(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/retry.py\", line 592, in increment\n",
" raise MaxRetryError(_pool, url, error or ResponseError(cause))\n",
"urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fb9a50ef340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 174, in http_request\n",
" return _get_http_response_with_retries(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 105, in _get_http_response_with_retries\n",
" return session.request(method, url, **kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 529, in request\n",
" resp = self.send(prep, **send_kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 645, in send\n",
" r = adapter.send(request, **kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 519, in send\n",
" raise ConnectionError(e, request=request)\n",
"requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fb9a50ef340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/repos/aitech-ium/IUM_08/examples/sklearn_elasticnet_wine/train.py\", line 24, in <module>\n",
" mlflow.set_experiment(\"s123456\")\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/fluent.py\", line 113, in set_experiment\n",
" experiment = client.get_experiment_by_name(experiment_name)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/client.py\", line 461, in get_experiment_by_name\n",
" return self._tracking_client.get_experiment_by_name(name)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/_tracking_service/client.py\", line 220, in get_experiment_by_name\n",
" return self.store.get_experiment_by_name(name)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/store/tracking/rest_store.py\", line 304, in get_experiment_by_name\n",
" response_proto = self._call_endpoint(GetExperimentByName, req_body)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/store/tracking/rest_store.py\", line 56, in _call_endpoint\n",
" return call_endpoint(self.get_host_creds(), endpoint, method, json_body, response_proto)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 283, in call_endpoint\n",
" response = http_request(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 192, in http_request\n",
" raise MlflowException(f\"API request to {url} failed with exception {e}\")\n",
"mlflow.exceptions.MlflowException: API request to http://localhost:5000/api/2.0/mlflow/experiments/get-by-name failed with exception HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fb9a50ef340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n"
]
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"WARNING:urllib3.connectionpool:Retrying (Retry(total=4, connect=4, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f6b4a6b5280>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=3, connect=3, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f6b4a6b5970>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=2, connect=2, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f6b4a6b5a00>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=1, connect=1, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f6b4a6b5d30>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=0, connect=0, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f6b4a71c3a0>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 174, in _new_conn\n",
" conn = connection.create_connection(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 95, in create_connection\n",
" raise err\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 85, in create_connection\n",
" sock.connect(sa)\n",
"ConnectionRefusedError: [Errno 111] Connection refused\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 703, in urlopen\n",
" httplib_response = self._make_request(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 398, in _make_request\n",
" conn.request(method, url, **httplib_request_kw)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 239, in request\n",
" super(HTTPConnection, self).request(method, url, body=body, headers=headers)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1285, in request\n",
" self._send_request(method, url, body, headers, encode_chunked)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1331, in _send_request\n",
" self.endheaders(body, encode_chunked=encode_chunked)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1280, in endheaders\n",
" self._send_output(message_body, encode_chunked=encode_chunked)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1040, in _send_output\n",
" self.send(msg)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 980, in send\n",
" self.connect()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 205, in connect\n",
" conn = self._new_conn()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 186, in _new_conn\n",
" raise NewConnectionError(\n",
"urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7f6b4a71c340>: Failed to establish a new connection: [Errno 111] Connection refused\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 440, in send\n",
" resp = conn.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" [Previous line repeated 2 more times]\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 785, in urlopen\n",
" retries = retries.increment(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/retry.py\", line 592, in increment\n",
" raise MaxRetryError(_pool, url, error or ResponseError(cause))\n",
"urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f6b4a71c340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 174, in http_request\n",
" return _get_http_response_with_retries(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 105, in _get_http_response_with_retries\n",
" return session.request(method, url, **kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 529, in request\n",
" resp = self.send(prep, **send_kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 645, in send\n",
" r = adapter.send(request, **kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 519, in send\n",
" raise ConnectionError(e, request=request)\n",
"requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f6b4a71c340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/repos/aitech-ium/IUM_08/examples/sklearn_elasticnet_wine/train.py\", line 24, in <module>\n",
" mlflow.set_experiment(\"s123456\")\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/fluent.py\", line 113, in set_experiment\n",
" experiment = client.get_experiment_by_name(experiment_name)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/client.py\", line 461, in get_experiment_by_name\n",
" return self._tracking_client.get_experiment_by_name(name)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/_tracking_service/client.py\", line 220, in get_experiment_by_name\n",
" return self.store.get_experiment_by_name(name)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/store/tracking/rest_store.py\", line 304, in get_experiment_by_name\n",
" response_proto = self._call_endpoint(GetExperimentByName, req_body)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/store/tracking/rest_store.py\", line 56, in _call_endpoint\n",
" return call_endpoint(self.get_host_creds(), endpoint, method, json_body, response_proto)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 283, in call_endpoint\n",
" response = http_request(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 192, in http_request\n",
" raise MlflowException(f\"API request to {url} failed with exception {e}\")\n",
"mlflow.exceptions.MlflowException: API request to http://localhost:5000/api/2.0/mlflow/experiments/get-by-name failed with exception HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f6b4a71c340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n"
]
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"WARNING:urllib3.connectionpool:Retrying (Retry(total=4, connect=4, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7feff2503280>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=3, connect=3, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7feff2503970>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=2, connect=2, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7feff2503a00>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=1, connect=1, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7feff2503d30>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=0, connect=0, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7feff256a3a0>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 174, in _new_conn\n",
" conn = connection.create_connection(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 95, in create_connection\n",
" raise err\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 85, in create_connection\n",
" sock.connect(sa)\n",
"ConnectionRefusedError: [Errno 111] Connection refused\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 703, in urlopen\n",
" httplib_response = self._make_request(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 398, in _make_request\n",
" conn.request(method, url, **httplib_request_kw)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 239, in request\n",
" super(HTTPConnection, self).request(method, url, body=body, headers=headers)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1285, in request\n",
" self._send_request(method, url, body, headers, encode_chunked)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1331, in _send_request\n",
" self.endheaders(body, encode_chunked=encode_chunked)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1280, in endheaders\n",
" self._send_output(message_body, encode_chunked=encode_chunked)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1040, in _send_output\n",
" self.send(msg)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 980, in send\n",
" self.connect()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 205, in connect\n",
" conn = self._new_conn()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 186, in _new_conn\n",
" raise NewConnectionError(\n",
"urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7feff256a340>: Failed to establish a new connection: [Errno 111] Connection refused\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 440, in send\n",
" resp = conn.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" [Previous line repeated 2 more times]\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 785, in urlopen\n",
" retries = retries.increment(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/retry.py\", line 592, in increment\n",
" raise MaxRetryError(_pool, url, error or ResponseError(cause))\n",
"urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7feff256a340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 174, in http_request\n",
" return _get_http_response_with_retries(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 105, in _get_http_response_with_retries\n",
" return session.request(method, url, **kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 529, in request\n",
" resp = self.send(prep, **send_kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 645, in send\n",
" r = adapter.send(request, **kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 519, in send\n",
" raise ConnectionError(e, request=request)\n",
"requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7feff256a340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/repos/aitech-ium/IUM_08/examples/sklearn_elasticnet_wine/train.py\", line 24, in <module>\n",
" mlflow.set_experiment(\"s123456\")\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/fluent.py\", line 113, in set_experiment\n",
" experiment = client.get_experiment_by_name(experiment_name)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/client.py\", line 461, in get_experiment_by_name\n",
" return self._tracking_client.get_experiment_by_name(name)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/_tracking_service/client.py\", line 220, in get_experiment_by_name\n",
" return self.store.get_experiment_by_name(name)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/store/tracking/rest_store.py\", line 304, in get_experiment_by_name\n",
" response_proto = self._call_endpoint(GetExperimentByName, req_body)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/store/tracking/rest_store.py\", line 56, in _call_endpoint\n",
" return call_endpoint(self.get_host_creds(), endpoint, method, json_body, response_proto)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 283, in call_endpoint\n",
" response = http_request(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 192, in http_request\n",
" raise MlflowException(f\"API request to {url} failed with exception {e}\")\n",
"mlflow.exceptions.MlflowException: API request to http://localhost:5000/api/2.0/mlflow/experiments/get-by-name failed with exception HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7feff256a340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n"
]
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"WARNING:urllib3.connectionpool:Retrying (Retry(total=4, connect=4, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f6f6fec5280>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=3, connect=3, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f6f6fec5970>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=2, connect=2, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f6f6fec5a00>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=1, connect=1, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f6f6fec5d30>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=0, connect=0, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f6f6ff2c3a0>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 174, in _new_conn\n",
" conn = connection.create_connection(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 95, in create_connection\n",
" raise err\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 85, in create_connection\n",
" sock.connect(sa)\n",
"ConnectionRefusedError: [Errno 111] Connection refused\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 703, in urlopen\n",
" httplib_response = self._make_request(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 398, in _make_request\n",
" conn.request(method, url, **httplib_request_kw)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 239, in request\n",
" super(HTTPConnection, self).request(method, url, body=body, headers=headers)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1285, in request\n",
" self._send_request(method, url, body, headers, encode_chunked)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1331, in _send_request\n",
" self.endheaders(body, encode_chunked=encode_chunked)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1280, in endheaders\n",
" self._send_output(message_body, encode_chunked=encode_chunked)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1040, in _send_output\n",
" self.send(msg)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 980, in send\n",
" self.connect()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 205, in connect\n",
" conn = self._new_conn()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 186, in _new_conn\n",
" raise NewConnectionError(\n",
"urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7f6f6ff2c340>: Failed to establish a new connection: [Errno 111] Connection refused\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 440, in send\n",
" resp = conn.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" [Previous line repeated 2 more times]\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 785, in urlopen\n",
" retries = retries.increment(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/retry.py\", line 592, in increment\n",
" raise MaxRetryError(_pool, url, error or ResponseError(cause))\n",
"urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f6f6ff2c340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 174, in http_request\n",
" return _get_http_response_with_retries(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 105, in _get_http_response_with_retries\n",
" return session.request(method, url, **kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 529, in request\n",
" resp = self.send(prep, **send_kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 645, in send\n",
" r = adapter.send(request, **kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 519, in send\n",
" raise ConnectionError(e, request=request)\n",
"requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f6f6ff2c340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/repos/aitech-ium/IUM_08/examples/sklearn_elasticnet_wine/train.py\", line 24, in <module>\n",
" mlflow.set_experiment(\"s123456\")\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/fluent.py\", line 113, in set_experiment\n",
" experiment = client.get_experiment_by_name(experiment_name)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/client.py\", line 461, in get_experiment_by_name\n",
" return self._tracking_client.get_experiment_by_name(name)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/_tracking_service/client.py\", line 220, in get_experiment_by_name\n",
" return self.store.get_experiment_by_name(name)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/store/tracking/rest_store.py\", line 304, in get_experiment_by_name\n",
" response_proto = self._call_endpoint(GetExperimentByName, req_body)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/store/tracking/rest_store.py\", line 56, in _call_endpoint\n",
" return call_endpoint(self.get_host_creds(), endpoint, method, json_body, response_proto)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 283, in call_endpoint\n",
" response = http_request(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 192, in http_request\n",
" raise MlflowException(f\"API request to {url} failed with exception {e}\")\n",
"mlflow.exceptions.MlflowException: API request to http://localhost:5000/api/2.0/mlflow/experiments/get-by-name failed with exception HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f6f6ff2c340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n"
]
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"WARNING:urllib3.connectionpool:Retrying (Retry(total=4, connect=4, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f870312a280>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=3, connect=3, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f870312a970>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=2, connect=2, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f870312aa00>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=1, connect=1, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f870312ad30>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=0, connect=0, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f87031913a0>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 174, in _new_conn\n",
" conn = connection.create_connection(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 95, in create_connection\n",
" raise err\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 85, in create_connection\n",
" sock.connect(sa)\n",
"ConnectionRefusedError: [Errno 111] Connection refused\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 703, in urlopen\n",
" httplib_response = self._make_request(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 398, in _make_request\n",
" conn.request(method, url, **httplib_request_kw)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 239, in request\n",
" super(HTTPConnection, self).request(method, url, body=body, headers=headers)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1285, in request\n",
" self._send_request(method, url, body, headers, encode_chunked)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1331, in _send_request\n",
" self.endheaders(body, encode_chunked=encode_chunked)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1280, in endheaders\n",
" self._send_output(message_body, encode_chunked=encode_chunked)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1040, in _send_output\n",
" self.send(msg)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 980, in send\n",
" self.connect()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 205, in connect\n",
" conn = self._new_conn()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 186, in _new_conn\n",
" raise NewConnectionError(\n",
"urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7f8703191340>: Failed to establish a new connection: [Errno 111] Connection refused\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 440, in send\n",
" resp = conn.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" [Previous line repeated 2 more times]\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 785, in urlopen\n",
" retries = retries.increment(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/retry.py\", line 592, in increment\n",
" raise MaxRetryError(_pool, url, error or ResponseError(cause))\n",
"urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f8703191340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 174, in http_request\n",
" return _get_http_response_with_retries(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 105, in _get_http_response_with_retries\n",
" return session.request(method, url, **kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 529, in request\n",
" resp = self.send(prep, **send_kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 645, in send\n",
" r = adapter.send(request, **kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 519, in send\n",
" raise ConnectionError(e, request=request)\n",
"requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f8703191340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/repos/aitech-ium/IUM_08/examples/sklearn_elasticnet_wine/train.py\", line 24, in <module>\n",
" mlflow.set_experiment(\"s123456\")\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/fluent.py\", line 113, in set_experiment\n",
" experiment = client.get_experiment_by_name(experiment_name)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/client.py\", line 461, in get_experiment_by_name\n",
" return self._tracking_client.get_experiment_by_name(name)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/_tracking_service/client.py\", line 220, in get_experiment_by_name\n",
" return self.store.get_experiment_by_name(name)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/store/tracking/rest_store.py\", line 304, in get_experiment_by_name\n",
" response_proto = self._call_endpoint(GetExperimentByName, req_body)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/store/tracking/rest_store.py\", line 56, in _call_endpoint\n",
" return call_endpoint(self.get_host_creds(), endpoint, method, json_body, response_proto)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 283, in call_endpoint\n",
" response = http_request(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 192, in http_request\n",
" raise MlflowException(f\"API request to {url} failed with exception {e}\")\n",
"mlflow.exceptions.MlflowException: API request to http://localhost:5000/api/2.0/mlflow/experiments/get-by-name failed with exception HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f8703191340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n"
]
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"WARNING:urllib3.connectionpool:Retrying (Retry(total=4, connect=4, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f48842ea280>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=3, connect=3, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f48842ea970>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=2, connect=2, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f48842eaa00>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=1, connect=1, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f48842ead30>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=0, connect=0, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f48843513a0>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 174, in _new_conn\n",
" conn = connection.create_connection(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 95, in create_connection\n",
" raise err\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 85, in create_connection\n",
" sock.connect(sa)\n",
"ConnectionRefusedError: [Errno 111] Connection refused\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 703, in urlopen\n",
" httplib_response = self._make_request(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 398, in _make_request\n",
" conn.request(method, url, **httplib_request_kw)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 239, in request\n",
" super(HTTPConnection, self).request(method, url, body=body, headers=headers)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1285, in request\n",
" self._send_request(method, url, body, headers, encode_chunked)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1331, in _send_request\n",
" self.endheaders(body, encode_chunked=encode_chunked)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1280, in endheaders\n",
" self._send_output(message_body, encode_chunked=encode_chunked)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1040, in _send_output\n",
" self.send(msg)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 980, in send\n",
" self.connect()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 205, in connect\n",
" conn = self._new_conn()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 186, in _new_conn\n",
" raise NewConnectionError(\n",
"urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7f4884351340>: Failed to establish a new connection: [Errno 111] Connection refused\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 440, in send\n",
" resp = conn.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" [Previous line repeated 2 more times]\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 785, in urlopen\n",
" retries = retries.increment(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/retry.py\", line 592, in increment\n",
" raise MaxRetryError(_pool, url, error or ResponseError(cause))\n",
"urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f4884351340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 174, in http_request\n",
" return _get_http_response_with_retries(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 105, in _get_http_response_with_retries\n",
" return session.request(method, url, **kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 529, in request\n",
" resp = self.send(prep, **send_kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 645, in send\n",
" r = adapter.send(request, **kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 519, in send\n",
" raise ConnectionError(e, request=request)\n",
"requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f4884351340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/repos/aitech-ium/IUM_08/examples/sklearn_elasticnet_wine/train.py\", line 24, in <module>\n",
" mlflow.set_experiment(\"s123456\")\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/fluent.py\", line 113, in set_experiment\n",
" experiment = client.get_experiment_by_name(experiment_name)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/client.py\", line 461, in get_experiment_by_name\n",
" return self._tracking_client.get_experiment_by_name(name)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/_tracking_service/client.py\", line 220, in get_experiment_by_name\n",
" return self.store.get_experiment_by_name(name)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/store/tracking/rest_store.py\", line 304, in get_experiment_by_name\n",
" response_proto = self._call_endpoint(GetExperimentByName, req_body)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/store/tracking/rest_store.py\", line 56, in _call_endpoint\n",
" return call_endpoint(self.get_host_creds(), endpoint, method, json_body, response_proto)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 283, in call_endpoint\n",
" response = http_request(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 192, in http_request\n",
" raise MlflowException(f\"API request to {url} failed with exception {e}\")\n",
"mlflow.exceptions.MlflowException: API request to http://localhost:5000/api/2.0/mlflow/experiments/get-by-name failed with exception HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f4884351340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n"
]
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"WARNING:urllib3.connectionpool:Retrying (Retry(total=4, connect=4, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fbabcb03280>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=3, connect=3, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fbabcb03970>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=2, connect=2, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fbabcb03a00>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=1, connect=1, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fbabcb03d30>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=0, connect=0, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fbabcb6a3a0>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 174, in _new_conn\n",
" conn = connection.create_connection(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 95, in create_connection\n",
" raise err\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 85, in create_connection\n",
" sock.connect(sa)\n",
"ConnectionRefusedError: [Errno 111] Connection refused\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 703, in urlopen\n",
" httplib_response = self._make_request(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 398, in _make_request\n",
" conn.request(method, url, **httplib_request_kw)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 239, in request\n",
" super(HTTPConnection, self).request(method, url, body=body, headers=headers)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1285, in request\n",
" self._send_request(method, url, body, headers, encode_chunked)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1331, in _send_request\n",
" self.endheaders(body, encode_chunked=encode_chunked)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1280, in endheaders\n",
" self._send_output(message_body, encode_chunked=encode_chunked)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1040, in _send_output\n",
" self.send(msg)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 980, in send\n",
" self.connect()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 205, in connect\n",
" conn = self._new_conn()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 186, in _new_conn\n",
" raise NewConnectionError(\n",
"urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7fbabcb6a340>: Failed to establish a new connection: [Errno 111] Connection refused\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 440, in send\n",
" resp = conn.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" [Previous line repeated 2 more times]\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 785, in urlopen\n",
" retries = retries.increment(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/retry.py\", line 592, in increment\n",
" raise MaxRetryError(_pool, url, error or ResponseError(cause))\n",
"urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fbabcb6a340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 174, in http_request\n",
" return _get_http_response_with_retries(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 105, in _get_http_response_with_retries\n",
" return session.request(method, url, **kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 529, in request\n",
" resp = self.send(prep, **send_kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 645, in send\n",
" r = adapter.send(request, **kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 519, in send\n",
" raise ConnectionError(e, request=request)\n",
"requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fbabcb6a340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/repos/aitech-ium/IUM_08/examples/sklearn_elasticnet_wine/train.py\", line 24, in <module>\n",
" mlflow.set_experiment(\"s123456\")\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/fluent.py\", line 113, in set_experiment\n",
" experiment = client.get_experiment_by_name(experiment_name)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/client.py\", line 461, in get_experiment_by_name\n",
" return self._tracking_client.get_experiment_by_name(name)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/_tracking_service/client.py\", line 220, in get_experiment_by_name\n",
" return self.store.get_experiment_by_name(name)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/store/tracking/rest_store.py\", line 304, in get_experiment_by_name\n",
" response_proto = self._call_endpoint(GetExperimentByName, req_body)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/store/tracking/rest_store.py\", line 56, in _call_endpoint\n",
" return call_endpoint(self.get_host_creds(), endpoint, method, json_body, response_proto)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 283, in call_endpoint\n",
" response = http_request(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 192, in http_request\n",
" raise MlflowException(f\"API request to {url} failed with exception {e}\")\n",
"mlflow.exceptions.MlflowException: API request to http://localhost:5000/api/2.0/mlflow/experiments/get-by-name failed with exception HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fbabcb6a340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n"
]
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"WARNING:urllib3.connectionpool:Retrying (Retry(total=4, connect=4, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fa41326d280>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=3, connect=3, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fa41326d970>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=2, connect=2, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fa41326da00>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=1, connect=1, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fa41326dd30>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=0, connect=0, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fa4132d43a0>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 174, in _new_conn\n",
" conn = connection.create_connection(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 95, in create_connection\n",
" raise err\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 85, in create_connection\n",
" sock.connect(sa)\n",
"ConnectionRefusedError: [Errno 111] Connection refused\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 703, in urlopen\n",
" httplib_response = self._make_request(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 398, in _make_request\n",
" conn.request(method, url, **httplib_request_kw)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 239, in request\n",
" super(HTTPConnection, self).request(method, url, body=body, headers=headers)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1285, in request\n",
" self._send_request(method, url, body, headers, encode_chunked)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1331, in _send_request\n",
" self.endheaders(body, encode_chunked=encode_chunked)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1280, in endheaders\n",
" self._send_output(message_body, encode_chunked=encode_chunked)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 1040, in _send_output\n",
" self.send(msg)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/http/client.py\", line 980, in send\n",
" self.connect()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 205, in connect\n",
" conn = self._new_conn()\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 186, in _new_conn\n",
" raise NewConnectionError(\n",
"urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7fa4132d4340>: Failed to establish a new connection: [Errno 111] Connection refused\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 440, in send\n",
" resp = conn.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 813, in urlopen\n",
" return self.urlopen(\n",
" [Previous line repeated 2 more times]\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 785, in urlopen\n",
" retries = retries.increment(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/retry.py\", line 592, in increment\n",
" raise MaxRetryError(_pool, url, error or ResponseError(cause))\n",
"urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fa4132d4340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 174, in http_request\n",
" return _get_http_response_with_retries(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 105, in _get_http_response_with_retries\n",
" return session.request(method, url, **kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 529, in request\n",
" resp = self.send(prep, **send_kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/sessions.py\", line 645, in send\n",
" r = adapter.send(request, **kwargs)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/requests/adapters.py\", line 519, in send\n",
" raise ConnectionError(e, request=request)\n",
"requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fa4132d4340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/repos/aitech-ium/IUM_08/examples/sklearn_elasticnet_wine/train.py\", line 24, in <module>\n",
" mlflow.set_experiment(\"s123456\")\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/fluent.py\", line 113, in set_experiment\n",
" experiment = client.get_experiment_by_name(experiment_name)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/client.py\", line 461, in get_experiment_by_name\n",
" return self._tracking_client.get_experiment_by_name(name)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/tracking/_tracking_service/client.py\", line 220, in get_experiment_by_name\n",
" return self.store.get_experiment_by_name(name)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/store/tracking/rest_store.py\", line 304, in get_experiment_by_name\n",
" response_proto = self._call_endpoint(GetExperimentByName, req_body)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/store/tracking/rest_store.py\", line 56, in _call_endpoint\n",
" return call_endpoint(self.get_host_creds(), endpoint, method, json_body, response_proto)\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 283, in call_endpoint\n",
" response = http_request(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/mlflow/utils/rest_utils.py\", line 192, in http_request\n",
" raise MlflowException(f\"API request to {url} failed with exception {e}\")\n",
"mlflow.exceptions.MlflowException: API request to http://localhost:5000/api/2.0/mlflow/experiments/get-by-name failed with exception HTTPConnectionPool(host='localhost', port=5000): Max retries exceeded with url: /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fa4132d4340>: Failed to establish a new connection: [Errno 111] Connection refused'))\n"
]
},
{
"name": "stdout",
"output_type": "stream",
"text": [
"WARNING:urllib3.connectionpool:Retrying (Retry(total=4, connect=4, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f3d52df5280>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=3, connect=3, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f3d52df5970>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=2, connect=2, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f3d52df5a00>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=1, connect=1, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f3d52df5d30>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"WARNING:urllib3.connectionpool:Retrying (Retry(total=0, connect=0, read=5, redirect=5, status=5)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f3d52e5c3a0>: Failed to establish a new connection: [Errno 111] Connection refused')': /api/2.0/mlflow/experiments/get-by-name?experiment_name=s123456\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connection.py\", line 174, in _new_conn\n",
" conn = connection.create_connection(\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 95, in create_connection\n",
" raise err\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/util/connection.py\", line 85, in create_connection\n",
" sock.connect(sa)\n",
"ConnectionRefusedError: [Errno 111] Connection refused\n",
"\n",
"During handling of the above exception, another exception occurred:\n",
"\n",
"Traceback (most recent call last):\n",
" File \"/home/tomek/miniconda3/lib/python3.9/site-packages/urllib3/connectionpool.py\", line 703, in urlopen\n",