{ "cells": [ { "cell_type": "markdown", "metadata": { "slideshow": { "slide_type": "-" } }, "source": [ "![baner aitech](../grafiki/SE4/logo.jpg \"baner\")\n", "\n", "***\n", "\n", "# Sztuczna empatia 4\n", "## Empatia w systemach dialogowych\n", "### Joanna Siwek\n", "\n", "***\n", "\n", "### Spis treści\n", "1. [Wstęp](#introduction)\n", "2. [Analiza języka mówionego i pisanego](#paragraph1)\n", "3. [Metody implementacji emocji w systemach dialogowych](#paragraph2)\n", "4. [Chatboty i wirtualni asystenci](#paragraph3)\n", "5. [Emocjonalni wirtualni rozmówcy](#paragraph4)\n", "6. [Zadania](#paragraph5)\n", "\n", "***\n", "\n", "![baner ue](../grafiki/SE4/ae_ue.jpg \"baner\")" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### Wstęp \n", "
\n", "
Jednym z bardziej obiecujących zastosowań sztucznej empatii są szeroko rozumiane systemy dialogowe, w tym wirtualni asystenci tacy jak Alexa (Amazon) czy systemy pytająco-odpowiadające takie jak Watson (IBM). Systemy te są na bieżąco rozwijane, a badania wskazują, iż uwzględnienie w ich budowie emocji i zachowań empatycznych powoduje wzrost zadowolenia klienta z oferowanych usług.\n", "
\n", "
\n", "
Pojęcie systemów dialogowych związane jest z kilkoma powiązanymi dziedzinami, takimi jak rozpoznawanie języka naturalnego, modele psychologiczne, rozpoznawanie emocji oraz lingwistka. Celem niniejszych zajęć, prócz przybliżenia wymienionych dziedzin, jest napisanie prostego chatbota na zadanym szkielecie, umożliwiającego przetwarzanie języka naturalnego oraz wyposażonego w podstawowe możliwości komunikacji emocjonalnej.
" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### Analiza języka mówionego i pisanego\n", "\n", "\n", "#### Przetwarzanie języka naturalnego\n", "
\n", "
Przetwarzanie języka naturalnego (Natural Language Processing NLP) to zdolność systemu komputerowego do rozumienia tekstu oraz mowy w sposób podobny do tego, jak robi to człowiek. NLP łączy lingwistykę komputerową (modelowanie języka ludzkiego oparte na regułach) z modelami statystycznymi, uczeniem maszynowym i deep learningiem. Razem, technologie te umożliwiają komputerom przetwarzanie języka ludzkiego w celu zrozumienia jego znaczenia, łącznie z nadawanym zamiarem i sentymentem użytkownika [3]. Programy NLP tłumaczą tekst pomiędzy językami, odpowiadają na komendy głosowe oraz analizują duże wolumeny tekstu, nawet w czasie rzeczywistym.
\n", "
\n", "
Zagadnienia przetwarzanie jezyka naturalnego dzielimy na [4]:
" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "![Składowe przetwarzania języka naturalnego, Autor: Joanna Siwek, Źródło: Opracowanie własne](../grafiki/SE4/se4_1.png \"NLP\")\n", "
Składowe przetwarzania języka naturalnego. Źródło: Opracowanie własne
" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "
Głównymi zadaniami systemów NLP jest [3]:
\n", "\n", " * Rozpoznawanie mowy\n", " * Tagowanie gramatyczne\n", " * Rozpoznawanie znaczenia wyrazów\n", " * Rozpoznawanie nazwanych obiektów\n", " * Rozpoznawanie ko-referencji\n", " * Analiza uczuć\n", " * Tworzenie języka naturalnego\n", "\n", "
Wyróżniamy dwie główne metody przetwarzania języka naturalnego
\n", "\n", " * Metody reguł symbolicznych\n", " * Deep learning\n", " \n", "
Metody regułowe polegają na ręcznym wypisywaniu reguł, według krórych prowadzone ma być rozumowanie w systemie. Jest to metoda historycznie starsza, posiadająca silne wady. Przede wszystkim, system działa jedynie w takim zakresie, w jakim zdefiniowane zostały reguły. Oznacza to, iż twórca musi dokładnie rozważyć wszystkie możliwe stany i aktywności systemu jeszcze przed jego stworzeniem. System nie będzie również w stanie zareagowac na sytuację, która nie została wcześniej zdefiniowana.
\n", "
\n", "
W odróżnieniu do systemów regułowych, systemy wykorzystujące deep learning same wywnioskowują reguły z dużych zbiorów danych. Im więcej danych jest dostarczonych, tym dokładniejszy jest system. Co więcej, systemy te wykorzystują statystykę, aby ominąć problemy z nieprawidłowo wprowadzonym tekstem czy niezrozumiałą mową - sygnał jest porównywany ze statystycznie najczęściej występującymi wejściami. Podobnie, uczenie maszynowe skupia się na najczęściej występujących sytuacjach i znaczeniach.
\n", "
\n", "
Pomimo wielu zalet modeli opartych na deep learningu, modele regułowe nadal są wykorzystywane, np. wtedy kiedy dostęp do dużych zbiorów danych jest niemożliwy.
\n", "
\n", "
Podstawowe elementy silników NLP to [15]:
\n", "\n", " * zamiar - zadanie, które chce wykonać użytkownik\n", " * instancja - miejsce, czas, data\n", " * wypowiedź\n", " * kontekst - parametry sesji\n", " * sesja - oznaczona przez początek i koniec konwersacji\n", " \n", "
\n", "
Można wymienić kilka powodów, dla których NLP przydaje się konkretnie w chatbotach [15]:
\n", "\n", " * Pozwala na dokładniejszą interpretację danych wprowadzanych przez użytkownika\n", " * Pozwala wyeliminować \"literówki\"\n", " * Pozwala na komunikację zrozumiałą dla szerszego grona użytkowników\n", " * Pozwala na szybszą naukę\n", " * Wymaga mniejszego zbioru danych uczących\n", " * Pozwala na abstrahowanie od konkretnej dziedziny zastosowań\n", " \n", "
\n", "
Warto tu wspomnieć o podmiotowości systemów konwersacyjnych. Aby system komputerowy był zdefiniowany jako podmiot, musi on mieć zdolnośc do samodzielnego podejmowania decyzji. Zgodnie z tą definicją, podmioty konwersacyjne nie mogę być prostymi systemami typu jeżeli x to y, ponieważ system taki nie zakłada automatycznego podejmowania decyzji o tym, w jaki sposób odpowiedzieć na dany sygnał od użytkownika.
" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### Metody implementacji emocji w systemach dialogowych \n", "
\n", "
W podmiotach konwersacyjnych zaimplementowanych na systemach wbudowanych (ang. embodied conversational agents - podmioty posiadające dedykowaną fizyczną realizację) empatia może być przypisana do wielu zachowań, takich jak mimikra, dopasowanie afektywne (np. odruchy stadne), empatyczna troska, altruizm i przyjmowanie perspektywy [2]. Zachowania te możemy podzielić na następujące kategorie:
\n", "\n", " * Mechanizmy kominikacji emocjonalnej - podmiot musi umieć odebrać oraz wysłać sygnały emocjonalne, np. przez słowa, mimikę, gesty\n", " * Mechanizmy regulacji emocjonalnej - podmiot musi potrafić zareagować w odpowiedni sposób na sygnał emocjonalny\n", " * Mechanizmy kognitywne - podmiot musi znać podstawowe zasady przyczynowo-skutkowe zachowań emocjonalnych oraz mieć możliwość pozyskania nowej wiedzy na ich temat\n", " \n", "
Każdy z tych poziomów zachowania posiada pewne swoje składowe, zależne od poziomu empatii - od bardziej podstawowych, instynktownych, do bardziej złożonych, związanych z inteligencją emocjonalną. Możemy zatem wyróżnić następujące zachowania:
\n", " \n", " * Komunikacja emocjonalna\n", " * Rozpoznanie emocji np. system wizyjny\n", " * Reprezentacja emocji np. mapa emocji\n", " * Wyrażenie emocji np. zmiana tonu głosu\n", " * Regulacja emocjonalna\n", " * Samoregulacja wewnętrzna\n", " * Humor\n", " * Osobowość\n", " * Regulacja międzypodmiotowa\n", " * Podobieństwo\n", " * Powiązanie emocjonalne\n", " * Sympatia\n", " * Mechanizmy kognitywne\n", " * Ocena\n", " * Re-ewaluacja\n", " * Teoria umysłu - przyjmowanie perspektywy\n", " \n", "
Można wyróżnić dwa rodzaje emocjonalnych podmiotów konwersacyjnych, zaimplementowanych na systemach wbudowanych [2]:
\n", "\n", " * Sensitive Artificial Listener (SAL) - wrażliwy sztuczny słuchacz\n", "
Jest to multimodalny system dialogowy, zdolny do niewerbalnej interakcji opartej na mowie, poruszaniu głową i mimice użytkownika. Bierze pod uwagę emocje rozmówcy i reaguje przy pomocy mimikry, opartej na rozpoznanym wyrazie twarzy.
\n", "
\n", " * Affective Listener - uczuciowy słuchacz\n", "
Systemy takie wykrywają uczucia w odpowiedziach, dokonują rozumowania oraz odpowiadają. Jednakże system i jego ewaluacja są oparte na wcześniej określonych, wyspecyfikowanych scenariuszach, dotyczących konkretnych czynności. Ich celem jest zwiększenie użyteczności i i zadowolenia użytkownika.
" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### Chatboty i wirtualni asystenci \n", "
\n", "
Chatboty możemy podzielić na dwie główne grupy [4]:
" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "![Rodzaje chatbotów, Autor: Joanna Siwek, Źródło: Opracowanie własne](../grafiki/SE4/se4_2.png \"Rodzaje chatbotów\")\n", "
Rodzaje chatbotów. Źródło: Opracowanie własne
" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "
Chatboty oparte na regułach nie są w stanie zareagować na sytuację, która nie została przewidziana w scenariuszu. Chatboty oparte na AI wykorzystują NLP oraz uczą się na podstawie interakcji z użytkownikiem.
\n", "
\n", "
Stworzenie chatbota, umożliwiającego rozmowę na dowolny temat, prowadzoną w języku naturalnym, nie jest proste. Główne wyzwania, z którymi należy się zmierzyć, to [4, 11]:
\n", "\n", " * synonimy, homonimy i slang\n", " * \"literówki\"\n", " * skróty\n", " * pominięta interpunkcja\n", " * różne akcenty\n", " * pozostawanie w temacie\n", " * unikanie powtarzalności\n", " * generowanie odpowiedzi adekwatnych do emocji\n", " \n", "
W praktyce możliwe są dwa podejścia do tworzenia chatbotów. Pierwsze z nich polega na wykorzystaniu gotowych szkieletów. Jest to rozwiązanie prostsze, szybsze i tańsze, jednakże często nie jest ono wystarczająco dopasowane do wymagań użytkownika oraz trudne w dopasowaniu do konkretnej realizacji. Przykładami gotowych rozwiązań są np.: Botsify, Chatterbot, RASA, Wit.ai, Botkit, TARS.
\n", "
\n", "
Drugie rozwiązanie polega na stworzeniu bota od podstaw. Jest to rozwiązanie zdecydowanie dużo bardziej kosztowne i czasochłonne, jednakże pozwala ono otrzymać produkt w większym stopniu dopasowany do wymogów użytkownika. Niestety, rozwiązanie to wymaga sporego doświadczenia.
\n", "
\n", "
Ogólnie, kroki które należy wykonać przed przystąpieniem do budowy własnego chatbota są następujące [4]:
\n", "\n", " * Analiza logiki biznesowej\n", " * Faza rozpoznania\n", " * Analiza rynku konkurencyjnego\n", " * Określenie głownych zadań i cech systemu\n", " * Stworzenie logiki biznesowej produktu\n", "\n", "
Kolejnym zagadnieniem jest ocena działania chatbota. Istnieją dwa możliwe podejścia - ocena rozmowy przez człowieka oraz ocena automatyczna. Ocena przez człowieka daje dużo bardziej wiarygodne rezultaty, jest niestety zdecydowanie droższa od metody automatycznej. Metody automatyczne to na przykład współczynnik BLEU czy też metody oparte na odległości od \"złotej odpowiedzi\". Metody te są niestety mniej dokładne oraz nie nadają się do oceny chatbotów we wszystkich dziedzinach (np. open-domain chatbots) [11].
\n", "\n", "
Ale jak tak naprawdę działa inteligentny chatbot? Możemy wyróżnić kolejne fazy jego działania [16]:
\n", " \n", " * tokenizacja - chatbot rozpoczyna pracę poprzez pocięcie tekstu na kawałki i usunięcie interpunkcji\n", " * normalizacja - następnie bot poszukuje najczęstszych literówek i błędów oraz je naprawia\n", " * rozpoznanie jednostek - chatbot próbuje określić, jaki typ obiektu jest opisywany\n", " * analiza zależności - bot dzieli zdanie na rzeczowniki, czasowniki, podmiot, interpunkcję i powszechnie stosowane wyrażenia\n", " * generowanie - bot generuje pewną liczbę odpowiedzi przy pomocy wszystkich zebranych informacji i wybiera najbardziej odpowiednią do sytuacji, którą wysyła do użytkownika." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### Emocjonalni wirtualni rozmówcy\n", "
\n", "
Istnieją dwa sposoby patrzenia na empatię w kontekście wirtualnych (i robotycznych) rozmówców [13]:
\n", "\n", " * sztuczne podmioty wchodzą w interakcję ze sobą lub otoczeniem, a obserwator (człowiek) odczuwa empatię\n", " * użytkownicy (ludzie) wchodzą w interakcję ze sobą bądź otoczeniem, a sztuczny podmiot odczuwa empatię.\n", " \n", "
Tym samym podmioty empatyczne definiujemy jako [13]:
\n", " \n", " * Podmioty, które reagują emocjonalnie na sytuacje, które są bardziej zgodne z sytuacją emocjonalną innego podmiotu lub\n", " * Podmioty, które poprzez swój projekt i zachowania powodują u użytkowników odpowiedzi, które są bardziej zgodne z sytuacją emocjonalną podmiotu.\n", " \n", "
Procesy umożliwiające podmiotowi bycie postrzeganym jako cel empatii to [13]:
\n", "\n", " * sytuacja/kontekst\n", " * cechy obserwatora\n", " * mechanizmy empatii\n", " * cechy obiektu empatii\n", " * modulacja empatii\n", " \n", "
\n", "
Wyróżnić można dwa główne typy modeli implementacji empatii [13]:
\n", "\n", " * Analityczne - modele te powstają bezpośrednio z modeli teoretycznych i są bardziej adekwatne. Z drugiej strony, modele te są często bardzo ogólne, i nie zawierają wystarczającej ilości informacji do stworzenia praktycznej implementacji modelu. W związku z tym mogą powstawać problemy, z niedokładnością odtowrzenia procesu myślowego twórcy modelu oraz problemu pomyłek w translacji modelu.\n", " * Empiryczne - modele te powstają na podstawie danych zebranych na podstawie interakcji emocjonalnych ludzi w sytuacjach empatycznych. Modele są odporne na problem pomyłek w translacji, jednakże zależą w bardzo dużym stopniu od samych danych, na których się opierają. Z tego powodu, są one bardzo trudne do uogólnienia.\n", "\n", "
\n", "
Przykłady systemów, wykorzystujących empatię to np.:
\n", "\n", " * FearNot!\n", " * Carmen's Bright IDEAS\n", " * SimSensei Kiosk\n", " \n", "
\n", "
Pytania, na które należy odpowiedzieć sobie, tworząc empatycznego wirtualnego rozmówce, to [13]:
\n", " \n", " * Jaki typ zachowania powinien wywoływac empatię? \n", " * Jaki wygląd i cechy będą wpływać na wywoływanie empatii? (np. wygląd dziecka)\n", " * Jak ważny jest kontekst i sytuacja?\n", " * Jakie systemy mediacyjne powinny być zastosowane i w jakich sytuacjach?\n", " * Jak możemy zmierzyć efekt, jaki obiekt empatii wywiera na użytkowniku?\n", "\n", "
Ostatnie dwa-trzy lata cechują się gwałtownym rozwojem systemów dialogowych wzbogaconych o elementy empatyczne czy emocjonalne. Systemy te są głownie oparte o deep learning i wykorzystują duże korpusy danych z takich źródeł jak Twitter, Redit czy Amazon. Ponieważ najłatwiej systemy dialogowe uczy się przy pomocy etykietowanych danych, bardzo często jako etykiety wykorzystuje się tagi bądź też emotikony [7]. Wzbogacenie istniejących systemów dialogowych o emocje sprzyja zwiększeniu ich dokładności. Przykładowo, szukając najbliższych sąsiadów w systemie pozbawionym emocji, jako najbliższych sąsiadów słowa \"headache\" określono słowa \"vomit\" i \"cough\". Natomiast kiedy wzbogacono system o emocje, jako najbliźsi sąsiedzi tegoż samego słowa zostały wskazane pojęcia \"irritation\" i \"anger' [7].
\n", "
\n", "
Istnieją trzy możliwości implementacji emocji [12]:
\n", "\n", " * podejście wielowymiarowe - określenie emocji jako wektorów\n", " * podejście dyskretne - wcześniejsze określenie kategorii emocji i klasyfikacja\n", " * modele oceniające - określenie warunkowych rozkładów prawdopodobieństwa występowania danych emocji.\n", " \n", "
\n", "
Modele empatycznych systemów dialogowych w znacznej większości są oparte na konwolucyjnych bądź rekurencyjnych sieciach neuronowych. Najczęściej stosowanym rozwiązaniem jest rozwiązanie enkoder-dekoder, gdzie dane wejściowe są najpierw kodowane, następnie trafiają do dwóch/trzech sieci neuronowych - odpowiedzialnych za przetwarzanie treści, przetwarzanie kontekstu i przetwarzanie emocji, a następnie odpowiedzi sieci są ze sobą łączone i dekodowane, oraz generowana jest odpowiedź dla użytkownika. Szczegółowy i bardzo dobrze opisany model można znaleźć w [8]. W modelu tym oblicza się rozkład prawdopodobieństwa wystąpienia danej emocji w odpowiedzi na sygnał nadany przez użytkownika. Emocje przekazywane są do systemu przez etykiety. Rozwiązania, które często znajdują zastosowanie w modelach emocjonalnych to GRU (gated recurrent unit), LSTM (long short-term memory), sequence2sequence, memory networks.
\n", "
\n", "
Enkodery uwzględniające emocje różnią się od ogólnych enkoderów tym, iz kontekst który zwracają zawiera również informacje związane z emocjami [12]:
\n", "\n", " * Jeżeli dostępne są etykiety emocji dla kontekstu lub danych podanych przez użytkownika, świadomość emocji może zostać łatwo osiągnięta poprzez podanie etykiet jako dodatkowych informacji do enkodera.\n", " * Jeżeli etykiety nie są dostępne, konieczne jest zastosowanie dodatkowego detektora emocji w celu przypisania etykiet.\n", " \n", "
\n", "
Problemy, z którymi borykają się emocjonalne systemy dialogowe to [12]:
\n", "\n", " * braki etykiet\n", " * ewaluacja emocji\n", " * problem z niespójnością celu uwzględnienia emocji z innymi celami, np. poprawnością gramatyczną\n", " * nie wszystkie wyrazy w wypowiedzi powinny być nacechowane emocjonalnie\n", " \n", "
\n", "
Przykładowe modele empatycznych rozmówców można znaleźć np. w [10] (jest to jeden z bardziej znanych modeli), czy [9] (oparty na poprzednim modelu, nowszy model z grudnia 2020).
" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### Zadania \n", "\n", "Stwórzmy prosty czatbot oparty na przetwarzaniu języka naturalnego i zbiórze reguł. Wykorzystamy do tego framework RASA [1], który jest open source. Zacznijmy od zainstalowania rasy i wszystkich zależności." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Kod Rasa jest asynchroniczny, dlatego potrzemujemy biblioteki asyncio..." ] }, { "cell_type": "code", "execution_count": 1, "metadata": { "scrolled": true }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Defaulting to user installation because normal site-packages is not writeable\n", "Requirement already satisfied: nest_asyncio==1.5.* in /usr/local/lib/python3.9/dist-packages (1.5.5)\n", "--- Logging error ---\n", "Traceback (most recent call last):\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/utils/logging.py\", line 177, in emit\n", " self.console.print(renderable, overflow=\"ignore\", crop=False, style=style)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/console.py\", line 1673, in print\n", " extend(render(renderable, render_options))\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/console.py\", line 1305, in render\n", " for render_output in iter_render:\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/utils/logging.py\", line 134, in __rich_console__\n", " for line in lines:\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/segment.py\", line 249, in split_lines\n", " for segment in segments:\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/console.py\", line 1283, in render\n", " renderable = rich_cast(renderable)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/protocol.py\", line 36, in rich_cast\n", " renderable = cast_method()\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/self_outdated_check.py\", line 130, in __rich__\n", " pip_cmd = get_best_invocation_for_this_pip()\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/utils/entrypoints.py\", line 58, in get_best_invocation_for_this_pip\n", " if found_executable and os.path.samefile(\n", " File \"/usr/lib/python3.9/genericpath.py\", line 101, in samefile\n", " s2 = os.stat(f2)\n", "FileNotFoundError: [Errno 2] No such file or directory: '/usr/bin/pip3.9'\n", "Call stack:\n", " File \"/usr/lib/python3.9/runpy.py\", line 197, in _run_module_as_main\n", " return _run_code(code, main_globals, None,\n", " File \"/usr/lib/python3.9/runpy.py\", line 87, in _run_code\n", " exec(code, run_globals)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/__main__.py\", line 31, in \n", " sys.exit(_main())\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/cli/main.py\", line 70, in main\n", " return command.main(cmd_args)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/cli/base_command.py\", line 101, in main\n", " return self._main(args)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/cli/base_command.py\", line 223, in _main\n", " self.handle_pip_version_check(options)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/cli/req_command.py\", line 190, in handle_pip_version_check\n", " pip_self_version_check(session, options)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/self_outdated_check.py\", line 236, in pip_self_version_check\n", " logger.warning(\"[present-rich] %s\", upgrade_prompt)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 1454, in warning\n", " self._log(WARNING, msg, args, **kwargs)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 1585, in _log\n", " self.handle(record)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 1595, in handle\n", " self.callHandlers(record)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 1657, in callHandlers\n", " hdlr.handle(record)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 948, in handle\n", " self.emit(record)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/utils/logging.py\", line 179, in emit\n", " self.handleError(record)\n", "Message: '[present-rich] %s'\n", "Arguments: (UpgradePrompt(old='22.2.2', new='23.0.1'),)\n", "Note: you may need to restart the kernel to use updated packages.\n" ] } ], "source": [ "pip install nest_asyncio==1.5.*" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "...którą importujemy i stosujemy." ] }, { "cell_type": "code", "execution_count": 2, "metadata": {}, "outputs": [], "source": [ "import nest_asyncio\n", "nest_asyncio.apply()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Rozwiązujemy problemy z zależnościami:" ] }, { "cell_type": "code", "execution_count": 3, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Defaulting to user installation because normal site-packages is not writeable\n", "Requirement already satisfied: fbmessenger==6.0.* in /home/students/s444341/.local/lib/python3.9/site-packages (6.0.0)\n", "Requirement already satisfied: requests>=2.0 in /usr/local/lib/python3.9/dist-packages (from fbmessenger==6.0.*) (2.28.1)\n", "Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.9/dist-packages (from requests>=2.0->fbmessenger==6.0.*) (2022.9.14)\n", "Requirement already satisfied: charset-normalizer<3,>=2 in /usr/local/lib/python3.9/dist-packages (from requests>=2.0->fbmessenger==6.0.*) (2.1.1)\n", "Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/local/lib/python3.9/dist-packages (from requests>=2.0->fbmessenger==6.0.*) (1.26.12)\n", "Requirement already satisfied: idna<4,>=2.5 in /usr/local/lib/python3.9/dist-packages (from requests>=2.0->fbmessenger==6.0.*) (3.4)\n", "--- Logging error ---\n", "Traceback (most recent call last):\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/utils/logging.py\", line 177, in emit\n", " self.console.print(renderable, overflow=\"ignore\", crop=False, style=style)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/console.py\", line 1673, in print\n", " extend(render(renderable, render_options))\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/console.py\", line 1305, in render\n", " for render_output in iter_render:\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/utils/logging.py\", line 134, in __rich_console__\n", " for line in lines:\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/segment.py\", line 249, in split_lines\n", " for segment in segments:\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/console.py\", line 1283, in render\n", " renderable = rich_cast(renderable)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/protocol.py\", line 36, in rich_cast\n", " renderable = cast_method()\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/self_outdated_check.py\", line 130, in __rich__\n", " pip_cmd = get_best_invocation_for_this_pip()\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/utils/entrypoints.py\", line 58, in get_best_invocation_for_this_pip\n", " if found_executable and os.path.samefile(\n", " File \"/usr/lib/python3.9/genericpath.py\", line 101, in samefile\n", " s2 = os.stat(f2)\n", "FileNotFoundError: [Errno 2] No such file or directory: '/usr/bin/pip3.9'\n", "Call stack:\n", " File \"/usr/lib/python3.9/runpy.py\", line 197, in _run_module_as_main\n", " return _run_code(code, main_globals, None,\n", " File \"/usr/lib/python3.9/runpy.py\", line 87, in _run_code\n", " exec(code, run_globals)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/__main__.py\", line 31, in \n", " sys.exit(_main())\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/cli/main.py\", line 70, in main\n", " return command.main(cmd_args)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/cli/base_command.py\", line 101, in main\n", " return self._main(args)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/cli/base_command.py\", line 223, in _main\n", " self.handle_pip_version_check(options)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/cli/req_command.py\", line 190, in handle_pip_version_check\n", " pip_self_version_check(session, options)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/self_outdated_check.py\", line 236, in pip_self_version_check\n", " logger.warning(\"[present-rich] %s\", upgrade_prompt)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 1454, in warning\n", " self._log(WARNING, msg, args, **kwargs)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 1585, in _log\n", " self.handle(record)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 1595, in handle\n", " self.callHandlers(record)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 1657, in callHandlers\n", " hdlr.handle(record)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 948, in handle\n", " self.emit(record)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/utils/logging.py\", line 179, in emit\n", " self.handleError(record)\n", "Message: '[present-rich] %s'\n", "Arguments: (UpgradePrompt(old='22.2.2', new='23.0.1'),)\n", "Note: you may need to restart the kernel to use updated packages.\n" ] } ], "source": [ "pip install fbmessenger==6.0.*" ] }, { "cell_type": "code", "execution_count": 4, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Defaulting to user installation because normal site-packages is not writeable\n", "Requirement already satisfied: pykwalify==1.8.* in /home/students/s444341/.local/lib/python3.9/site-packages (1.8.0)\n", "Requirement already satisfied: python-dateutil>=2.8.0 in /usr/local/lib/python3.9/dist-packages (from pykwalify==1.8.*) (2.8.2)\n", "Requirement already satisfied: docopt>=0.6.2 in /home/students/s444341/.local/lib/python3.9/site-packages (from pykwalify==1.8.*) (0.6.2)\n", "Requirement already satisfied: ruamel.yaml>=0.16.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from pykwalify==1.8.*) (0.16.13)\n", "Requirement already satisfied: six>=1.5 in /usr/lib/python3/dist-packages (from python-dateutil>=2.8.0->pykwalify==1.8.*) (1.16.0)\n", "Requirement already satisfied: ruamel.yaml.clib>=0.1.2 in /usr/local/lib/python3.9/dist-packages (from ruamel.yaml>=0.16.0->pykwalify==1.8.*) (0.2.6)\n", "--- Logging error ---\n", "Traceback (most recent call last):\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/utils/logging.py\", line 177, in emit\n", " self.console.print(renderable, overflow=\"ignore\", crop=False, style=style)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/console.py\", line 1673, in print\n", " extend(render(renderable, render_options))\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/console.py\", line 1305, in render\n", " for render_output in iter_render:\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/utils/logging.py\", line 134, in __rich_console__\n", " for line in lines:\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/segment.py\", line 249, in split_lines\n", " for segment in segments:\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/console.py\", line 1283, in render\n", " renderable = rich_cast(renderable)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/protocol.py\", line 36, in rich_cast\n", " renderable = cast_method()\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/self_outdated_check.py\", line 130, in __rich__\n", " pip_cmd = get_best_invocation_for_this_pip()\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/utils/entrypoints.py\", line 58, in get_best_invocation_for_this_pip\n", " if found_executable and os.path.samefile(\n", " File \"/usr/lib/python3.9/genericpath.py\", line 101, in samefile\n", " s2 = os.stat(f2)\n", "FileNotFoundError: [Errno 2] No such file or directory: '/usr/bin/pip3.9'\n", "Call stack:\n", " File \"/usr/lib/python3.9/runpy.py\", line 197, in _run_module_as_main\n", " return _run_code(code, main_globals, None,\n", " File \"/usr/lib/python3.9/runpy.py\", line 87, in _run_code\n", " exec(code, run_globals)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/__main__.py\", line 31, in \n", " sys.exit(_main())\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/cli/main.py\", line 70, in main\n", " return command.main(cmd_args)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/cli/base_command.py\", line 101, in main\n", " return self._main(args)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/cli/base_command.py\", line 223, in _main\n", " self.handle_pip_version_check(options)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/cli/req_command.py\", line 190, in handle_pip_version_check\n", " pip_self_version_check(session, options)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/self_outdated_check.py\", line 236, in pip_self_version_check\n", " logger.warning(\"[present-rich] %s\", upgrade_prompt)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 1454, in warning\n", " self._log(WARNING, msg, args, **kwargs)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 1585, in _log\n", " self.handle(record)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 1595, in handle\n", " self.callHandlers(record)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 1657, in callHandlers\n", " hdlr.handle(record)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 948, in handle\n", " self.emit(record)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/utils/logging.py\", line 179, in emit\n", " self.handleError(record)\n", "Message: '[present-rich] %s'\n", "Arguments: (UpgradePrompt(old='22.2.2', new='23.0.1'),)\n", "Note: you may need to restart the kernel to use updated packages.\n" ] } ], "source": [ "pip install pykwalify==1.8.*" ] }, { "cell_type": "code", "execution_count": 5, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Defaulting to user installation because normal site-packages is not writeable\n", "Requirement already satisfied: keras==2.8.* in /home/students/s444341/.local/lib/python3.9/site-packages (2.8.0)\n", "--- Logging error ---\n", "Traceback (most recent call last):\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/utils/logging.py\", line 177, in emit\n", " self.console.print(renderable, overflow=\"ignore\", crop=False, style=style)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/console.py\", line 1673, in print\n", " extend(render(renderable, render_options))\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/console.py\", line 1305, in render\n", " for render_output in iter_render:\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/utils/logging.py\", line 134, in __rich_console__\n", " for line in lines:\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/segment.py\", line 249, in split_lines\n", " for segment in segments:\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/console.py\", line 1283, in render\n", " renderable = rich_cast(renderable)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/protocol.py\", line 36, in rich_cast\n", " renderable = cast_method()\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/self_outdated_check.py\", line 130, in __rich__\n", " pip_cmd = get_best_invocation_for_this_pip()\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/utils/entrypoints.py\", line 58, in get_best_invocation_for_this_pip\n", " if found_executable and os.path.samefile(\n", " File \"/usr/lib/python3.9/genericpath.py\", line 101, in samefile\n", " s2 = os.stat(f2)\n", "FileNotFoundError: [Errno 2] No such file or directory: '/usr/bin/pip3.9'\n", "Call stack:\n", " File \"/usr/lib/python3.9/runpy.py\", line 197, in _run_module_as_main\n", " return _run_code(code, main_globals, None,\n", " File \"/usr/lib/python3.9/runpy.py\", line 87, in _run_code\n", " exec(code, run_globals)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/__main__.py\", line 31, in \n", " sys.exit(_main())\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/cli/main.py\", line 70, in main\n", " return command.main(cmd_args)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/cli/base_command.py\", line 101, in main\n", " return self._main(args)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/cli/base_command.py\", line 223, in _main\n", " self.handle_pip_version_check(options)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/cli/req_command.py\", line 190, in handle_pip_version_check\n", " pip_self_version_check(session, options)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/self_outdated_check.py\", line 236, in pip_self_version_check\n", " logger.warning(\"[present-rich] %s\", upgrade_prompt)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 1454, in warning\n", " self._log(WARNING, msg, args, **kwargs)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 1585, in _log\n", " self.handle(record)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 1595, in handle\n", " self.callHandlers(record)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 1657, in callHandlers\n", " hdlr.handle(record)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 948, in handle\n", " self.emit(record)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/utils/logging.py\", line 179, in emit\n", " self.handleError(record)\n", "Message: '[present-rich] %s'\n", "Arguments: (UpgradePrompt(old='22.2.2', new='23.0.1'),)\n", "Note: you may need to restart the kernel to use updated packages.\n" ] } ], "source": [ "pip install keras==2.8.*" ] }, { "cell_type": "code", "execution_count": 6, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Defaulting to user installation because normal site-packages is not writeable\n", "Collecting tensorflow==2.7.*\n", " Using cached tensorflow-2.7.4-cp39-cp39-manylinux2010_x86_64.whl (496.1 MB)\n", "Requirement already satisfied: gast<0.5.0,>=0.2.1 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorflow==2.7.*) (0.4.0)\n", "Requirement already satisfied: tensorboard~=2.6 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorflow==2.7.*) (2.8.0)\n", "Collecting tensorflow-estimator<2.8,~=2.7.0rc0\n", " Using cached tensorflow_estimator-2.7.0-py2.py3-none-any.whl (463 kB)\n", "Requirement already satisfied: numpy>=1.14.5 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorflow==2.7.*) (1.23.5)\n", "Requirement already satisfied: absl-py>=0.4.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorflow==2.7.*) (1.2.0)\n", "Requirement already satisfied: termcolor>=1.1.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorflow==2.7.*) (2.2.0)\n", "Requirement already satisfied: typing-extensions>=3.6.6 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorflow==2.7.*) (4.5.0)\n", "Requirement already satisfied: six>=1.12.0 in /usr/lib/python3/dist-packages (from tensorflow==2.7.*) (1.16.0)\n", "Requirement already satisfied: opt-einsum>=2.3.2 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorflow==2.7.*) (3.3.0)\n", "Requirement already satisfied: keras-preprocessing>=1.1.1 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorflow==2.7.*) (1.1.2)\n", "Requirement already satisfied: tensorflow-io-gcs-filesystem>=0.21.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorflow==2.7.*) (0.32.0)\n", "Requirement already satisfied: h5py>=2.9.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorflow==2.7.*) (3.8.0)\n", "Requirement already satisfied: wheel<1.0,>=0.32.0 in /usr/lib/python3/dist-packages (from tensorflow==2.7.*) (0.34.2)\n", "Requirement already satisfied: google-pasta>=0.1.1 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorflow==2.7.*) (0.2.0)\n", "Requirement already satisfied: protobuf<3.20,>=3.9.2 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorflow==2.7.*) (3.19.6)\n", "Requirement already satisfied: wrapt>=1.11.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorflow==2.7.*) (1.15.0)\n", "Requirement already satisfied: astunparse>=1.6.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorflow==2.7.*) (1.6.3)\n", "Collecting keras<2.8,>=2.7.0rc0\n", " Using cached keras-2.7.0-py2.py3-none-any.whl (1.3 MB)\n", "Requirement already satisfied: flatbuffers<3.0,>=1.12 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorflow==2.7.*) (2.0.7)\n", "Requirement already satisfied: grpcio<2.0,>=1.24.3 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorflow==2.7.*) (1.53.0)\n", "Requirement already satisfied: libclang>=9.0.1 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorflow==2.7.*) (16.0.0)\n", "Requirement already satisfied: tensorboard-plugin-wit>=1.6.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorboard~=2.6->tensorflow==2.7.*) (1.8.1)\n", "Requirement already satisfied: google-auth<3,>=1.6.3 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorboard~=2.6->tensorflow==2.7.*) (1.35.0)\n", "Requirement already satisfied: werkzeug>=0.11.15 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorboard~=2.6->tensorflow==2.7.*) (2.2.3)\n", "Requirement already satisfied: tensorboard-data-server<0.7.0,>=0.6.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorboard~=2.6->tensorflow==2.7.*) (0.6.1)\n", "Requirement already satisfied: google-auth-oauthlib<0.5,>=0.4.1 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorboard~=2.6->tensorflow==2.7.*) (0.4.6)\n", "Requirement already satisfied: requests<3,>=2.21.0 in /usr/local/lib/python3.9/dist-packages (from tensorboard~=2.6->tensorflow==2.7.*) (2.28.1)\n", "Requirement already satisfied: markdown>=2.6.8 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorboard~=2.6->tensorflow==2.7.*) (3.4.3)\n", "Requirement already satisfied: setuptools>=41.0.0 in /usr/lib/python3/dist-packages (from tensorboard~=2.6->tensorflow==2.7.*) (52.0.0)\n", "Requirement already satisfied: cachetools<5.0,>=2.0.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from google-auth<3,>=1.6.3->tensorboard~=2.6->tensorflow==2.7.*) (4.2.4)\n", "Requirement already satisfied: rsa<5,>=3.1.4 in /home/students/s444341/.local/lib/python3.9/site-packages (from google-auth<3,>=1.6.3->tensorboard~=2.6->tensorflow==2.7.*) (4.9)\n", "Requirement already satisfied: pyasn1-modules>=0.2.1 in /home/students/s444341/.local/lib/python3.9/site-packages (from google-auth<3,>=1.6.3->tensorboard~=2.6->tensorflow==2.7.*) (0.2.8)\n", "Requirement already satisfied: requests-oauthlib>=0.7.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from google-auth-oauthlib<0.5,>=0.4.1->tensorboard~=2.6->tensorflow==2.7.*) (1.3.1)\n", "Requirement already satisfied: importlib-metadata>=4.4 in /usr/local/lib/python3.9/dist-packages (from markdown>=2.6.8->tensorboard~=2.6->tensorflow==2.7.*) (4.12.0)\n", "Requirement already satisfied: charset-normalizer<3,>=2 in /usr/local/lib/python3.9/dist-packages (from requests<3,>=2.21.0->tensorboard~=2.6->tensorflow==2.7.*) (2.1.1)\n", "Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.9/dist-packages (from requests<3,>=2.21.0->tensorboard~=2.6->tensorflow==2.7.*) (2022.9.14)\n", "Requirement already satisfied: idna<4,>=2.5 in /usr/local/lib/python3.9/dist-packages (from requests<3,>=2.21.0->tensorboard~=2.6->tensorflow==2.7.*) (3.4)\n", "Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/local/lib/python3.9/dist-packages (from requests<3,>=2.21.0->tensorboard~=2.6->tensorflow==2.7.*) (1.26.12)\n", "Requirement already satisfied: MarkupSafe>=2.1.1 in /usr/local/lib/python3.9/dist-packages (from werkzeug>=0.11.15->tensorboard~=2.6->tensorflow==2.7.*) (2.1.1)\n", "Requirement already satisfied: zipp>=0.5 in /usr/lib/python3/dist-packages (from importlib-metadata>=4.4->markdown>=2.6.8->tensorboard~=2.6->tensorflow==2.7.*) (1.0.0)\n", "Requirement already satisfied: pyasn1<0.5.0,>=0.4.6 in /home/students/s444341/.local/lib/python3.9/site-packages (from pyasn1-modules>=0.2.1->google-auth<3,>=1.6.3->tensorboard~=2.6->tensorflow==2.7.*) (0.4.8)\n", "Requirement already satisfied: oauthlib>=3.0.0 in /usr/local/lib/python3.9/dist-packages (from requests-oauthlib>=0.7.0->google-auth-oauthlib<0.5,>=0.4.1->tensorboard~=2.6->tensorflow==2.7.*) (3.2.1)\n", "Installing collected packages: tensorflow-estimator, keras, tensorflow\n", " Attempting uninstall: tensorflow-estimator\n", " Found existing installation: tensorflow-estimator 2.8.0\n", " Uninstalling tensorflow-estimator-2.8.0:\n", " Successfully uninstalled tensorflow-estimator-2.8.0\n", " Attempting uninstall: keras\n", " Found existing installation: keras 2.8.0\n", " Uninstalling keras-2.8.0:\n", " Successfully uninstalled keras-2.8.0\n", " Attempting uninstall: tensorflow\n", " Found existing installation: tensorflow 2.8.4\n", " Uninstalling tensorflow-2.8.4:\n", " Successfully uninstalled tensorflow-2.8.4\n", "\u001b[33m WARNING: The scripts estimator_ckpt_converter, import_pb_to_tensorboard, saved_model_cli, tensorboard, tf_upgrade_v2, tflite_convert, toco and toco_from_protos are installed in '/home/students/s444341/.local/bin' which is not on PATH.\n", " Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.\u001b[0m\u001b[33m\n", "\u001b[0m\u001b[31mERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.\n", "tensorflow-text 2.8.2 requires tensorflow<2.9,>=2.8.0; platform_machine != \"arm64\" or platform_system != \"Darwin\", but you have tensorflow 2.7.4 which is incompatible.\n", "rasa 3.3.6 requires tensorflow<2.9.0,>=2.8.4; sys_platform != \"darwin\" or platform_machine != \"arm64\", but you have tensorflow 2.7.4 which is incompatible.\u001b[0m\u001b[31m\n", "\u001b[0mSuccessfully installed keras-2.7.0 tensorflow-2.7.4 tensorflow-estimator-2.7.0\n", "--- Logging error ---\n", "Traceback (most recent call last):\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/utils/logging.py\", line 177, in emit\n", " self.console.print(renderable, overflow=\"ignore\", crop=False, style=style)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/console.py\", line 1673, in print\n", " extend(render(renderable, render_options))\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/console.py\", line 1305, in render\n", " for render_output in iter_render:\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/utils/logging.py\", line 134, in __rich_console__\n", " for line in lines:\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/segment.py\", line 249, in split_lines\n", " for segment in segments:\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/console.py\", line 1283, in render\n", " renderable = rich_cast(renderable)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/protocol.py\", line 36, in rich_cast\n", " renderable = cast_method()\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/self_outdated_check.py\", line 130, in __rich__\n", " pip_cmd = get_best_invocation_for_this_pip()\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/utils/entrypoints.py\", line 58, in get_best_invocation_for_this_pip\n", " if found_executable and os.path.samefile(\n", " File \"/usr/lib/python3.9/genericpath.py\", line 101, in samefile\n", " s2 = os.stat(f2)\n", "FileNotFoundError: [Errno 2] No such file or directory: '/usr/bin/pip3.9'\n", "Call stack:\n", " File \"/usr/lib/python3.9/runpy.py\", line 197, in _run_module_as_main\n", " return _run_code(code, main_globals, None,\n", " File \"/usr/lib/python3.9/runpy.py\", line 87, in _run_code\n", " exec(code, run_globals)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/__main__.py\", line 31, in \n", " sys.exit(_main())\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/cli/main.py\", line 70, in main\n", " return command.main(cmd_args)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/cli/base_command.py\", line 101, in main\n", " return self._main(args)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/cli/base_command.py\", line 223, in _main\n", " self.handle_pip_version_check(options)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/cli/req_command.py\", line 190, in handle_pip_version_check\n", " pip_self_version_check(session, options)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/self_outdated_check.py\", line 236, in pip_self_version_check\n", " logger.warning(\"[present-rich] %s\", upgrade_prompt)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 1454, in warning\n", " self._log(WARNING, msg, args, **kwargs)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 1585, in _log\n", " self.handle(record)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 1595, in handle\n", " self.callHandlers(record)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 1657, in callHandlers\n", " hdlr.handle(record)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 948, in handle\n", " self.emit(record)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/utils/logging.py\", line 179, in emit\n", " self.handleError(record)\n", "Message: '[present-rich] %s'\n", "Arguments: (UpgradePrompt(old='22.2.2', new='23.0.1'),)\n", "Note: you may need to restart the kernel to use updated packages.\n" ] } ], "source": [ "pip install tensorflow==2.7.*" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Teraz powinno już nie być problemów z zainstalowaniem Rasa." ] }, { "cell_type": "code", "execution_count": 7, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Defaulting to user installation because normal site-packages is not writeable\n", "Requirement already satisfied: matplotlib==3.4.0 in /home/students/s444341/.local/lib/python3.9/site-packages (3.4.0)\n", "Requirement already satisfied: python-dateutil>=2.7 in /usr/local/lib/python3.9/dist-packages (from matplotlib==3.4.0) (2.8.2)\n", "Requirement already satisfied: cycler>=0.10 in /usr/lib/python3/dist-packages (from matplotlib==3.4.0) (0.10.0)\n", "Requirement already satisfied: numpy>=1.16 in /home/students/s444341/.local/lib/python3.9/site-packages (from matplotlib==3.4.0) (1.23.5)\n", "Requirement already satisfied: pillow>=6.2.0 in /usr/lib/python3/dist-packages (from matplotlib==3.4.0) (8.1.2)\n", "Requirement already satisfied: kiwisolver>=1.0.1 in /usr/lib/python3/dist-packages (from matplotlib==3.4.0) (1.3.1)\n", "Requirement already satisfied: pyparsing>=2.2.1 in /usr/lib/python3/dist-packages (from matplotlib==3.4.0) (2.4.7)\n", "Requirement already satisfied: six>=1.5 in /usr/lib/python3/dist-packages (from python-dateutil>=2.7->matplotlib==3.4.0) (1.16.0)\n", "--- Logging error ---\n", "Traceback (most recent call last):\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/utils/logging.py\", line 177, in emit\n", " self.console.print(renderable, overflow=\"ignore\", crop=False, style=style)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/console.py\", line 1673, in print\n", " extend(render(renderable, render_options))\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/console.py\", line 1305, in render\n", " for render_output in iter_render:\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/utils/logging.py\", line 134, in __rich_console__\n", " for line in lines:\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/segment.py\", line 249, in split_lines\n", " for segment in segments:\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/console.py\", line 1283, in render\n", " renderable = rich_cast(renderable)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/protocol.py\", line 36, in rich_cast\n", " renderable = cast_method()\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/self_outdated_check.py\", line 130, in __rich__\n", " pip_cmd = get_best_invocation_for_this_pip()\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/utils/entrypoints.py\", line 58, in get_best_invocation_for_this_pip\n", " if found_executable and os.path.samefile(\n", " File \"/usr/lib/python3.9/genericpath.py\", line 101, in samefile\n", " s2 = os.stat(f2)\n", "FileNotFoundError: [Errno 2] No such file or directory: '/usr/bin/pip3.9'\n", "Call stack:\n", " File \"/usr/lib/python3.9/runpy.py\", line 197, in _run_module_as_main\n", " return _run_code(code, main_globals, None,\n", " File \"/usr/lib/python3.9/runpy.py\", line 87, in _run_code\n", " exec(code, run_globals)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/__main__.py\", line 31, in \n", " sys.exit(_main())\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/cli/main.py\", line 70, in main\n", " return command.main(cmd_args)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/cli/base_command.py\", line 101, in main\n", " return self._main(args)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/cli/base_command.py\", line 223, in _main\n", " self.handle_pip_version_check(options)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/cli/req_command.py\", line 190, in handle_pip_version_check\n", " pip_self_version_check(session, options)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/self_outdated_check.py\", line 236, in pip_self_version_check\n", " logger.warning(\"[present-rich] %s\", upgrade_prompt)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 1454, in warning\n", " self._log(WARNING, msg, args, **kwargs)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 1585, in _log\n", " self.handle(record)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 1595, in handle\n", " self.callHandlers(record)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 1657, in callHandlers\n", " hdlr.handle(record)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 948, in handle\n", " self.emit(record)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/utils/logging.py\", line 179, in emit\n", " self.handleError(record)\n", "Message: '[present-rich] %s'\n", "Arguments: (UpgradePrompt(old='22.2.2', new='23.0.1'),)\n", "Note: you may need to restart the kernel to use updated packages.\n" ] } ], "source": [ "pip install matplotlib==3.4.0" ] }, { "cell_type": "code", "execution_count": 8, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Defaulting to user installation because normal site-packages is not writeable\n", "Requirement already satisfied: rasa[full]==3.3.* in /home/students/s444341/.local/lib/python3.9/site-packages (3.3.6)\n", "Requirement already satisfied: SQLAlchemy<1.5.0,>=1.4.0 in /usr/local/lib/python3.9/dist-packages (from rasa[full]==3.3.*) (1.4.41)\n", "Requirement already satisfied: colorclass<2.3,>=2.2 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (2.2.2)\n", "Requirement already satisfied: boto3<2.0,>=1.12 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (1.26.101)\n", "Requirement already satisfied: twilio<7.15,>=6.26 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (6.50.1)\n", "Requirement already satisfied: absl-py<1.3,>=0.9 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (1.2.0)\n", "Requirement already satisfied: pydot<1.5,>=1.4 in /usr/local/lib/python3.9/dist-packages (from rasa[full]==3.3.*) (1.4.2)\n", "Requirement already satisfied: setuptools>=41.0.0 in /usr/lib/python3/dist-packages (from rasa[full]==3.3.*) (52.0.0)\n", "Requirement already satisfied: apscheduler<3.10,>=3.6 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (3.7.0)\n", "Requirement already satisfied: CacheControl<0.13.0,>=0.12.9 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (0.12.11)\n", "Requirement already satisfied: sklearn-crfsuite<0.4,>=0.3 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (0.3.6)\n", "Requirement already satisfied: pluggy<2.0.0,>=1.0.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (1.0.0)\n", "Requirement already satisfied: requests<3.0,>=2.23 in /usr/local/lib/python3.9/dist-packages (from rasa[full]==3.3.*) (2.28.1)\n", "Requirement already satisfied: typing-extensions<5.0.0,>=3.7.4 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (4.5.0)\n", "Requirement already satisfied: prompt-toolkit<3.0.29,>=3.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (3.0.28)\n", "Requirement already satisfied: protobuf<3.20,>=3.9.2 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (3.19.6)\n", "Requirement already satisfied: ujson<6.0,>=1.35 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (5.7.0)\n", "Requirement already satisfied: questionary<1.11.0,>=1.5.1 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (1.10.0)\n", "Requirement already satisfied: terminaltables<3.2.0,>=3.1.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (3.1.10)\n", "Requirement already satisfied: kafka-python<3.0,>=1.4 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (2.0.2)\n", "Requirement already satisfied: packaging<21.0,>=20.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (20.9)\n", "Requirement already satisfied: slackclient<3.0.0,>=2.0.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (2.9.4)\n", "Requirement already satisfied: pykwalify<1.9,>=1.7 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (1.8.0)\n", "Requirement already satisfied: tensorflow-addons<0.18.0,>=0.17.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (0.17.1)\n", "Requirement already satisfied: tensorflow-text<2.9.0,>=2.8.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (2.8.2)\n", "Requirement already satisfied: dask==2022.2.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (2022.2.0)\n", "Requirement already satisfied: google-auth<3 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (1.35.0)\n", "Requirement already satisfied: sanic-cors<2.1.0,>=2.0.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (2.0.1)\n", "Requirement already satisfied: mattermostwrapper<2.3,>=2.2 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (2.2)\n", "Requirement already satisfied: python-socketio<6,>=4.4 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (5.8.0)\n", "Requirement already satisfied: sanic-jwt<2.0.0,>=1.6.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (1.8.0)\n", "Requirement already satisfied: scipy<1.9.0,>=1.4.1 in /usr/lib/python3/dist-packages (from rasa[full]==3.3.*) (1.6.0)\n", "Requirement already satisfied: typing-utils<0.2.0,>=0.1.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (0.1.0)\n", "Requirement already satisfied: webexteamssdk<1.7.0,>=1.1.1 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (1.6.1)\n", "Requirement already satisfied: matplotlib<3.6,>=3.1 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (3.4.0)\n", "Requirement already satisfied: joblib<1.3.0,>=0.15.1 in /usr/lib/python3/dist-packages (from rasa[full]==3.3.*) (0.17.0)\n", "Requirement already satisfied: rasa-sdk<3.4.0,>=3.3.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (3.3.1)\n", "Requirement already satisfied: sanic<21.13,>=21.12 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (21.12.2)\n", "Requirement already satisfied: pymongo[srv,tls]<3.11,>=3.8 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (3.10.1)\n", "Requirement already satisfied: colorhash<1.2.0,>=1.0.2 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (1.0.4)\n", "Requirement already satisfied: coloredlogs<16,>=10 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (15.0.1)\n", "Requirement already satisfied: randomname<0.2.0,>=0.1.5 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (0.1.5)\n", "Requirement already satisfied: tarsafe<0.0.4,>=0.0.3 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (0.0.3)\n", "Requirement already satisfied: jsonschema<4.17,>=3.2 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (4.4.0)\n", "Requirement already satisfied: sentry-sdk<1.10.0,>=0.17.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (1.3.1)\n", "Requirement already satisfied: tqdm<5.0,>=4.31 in /usr/local/lib/python3.9/dist-packages (from rasa[full]==3.3.*) (4.64.1)\n", "Requirement already satisfied: psycopg2-binary<2.10.0,>=2.8.2 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (2.9.5)\n", "Requirement already satisfied: PyJWT[crypto]<3.0.0,>=2.0.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (2.6.0)\n", "Requirement already satisfied: aiogram<2.20 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (2.15)\n", "Requirement already satisfied: python-engineio!=5.0.0,<6,>=4 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (4.4.0)\n", "Requirement already satisfied: python-dateutil<2.9,>=2.8 in /usr/local/lib/python3.9/dist-packages (from rasa[full]==3.3.*) (2.8.2)\n", "Requirement already satisfied: aiohttp!=3.7.4.post0,<3.9,>=3.6 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (3.7.4)\n", "Requirement already satisfied: cloudpickle<2.3,>=1.2 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (1.6.0)\n", "Requirement already satisfied: networkx<2.7,>=2.4 in /usr/lib/python3/dist-packages (from rasa[full]==3.3.*) (2.5)\n", "Requirement already satisfied: redis<5.0,>=3.4 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (3.5.3)\n", "Collecting tensorflow<2.9.0,>=2.8.4\n", " Using cached tensorflow-2.8.4-cp39-cp39-manylinux2010_x86_64.whl (498.1 MB)\n", "Requirement already satisfied: pytz<2023.0,>=2019.1 in /usr/lib/python3/dist-packages (from rasa[full]==3.3.*) (2021.1)\n", "Requirement already satisfied: aio-pika<9.0.0,>=6.7.1 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (8.3.0)\n", "Requirement already satisfied: numpy<1.24.0,>=1.19.2 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (1.23.5)\n", "Requirement already satisfied: regex<2022.10,>=2020.6 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (2022.4.24)\n", "Requirement already satisfied: attrs<22.2,>=19.3 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (21.2.0)\n", "Requirement already satisfied: fbmessenger<6.1.0,>=6.0.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (6.0.0)\n", "Requirement already satisfied: rocketchat_API<1.27.0,>=0.6.31 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (1.25.0)\n", "Requirement already satisfied: sanic-routing<0.8.0,>=0.7.2 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (0.7.2)\n", "Requirement already satisfied: scikit-learn<1.2,>=0.22 in /usr/lib/python3/dist-packages (from rasa[full]==3.3.*) (0.23.2)\n", "Requirement already satisfied: spacy<3.5,>=3.1 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (3.2.5)\n", "Requirement already satisfied: jsonpickle<2.3,>=1.3 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (2.0.0)\n", "Requirement already satisfied: tensorflow_hub<0.13.0,>=0.12.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (0.12.0)\n", "Requirement already satisfied: ruamel.yaml<0.18.0,>=0.16.5 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (0.16.13)\n", "Requirement already satisfied: transformers<4.14.0,>=4.13.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (4.13.0)\n", "Requirement already satisfied: sentencepiece[sentencepiece]<0.2.0,>=0.1.96 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (0.1.97)\n", "Requirement already satisfied: jieba<0.43,>=0.39 in /home/students/s444341/.local/lib/python3.9/site-packages (from rasa[full]==3.3.*) (0.42.1)\n", "Requirement already satisfied: pyyaml>=5.3.1 in /usr/lib/python3/dist-packages (from dask==2022.2.0->rasa[full]==3.3.*) (5.3.1)\n", "Requirement already satisfied: partd>=0.3.10 in /home/students/s444341/.local/lib/python3.9/site-packages (from dask==2022.2.0->rasa[full]==3.3.*) (1.3.0)\n", "Requirement already satisfied: toolz>=0.8.2 in /home/students/s444341/.local/lib/python3.9/site-packages (from dask==2022.2.0->rasa[full]==3.3.*) (0.12.0)\n", "Requirement already satisfied: fsspec>=0.6.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from dask==2022.2.0->rasa[full]==3.3.*) (2023.3.0)\n", "Requirement already satisfied: yarl in /home/students/s444341/.local/lib/python3.9/site-packages (from aio-pika<9.0.0,>=6.7.1->rasa[full]==3.3.*) (1.8.2)\n", "Requirement already satisfied: aiormq~=6.6.3 in /home/students/s444341/.local/lib/python3.9/site-packages (from aio-pika<9.0.0,>=6.7.1->rasa[full]==3.3.*) (6.6.4)\n", "Requirement already satisfied: Babel>=2.8.0 in /usr/local/lib/python3.9/dist-packages (from aiogram<2.20->rasa[full]==3.3.*) (2.10.3)\n", "Requirement already satisfied: certifi>=2020.6.20 in /usr/local/lib/python3.9/dist-packages (from aiogram<2.20->rasa[full]==3.3.*) (2022.9.14)\n", "Requirement already satisfied: chardet<4.0,>=2.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from aiohttp!=3.7.4.post0,<3.9,>=3.6->rasa[full]==3.3.*) (3.0.4)\n", "Requirement already satisfied: async-timeout<4.0,>=3.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from aiohttp!=3.7.4.post0,<3.9,>=3.6->rasa[full]==3.3.*) (3.0.1)\n", "Requirement already satisfied: multidict<7.0,>=4.5 in /home/students/s444341/.local/lib/python3.9/site-packages (from aiohttp!=3.7.4.post0,<3.9,>=3.6->rasa[full]==3.3.*) (5.2.0)\n", "Requirement already satisfied: six>=1.4.0 in /usr/lib/python3/dist-packages (from apscheduler<3.10,>=3.6->rasa[full]==3.3.*) (1.16.0)\n", "Requirement already satisfied: tzlocal~=2.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from apscheduler<3.10,>=3.6->rasa[full]==3.3.*) (2.1)\n", "Requirement already satisfied: botocore<1.30.0,>=1.29.101 in /home/students/s444341/.local/lib/python3.9/site-packages (from boto3<2.0,>=1.12->rasa[full]==3.3.*) (1.29.101)\n", "Requirement already satisfied: s3transfer<0.7.0,>=0.6.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from boto3<2.0,>=1.12->rasa[full]==3.3.*) (0.6.0)\n", "Requirement already satisfied: jmespath<2.0.0,>=0.7.1 in /home/students/s444341/.local/lib/python3.9/site-packages (from boto3<2.0,>=1.12->rasa[full]==3.3.*) (1.0.1)\n", "Requirement already satisfied: msgpack>=0.5.2 in /home/students/s444341/.local/lib/python3.9/site-packages (from CacheControl<0.13.0,>=0.12.9->rasa[full]==3.3.*) (1.0.5)\n", "Requirement already satisfied: humanfriendly>=9.1 in /home/students/s444341/.local/lib/python3.9/site-packages (from coloredlogs<16,>=10->rasa[full]==3.3.*) (10.0)\n", "Requirement already satisfied: rsa<5,>=3.1.4 in /home/students/s444341/.local/lib/python3.9/site-packages (from google-auth<3->rasa[full]==3.3.*) (4.9)\n", "Requirement already satisfied: pyasn1-modules>=0.2.1 in /home/students/s444341/.local/lib/python3.9/site-packages (from google-auth<3->rasa[full]==3.3.*) (0.2.8)\n", "Requirement already satisfied: cachetools<5.0,>=2.0.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from google-auth<3->rasa[full]==3.3.*) (4.2.4)\n", "Requirement already satisfied: pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0 in /usr/local/lib/python3.9/dist-packages (from jsonschema<4.17,>=3.2->rasa[full]==3.3.*) (0.18.1)\n", "Requirement already satisfied: pyparsing>=2.2.1 in /usr/lib/python3/dist-packages (from matplotlib<3.6,>=3.1->rasa[full]==3.3.*) (2.4.7)\n", "Requirement already satisfied: cycler>=0.10 in /usr/lib/python3/dist-packages (from matplotlib<3.6,>=3.1->rasa[full]==3.3.*) (0.10.0)\n", "Requirement already satisfied: kiwisolver>=1.0.1 in /usr/lib/python3/dist-packages (from matplotlib<3.6,>=3.1->rasa[full]==3.3.*) (1.3.1)\n", "Requirement already satisfied: pillow>=6.2.0 in /usr/lib/python3/dist-packages (from matplotlib<3.6,>=3.1->rasa[full]==3.3.*) (8.1.2)\n", "Requirement already satisfied: wcwidth in /usr/local/lib/python3.9/dist-packages (from prompt-toolkit<3.0.29,>=3.0->rasa[full]==3.3.*) (0.2.5)\n", "Requirement already satisfied: cryptography>=3.4.0 in /usr/local/lib/python3.9/dist-packages (from PyJWT[crypto]<3.0.0,>=2.0.0->rasa[full]==3.3.*) (38.0.1)\n", "Requirement already satisfied: docopt>=0.6.2 in /home/students/s444341/.local/lib/python3.9/site-packages (from pykwalify<1.9,>=1.7->rasa[full]==3.3.*) (0.6.2)\n", "Requirement already satisfied: dnspython<2.0.0,>=1.16.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from pymongo[srv,tls]<3.11,>=3.8->rasa[full]==3.3.*) (1.16.0)\n", "Requirement already satisfied: bidict>=0.21.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from python-socketio<6,>=4.4->rasa[full]==3.3.*) (0.22.1)\n", "Requirement already satisfied: fire in /home/students/s444341/.local/lib/python3.9/site-packages (from randomname<0.2.0,>=0.1.5->rasa[full]==3.3.*) (0.5.0)\n", "Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/local/lib/python3.9/dist-packages (from requests<3.0,>=2.23->rasa[full]==3.3.*) (1.26.12)\n", "Requirement already satisfied: idna<4,>=2.5 in /usr/local/lib/python3.9/dist-packages (from requests<3.0,>=2.23->rasa[full]==3.3.*) (3.4)\n", "Requirement already satisfied: charset-normalizer<3,>=2 in /usr/local/lib/python3.9/dist-packages (from requests<3.0,>=2.23->rasa[full]==3.3.*) (2.1.1)\n", "Requirement already satisfied: ruamel.yaml.clib>=0.1.2 in /usr/local/lib/python3.9/dist-packages (from ruamel.yaml<0.18.0,>=0.16.5->rasa[full]==3.3.*) (0.2.6)\n", "Requirement already satisfied: httptools>=0.0.10 in /home/students/s444341/.local/lib/python3.9/site-packages (from sanic<21.13,>=21.12->rasa[full]==3.3.*) (0.5.0)\n", "Requirement already satisfied: aiofiles>=0.6.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from sanic<21.13,>=21.12->rasa[full]==3.3.*) (23.1.0)\n", "Requirement already satisfied: websockets>=10.0 in /usr/local/lib/python3.9/dist-packages (from sanic<21.13,>=21.12->rasa[full]==3.3.*) (10.3)\n", "Requirement already satisfied: uvloop>=0.5.3 in /home/students/s444341/.local/lib/python3.9/site-packages (from sanic<21.13,>=21.12->rasa[full]==3.3.*) (0.17.0)\n", "\u001b[33mWARNING: sentencepiece 0.1.97 does not provide the extra 'sentencepiece'\u001b[0m\u001b[33m\n", "\u001b[0mRequirement already satisfied: tabulate in /home/students/s444341/.local/lib/python3.9/site-packages (from sklearn-crfsuite<0.4,>=0.3->rasa[full]==3.3.*) (0.9.0)\n", "Requirement already satisfied: python-crfsuite>=0.8.3 in /home/students/s444341/.local/lib/python3.9/site-packages (from sklearn-crfsuite<0.4,>=0.3->rasa[full]==3.3.*) (0.9.9)\n", "Requirement already satisfied: pathy>=0.3.5 in /usr/local/lib/python3.9/dist-packages (from spacy<3.5,>=3.1->rasa[full]==3.3.*) (0.6.2)\n", "Requirement already satisfied: pydantic!=1.8,!=1.8.1,<1.9.0,>=1.7.4 in /home/students/s444341/.local/lib/python3.9/site-packages (from spacy<3.5,>=3.1->rasa[full]==3.3.*) (1.8.2)\n", "Requirement already satisfied: thinc<8.1.0,>=8.0.12 in /home/students/s444341/.local/lib/python3.9/site-packages (from spacy<3.5,>=3.1->rasa[full]==3.3.*) (8.0.17)\n", "Requirement already satisfied: jinja2 in /usr/local/lib/python3.9/dist-packages (from spacy<3.5,>=3.1->rasa[full]==3.3.*) (3.1.2)\n", "Requirement already satisfied: typer<0.5.0,>=0.3.0 in /usr/local/lib/python3.9/dist-packages (from spacy<3.5,>=3.1->rasa[full]==3.3.*) (0.4.2)\n", "Requirement already satisfied: cymem<2.1.0,>=2.0.2 in /usr/local/lib/python3.9/dist-packages (from spacy<3.5,>=3.1->rasa[full]==3.3.*) (2.0.6)\n", "Requirement already satisfied: spacy-legacy<3.1.0,>=3.0.8 in /usr/local/lib/python3.9/dist-packages (from spacy<3.5,>=3.1->rasa[full]==3.3.*) (3.0.10)\n", "Requirement already satisfied: wasabi<1.1.0,>=0.8.1 in /usr/local/lib/python3.9/dist-packages (from spacy<3.5,>=3.1->rasa[full]==3.3.*) (0.10.1)\n", "Requirement already satisfied: blis<0.8.0,>=0.4.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from spacy<3.5,>=3.1->rasa[full]==3.3.*) (0.7.9)\n", "Requirement already satisfied: catalogue<2.1.0,>=2.0.6 in /usr/local/lib/python3.9/dist-packages (from spacy<3.5,>=3.1->rasa[full]==3.3.*) (2.0.8)\n", "Requirement already satisfied: spacy-loggers<2.0.0,>=1.0.0 in /usr/local/lib/python3.9/dist-packages (from spacy<3.5,>=3.1->rasa[full]==3.3.*) (1.0.3)\n", "Requirement already satisfied: smart-open<7.0.0,>=5.2.1 in /usr/local/lib/python3.9/dist-packages (from spacy<3.5,>=3.1->rasa[full]==3.3.*) (5.2.1)\n", "Requirement already satisfied: murmurhash<1.1.0,>=0.28.0 in /usr/local/lib/python3.9/dist-packages (from spacy<3.5,>=3.1->rasa[full]==3.3.*) (1.0.8)\n", "Requirement already satisfied: preshed<3.1.0,>=3.0.2 in /usr/local/lib/python3.9/dist-packages (from spacy<3.5,>=3.1->rasa[full]==3.3.*) (3.0.7)\n", "Requirement already satisfied: langcodes<4.0.0,>=3.2.0 in /usr/local/lib/python3.9/dist-packages (from spacy<3.5,>=3.1->rasa[full]==3.3.*) (3.3.0)\n", "Requirement already satisfied: srsly<3.0.0,>=2.4.1 in /usr/local/lib/python3.9/dist-packages (from spacy<3.5,>=3.1->rasa[full]==3.3.*) (2.4.4)\n", "Requirement already satisfied: greenlet!=0.4.17 in /usr/local/lib/python3.9/dist-packages (from SQLAlchemy<1.5.0,>=1.4.0->rasa[full]==3.3.*) (1.1.3)\n", "Requirement already satisfied: termcolor>=1.1.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorflow<2.9.0,>=2.8.4->rasa[full]==3.3.*) (2.2.0)\n", "Requirement already satisfied: grpcio<2.0,>=1.24.3 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorflow<2.9.0,>=2.8.4->rasa[full]==3.3.*) (1.53.0)\n", "Requirement already satisfied: opt-einsum>=2.3.2 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorflow<2.9.0,>=2.8.4->rasa[full]==3.3.*) (3.3.0)\n", "Collecting tensorflow-estimator<2.9,>=2.8\n", " Using cached tensorflow_estimator-2.8.0-py2.py3-none-any.whl (462 kB)\n", "Requirement already satisfied: tensorflow-io-gcs-filesystem>=0.23.1 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorflow<2.9.0,>=2.8.4->rasa[full]==3.3.*) (0.32.0)\n", "Requirement already satisfied: tensorboard<2.9,>=2.8 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorflow<2.9.0,>=2.8.4->rasa[full]==3.3.*) (2.8.0)\n", "Collecting keras<2.9,>=2.8.0rc0\n", " Using cached keras-2.8.0-py2.py3-none-any.whl (1.4 MB)\n", "Requirement already satisfied: flatbuffers>=1.12 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorflow<2.9.0,>=2.8.4->rasa[full]==3.3.*) (2.0.7)\n", "Requirement already satisfied: h5py>=2.9.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorflow<2.9.0,>=2.8.4->rasa[full]==3.3.*) (3.8.0)\n", "Requirement already satisfied: libclang>=9.0.1 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorflow<2.9.0,>=2.8.4->rasa[full]==3.3.*) (16.0.0)\n", "Requirement already satisfied: keras-preprocessing>=1.1.1 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorflow<2.9.0,>=2.8.4->rasa[full]==3.3.*) (1.1.2)\n", "Requirement already satisfied: astunparse>=1.6.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorflow<2.9.0,>=2.8.4->rasa[full]==3.3.*) (1.6.3)\n", "Requirement already satisfied: wrapt>=1.11.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorflow<2.9.0,>=2.8.4->rasa[full]==3.3.*) (1.15.0)\n", "Requirement already satisfied: google-pasta>=0.1.1 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorflow<2.9.0,>=2.8.4->rasa[full]==3.3.*) (0.2.0)\n", "Requirement already satisfied: gast>=0.2.1 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorflow<2.9.0,>=2.8.4->rasa[full]==3.3.*) (0.4.0)\n", "Requirement already satisfied: typeguard>=2.7 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorflow-addons<0.18.0,>=0.17.0->rasa[full]==3.3.*) (2.13.3)\n", "Requirement already satisfied: tokenizers<0.11,>=0.10.1 in /home/students/s444341/.local/lib/python3.9/site-packages (from transformers<4.14.0,>=4.13.0->rasa[full]==3.3.*) (0.10.3)\n", "Requirement already satisfied: filelock in /usr/lib/python3/dist-packages (from transformers<4.14.0,>=4.13.0->rasa[full]==3.3.*) (3.0.12)\n", "Requirement already satisfied: sacremoses in /home/students/s444341/.local/lib/python3.9/site-packages (from transformers<4.14.0,>=4.13.0->rasa[full]==3.3.*) (0.0.53)\n", "Requirement already satisfied: huggingface-hub<1.0,>=0.1.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from transformers<4.14.0,>=4.13.0->rasa[full]==3.3.*) (0.13.3)\n", "Requirement already satisfied: future in /home/students/s444341/.local/lib/python3.9/site-packages (from webexteamssdk<1.7.0,>=1.1.1->rasa[full]==3.3.*) (0.18.3)\n", "Requirement already satisfied: requests-toolbelt in /home/students/s444341/.local/lib/python3.9/site-packages (from webexteamssdk<1.7.0,>=1.1.1->rasa[full]==3.3.*) (0.10.1)\n", "Requirement already satisfied: pamqp==3.2.1 in /home/students/s444341/.local/lib/python3.9/site-packages (from aiormq~=6.6.3->aio-pika<9.0.0,>=6.7.1->rasa[full]==3.3.*) (3.2.1)\n", "Requirement already satisfied: wheel<1.0,>=0.23.0 in /usr/lib/python3/dist-packages (from astunparse>=1.6.0->tensorflow<2.9.0,>=2.8.4->rasa[full]==3.3.*) (0.34.2)\n", "Requirement already satisfied: cffi>=1.12 in /usr/local/lib/python3.9/dist-packages (from cryptography>=3.4.0->PyJWT[crypto]<3.0.0,>=2.0.0->rasa[full]==3.3.*) (1.15.1)\n", "Requirement already satisfied: locket in /home/students/s444341/.local/lib/python3.9/site-packages (from partd>=0.3.10->dask==2022.2.0->rasa[full]==3.3.*) (1.0.0)\n", "Requirement already satisfied: pyasn1<0.5.0,>=0.4.6 in /home/students/s444341/.local/lib/python3.9/site-packages (from pyasn1-modules>=0.2.1->google-auth<3->rasa[full]==3.3.*) (0.4.8)\n", "Requirement already satisfied: tensorboard-data-server<0.7.0,>=0.6.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorboard<2.9,>=2.8->tensorflow<2.9.0,>=2.8.4->rasa[full]==3.3.*) (0.6.1)\n", "Requirement already satisfied: markdown>=2.6.8 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorboard<2.9,>=2.8->tensorflow<2.9.0,>=2.8.4->rasa[full]==3.3.*) (3.4.3)\n", "Requirement already satisfied: google-auth-oauthlib<0.5,>=0.4.1 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorboard<2.9,>=2.8->tensorflow<2.9.0,>=2.8.4->rasa[full]==3.3.*) (0.4.6)\n", "Requirement already satisfied: tensorboard-plugin-wit>=1.6.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorboard<2.9,>=2.8->tensorflow<2.9.0,>=2.8.4->rasa[full]==3.3.*) (1.8.1)\n", "Requirement already satisfied: werkzeug>=0.11.15 in /home/students/s444341/.local/lib/python3.9/site-packages (from tensorboard<2.9,>=2.8->tensorflow<2.9.0,>=2.8.4->rasa[full]==3.3.*) (2.2.3)\n", "Requirement already satisfied: click<9.0.0,>=7.1.1 in /usr/local/lib/python3.9/dist-packages (from typer<0.5.0,>=0.3.0->spacy<3.5,>=3.1->rasa[full]==3.3.*) (8.1.3)\n", "Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.9/dist-packages (from jinja2->spacy<3.5,>=3.1->rasa[full]==3.3.*) (2.1.1)\n", "Requirement already satisfied: pycparser in /usr/local/lib/python3.9/dist-packages (from cffi>=1.12->cryptography>=3.4.0->PyJWT[crypto]<3.0.0,>=2.0.0->rasa[full]==3.3.*) (2.21)\n", "Requirement already satisfied: requests-oauthlib>=0.7.0 in /home/students/s444341/.local/lib/python3.9/site-packages (from google-auth-oauthlib<0.5,>=0.4.1->tensorboard<2.9,>=2.8->tensorflow<2.9.0,>=2.8.4->rasa[full]==3.3.*) (1.3.1)\n", "Requirement already satisfied: importlib-metadata>=4.4 in /usr/local/lib/python3.9/dist-packages (from markdown>=2.6.8->tensorboard<2.9,>=2.8->tensorflow<2.9.0,>=2.8.4->rasa[full]==3.3.*) (4.12.0)\n", "Requirement already satisfied: zipp>=0.5 in /usr/lib/python3/dist-packages (from importlib-metadata>=4.4->markdown>=2.6.8->tensorboard<2.9,>=2.8->tensorflow<2.9.0,>=2.8.4->rasa[full]==3.3.*) (1.0.0)\n", "Requirement already satisfied: oauthlib>=3.0.0 in /usr/local/lib/python3.9/dist-packages (from requests-oauthlib>=0.7.0->google-auth-oauthlib<0.5,>=0.4.1->tensorboard<2.9,>=2.8->tensorflow<2.9.0,>=2.8.4->rasa[full]==3.3.*) (3.2.1)\n", "Installing collected packages: tensorflow-estimator, keras, tensorflow\n", " Attempting uninstall: tensorflow-estimator\n", " Found existing installation: tensorflow-estimator 2.7.0\n", " Uninstalling tensorflow-estimator-2.7.0:\n", " Successfully uninstalled tensorflow-estimator-2.7.0\n", " Attempting uninstall: keras\n", " Found existing installation: keras 2.7.0\n", " Uninstalling keras-2.7.0:\n", " Successfully uninstalled keras-2.7.0\n", " Attempting uninstall: tensorflow\n", " Found existing installation: tensorflow 2.7.4\n", " Uninstalling tensorflow-2.7.4:\n", " Successfully uninstalled tensorflow-2.7.4\n", "\u001b[33m WARNING: The scripts estimator_ckpt_converter, import_pb_to_tensorboard, saved_model_cli, tensorboard, tf_upgrade_v2, tflite_convert, toco and toco_from_protos are installed in '/home/students/s444341/.local/bin' which is not on PATH.\n", " Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.\u001b[0m\u001b[33m\n", "\u001b[0mSuccessfully installed keras-2.8.0 tensorflow-2.8.4 tensorflow-estimator-2.8.0\n", "--- Logging error ---\n", "Traceback (most recent call last):\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/utils/logging.py\", line 177, in emit\n", " self.console.print(renderable, overflow=\"ignore\", crop=False, style=style)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/console.py\", line 1673, in print\n", " extend(render(renderable, render_options))\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/console.py\", line 1305, in render\n", " for render_output in iter_render:\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/utils/logging.py\", line 134, in __rich_console__\n", " for line in lines:\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/segment.py\", line 249, in split_lines\n", " for segment in segments:\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/console.py\", line 1283, in render\n", " renderable = rich_cast(renderable)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/protocol.py\", line 36, in rich_cast\n", " renderable = cast_method()\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/self_outdated_check.py\", line 130, in __rich__\n", " pip_cmd = get_best_invocation_for_this_pip()\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/utils/entrypoints.py\", line 58, in get_best_invocation_for_this_pip\n", " if found_executable and os.path.samefile(\n", " File \"/usr/lib/python3.9/genericpath.py\", line 101, in samefile\n", " s2 = os.stat(f2)\n", "FileNotFoundError: [Errno 2] No such file or directory: '/usr/bin/pip3.9'\n", "Call stack:\n", " File \"/usr/lib/python3.9/runpy.py\", line 197, in _run_module_as_main\n", " return _run_code(code, main_globals, None,\n", " File \"/usr/lib/python3.9/runpy.py\", line 87, in _run_code\n", " exec(code, run_globals)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/__main__.py\", line 31, in \n", " sys.exit(_main())\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/cli/main.py\", line 70, in main\n", " return command.main(cmd_args)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/cli/base_command.py\", line 101, in main\n", " return self._main(args)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/cli/base_command.py\", line 223, in _main\n", " self.handle_pip_version_check(options)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/cli/req_command.py\", line 190, in handle_pip_version_check\n", " pip_self_version_check(session, options)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/self_outdated_check.py\", line 236, in pip_self_version_check\n", " logger.warning(\"[present-rich] %s\", upgrade_prompt)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 1454, in warning\n", " self._log(WARNING, msg, args, **kwargs)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 1585, in _log\n", " self.handle(record)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 1595, in handle\n", " self.callHandlers(record)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 1657, in callHandlers\n", " hdlr.handle(record)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 948, in handle\n", " self.emit(record)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/utils/logging.py\", line 179, in emit\n", " self.handleError(record)\n", "Message: '[present-rich] %s'\n", "Arguments: (UpgradePrompt(old='22.2.2', new='23.0.1'),)\n", "Note: you may need to restart the kernel to use updated packages.\n" ] } ], "source": [ "pip install rasa[full]==3.3.*" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Importujemy ją." ] }, { "cell_type": "code", "execution_count": 9, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "'3.3.6'" ] }, "execution_count": 9, "metadata": {}, "output_type": "execute_result" } ], "source": [ "import rasa\n", "rasa.__version__" ] }, { "cell_type": "raw", "metadata": {}, "source": [ "Tworzymy nowy projekt we frameworku RASA." ] }, { "cell_type": "code", "execution_count": 10, "metadata": {}, "outputs": [], "source": [ "from rasa.cli.scaffold import create_initial_project\n", "\n", "project_dir = \"Projekt_AE\"\n", "create_initial_project(project_dir)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Przejdź do katalogu." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Definiujemy zmienne dla funckji train, którą będziemy trenować model." ] }, { "cell_type": "code", "execution_count": 11, "metadata": {}, "outputs": [], "source": [ "config = project_dir + \"/config.yml\"\n", "training_files = project_dir + \"/data/\"\n", "domain = project_dir + \"/domain.yml\"\n", "output = project_dir + \"/models/\"" ] }, { "cell_type": "code", "execution_count": 12, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Defaulting to user installation because normal site-packages is not writeable\n", "Requirement already satisfied: pyspark==2.4.* in /home/students/s444341/.local/lib/python3.9/site-packages (2.4.8)\n", "Requirement already satisfied: py4j==0.10.7 in /home/students/s444341/.local/lib/python3.9/site-packages (from pyspark==2.4.*) (0.10.7)\n", "--- Logging error ---\n", "Traceback (most recent call last):\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/utils/logging.py\", line 177, in emit\n", " self.console.print(renderable, overflow=\"ignore\", crop=False, style=style)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/console.py\", line 1673, in print\n", " extend(render(renderable, render_options))\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/console.py\", line 1305, in render\n", " for render_output in iter_render:\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/utils/logging.py\", line 134, in __rich_console__\n", " for line in lines:\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/segment.py\", line 249, in split_lines\n", " for segment in segments:\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/console.py\", line 1283, in render\n", " renderable = rich_cast(renderable)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_vendor/rich/protocol.py\", line 36, in rich_cast\n", " renderable = cast_method()\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/self_outdated_check.py\", line 130, in __rich__\n", " pip_cmd = get_best_invocation_for_this_pip()\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/utils/entrypoints.py\", line 58, in get_best_invocation_for_this_pip\n", " if found_executable and os.path.samefile(\n", " File \"/usr/lib/python3.9/genericpath.py\", line 101, in samefile\n", " s2 = os.stat(f2)\n", "FileNotFoundError: [Errno 2] No such file or directory: '/usr/bin/pip3.9'\n", "Call stack:\n", " File \"/usr/lib/python3.9/runpy.py\", line 197, in _run_module_as_main\n", " return _run_code(code, main_globals, None,\n", " File \"/usr/lib/python3.9/runpy.py\", line 87, in _run_code\n", " exec(code, run_globals)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/__main__.py\", line 31, in \n", " sys.exit(_main())\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/cli/main.py\", line 70, in main\n", " return command.main(cmd_args)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/cli/base_command.py\", line 101, in main\n", " return self._main(args)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/cli/base_command.py\", line 223, in _main\n", " self.handle_pip_version_check(options)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/cli/req_command.py\", line 190, in handle_pip_version_check\n", " pip_self_version_check(session, options)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/self_outdated_check.py\", line 236, in pip_self_version_check\n", " logger.warning(\"[present-rich] %s\", upgrade_prompt)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 1454, in warning\n", " self._log(WARNING, msg, args, **kwargs)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 1585, in _log\n", " self.handle(record)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 1595, in handle\n", " self.callHandlers(record)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 1657, in callHandlers\n", " hdlr.handle(record)\n", " File \"/usr/lib/python3.9/logging/__init__.py\", line 948, in handle\n", " self.emit(record)\n", " File \"/usr/local/lib/python3.9/dist-packages/pip/_internal/utils/logging.py\", line 179, in emit\n", " self.handleError(record)\n", "Message: '[present-rich] %s'\n", "Arguments: (UpgradePrompt(old='22.2.2', new='23.0.1'),)\n", "Note: you may need to restart the kernel to use updated packages.\n" ] } ], "source": [ "pip install pyspark==2.4.*" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Nareszcie, uczymy model:" ] }, { "cell_type": "code", "execution_count": 15, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "\u001b[94mThe configuration for policies and pipeline was chosen automatically. It was written into the config file at 'Projekt_AE/config.yml'.\u001b[0m\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "Processed story blocks: 100%|██████████| 2/2 [00:00<00:00, 466.84it/s, # trackers=1]\n", "Processed story blocks: 100%|██████████| 2/2 [00:00<00:00, 1114.47it/s, # trackers=1]\n", "Processed story blocks: 100%|██████████| 2/2 [00:00<00:00, 812.85it/s, # trackers=2]\n", "Processed story blocks: 100%|██████████| 2/2 [00:00<00:00, 454.27it/s, # trackers=3]\n", "Processed rules: 100%|██████████| 2/2 [00:00<00:00, 1263.73it/s, # trackers=1]\n", "Processed trackers: 100%|██████████| 1/1 [00:00<00:00, 212.46it/s, # action=5]\n", "Processed actions: 5it [00:00, 1242.76it/s, # examples=5]\n", "Processed trackers: 100%|██████████| 1/1 [00:00<00:00, 428.03it/s, # action=3]\n", "Processed actions: 3it [00:00, 2160.16it/s, # examples=2]\n", "Processed trackers: 100%|██████████| 1/1 [00:00<00:00, 209.80it/s, # action=5]\n", "Processed trackers: 100%|██████████| 1/1 [00:00<00:00, 813.01it/s]\n", "Processed trackers: 100%|██████████| 2/2 [00:00<00:00, 1010.43it/s]\n", "Processed trackers: 100%|██████████| 4/4 [00:00<00:00, 353.71it/s, # action=9]\n", "Epochs: 100%|██████████| 100/100 [00:13<00:00, 7.39it/s, t_loss=0.181, loss=0.0286, acc=1]\n", "Processed trackers: 100%|██████████| 4/4 [00:00<00:00, 1050.81it/s, # intent=5]\n", "Epochs: 100%|██████████| 100/100 [00:13<00:00, 7.37it/s, t_loss=0.124, loss=0.00663, acc=1] \n", "/home/students/s444341/.local/lib/python3.9/site-packages/rasa/core/policies/unexpected_intent_policy.py:839: DeprecationWarning: the `interpolation=` argument to quantile was renamed to `method=`, which has additional options.\n", "Users of the modes 'nearest', 'lower', 'higher', or 'midpoint' are encouraged to review the method they used. (Deprecated NumPy 1.22)\n", " quantile_values = np.quantile( # type: ignore[call-overload]\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "\u001b[92mYour Rasa model is trained and saved at 'Projekt_AE/models/20230329-182617-upbeat-aggregate.tar.gz'.\u001b[0m\n" ] } ], "source": [ "model = rasa.train(domain, config, [training_files], output)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Wypisz ścieżkę do modelu:" ] }, { "cell_type": "code", "execution_count": 16, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "TrainingResult(model='Projekt_AE/models/20230329-182617-upbeat-aggregate.tar.gz', code=0, dry_run_results=None)\n" ] } ], "source": [ "print(model)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Przeklej ścieżkę i porozmawiaj ze swoim botem:" ] }, { "cell_type": "code", "execution_count": 18, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "WARNING:tensorflow:5 out of the last 104 calls to .train_function at 0x7fb4ff636b80> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has experimental_relax_shapes=True option that relaxes argument shapes that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.\n", "WARNING:tensorflow:6 out of the last 105 calls to .train_function at 0x7fb4fe085820> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has experimental_relax_shapes=True option that relaxes argument shapes that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for more details.\n", "Your bot is ready to talk! Type your messages here or send '/stop'.\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ " Hi\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "\u001b[92mHey! How are you?\u001b[0m\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ " Good, are you tired?\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "\u001b[92mI'm very tired, how are you?\u001b[0m\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ " /stop\n" ] } ], "source": [ "from rasa.jupyter import chat\n", "from rasa.core.utils import read_endpoints_from_path\n", "# do ścieżki modelu wklej ścieżkę, która została zwrócona w poprzednim kroku\n", "model_path = model.model\n", "endpoints = read_endpoints_from_path(project_dir + \"/endpoints.yml\")\n", "chat(model_path, endpoints)" ] }, { "attachments": {}, "cell_type": "markdown", "metadata": {}, "source": [ "Możliwości naszego Chatbota są mocno ograniczone - potrafi się przywitać i pożegnać oraz rozpoznać podstawowe emocje. Spróbujmy nauczyć go czegoś nowego. Wejdź na https://github.com/RasaHQ/NLU-training-data/blob/main/mood/nlu.yml\n", "\n", "\n", "Skopiuj plik nlu.yml dla kategorii \"mood\". Przekopiuj jego treść do pliku nlu.yml w swoim folderze projektu (folder data).\n", "\n", "\n", "Następnie dodaj (ręcznie) odpowiednie stories w pliku stories.yml.\n", "\n", "\n", "Przejdź do pliku domain i dodaj nowe elementy, np. \"mood_nervous\" oraz \"utter_foo_bar\".\n", "\n", "\n", "Wejdź do folderu projektu i usuń stworzony model.\n", "\n", "\n", "Ponownie naucz swojego bota i z nim porozmawiaj. Zapytaj o nowo dodane emocje. (Konieczny może być restart kernela)\n", "\n", "```\n", "Pliki z własnymi, prostymi zasadami są umieszczone na repozytorium \n", "https://git.wmi.amu.edu.pl/s444341/Sztuczna_empatia\n", "```" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Poniżej zamieszczona jest funkcja, która zbiera wszystkie pliki yml z nlu, stories i rules, oraz wrzuca je do dwóch tymczasowych katalogów." ] }, { "cell_type": "code", "execution_count": 19, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Projekt_AE/data/stories.yml Projekt_AE/data/nlu.yml\n" ] } ], "source": [ "nlu_data_directory = f'{project_dir}/data/nlu.yml'\n", "stories_directory = f'{project_dir}/data/stories.yml'\n", "print(stories_directory, nlu_data_directory)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Aby przetestować model, wywułaj funkcję call:" ] }, { "cell_type": "code", "execution_count": 24, "metadata": {}, "outputs": [], "source": [ "rasa.test(model_path, stories_directory, nlu_data_directory)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Błędy NLU są eksportowane do errors.json." ] }, { "cell_type": "code", "execution_count": 25, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Brak bledow NLU.\n" ] } ], "source": [ "import os\n", "if os.path.isfile(\"errors.json\"):\n", " print(\"Bledy NLU:\")\n", " print(open(\"errors.json\").read())\n", "else:\n", " print(\"Brak bledow NLU.\")\n", "\n", "if os.path.isdir(\"results\"):\n", " print(\"\\n\")\n", " print(\"Core Errors:\")\n", " print(open(\"results/failed_test_stories.yml\").read())" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### Źródła:\n", "
\n", "[1] https://rasa.com/docs/rasa/jupyter-notebooks/\n", "\n", "[2] Yalçın, Ö. (2020). Empathy framework for embodied conversational agents. Cognitive Systems Research, 59, 123-132.\n", "\n", "[3] https://www.ibm.com/cloud/learn/natural-language-processing?mhsrc=ibmsearch_a&mhq=natural%20language\n", "\n", "[4] https://sloboda-studio.com/blog/how-to-use-nlp-for-building-a-chatbot/\n", "\n", "[5] Grosuleac, A., Budulan, S., & Rebedea, T. (2020). Seeking an Empathy-abled Conversational Agent. RoCHI.\n", "\n", "[6] Ӧzge Nilay Yalcin, Steve DiPaola, 2018, A computational model of empathy for interactive agents,\n", "Biologically Inspired Cognitive Architectures, Volume 26, pp. 20-25, DOI: doi.org/10.1016/j.bica.2018.07.010.\n", "\n", "[7] Fung, P., Bertero, D., Xu, P., Park, J.H., Wu, C., & Madotto, A. (2018). Empathetic Dialog Systems.\n", "\n", "[8] Wei, W., Liu, J., Mao, X., Guo, G., Zhu, F., Zhou, P., & Hu, Y. (2019). Emotion-aware Chat Machine: Automatic Emotional Response Generation for Human-like Emotional Interaction. Proceedings of the 28th ACM International Conference on Information and Knowledge Management.\n", "\n", "[9] Li, Q., Chen, H., Ren, Z., Chen, Z., Tu, Z., & Ma, J. (2020). EmpDG: Multi-resolution Interactive Empathetic Dialogue Generation. COLING.\n", "\n", "[10] Rashkin, H., Smith, E.M., Li, M., & Boureau, Y. (2019). Towards Empathetic Open-domain Conversation Models: A New Benchmark and Dataset. ACL.\n", "\n", "[11] Ghandeharioun, A., Shen, J.H., Jaques, N., Ferguson, C., Jones, N.J., Lapedriza, À., & Picard, R.W. (2019). Approximating Interactive Human Evaluation with Self-Play for Open-Domain Dialog Systems. NeurIPS.\n", "\n", "[12] Ma, Y., Nguyen, K.L., Xing, F.Z., & Cambria, E. (2020). A survey on empathetic dialogue systems. Inf. Fusion, 64, 50-70.\n", "\n", "[13] Paiva, A., Leite, I., Boukricha, H., & Wachsmuth, I. (2017). Empathy in Virtual Agents and Robots. ACM Transactions on Interactive Intelligent Systems (TiiS), 7, 1 - 40.\n", "\n", "[14] https://forum.rasa.com/t/how-to-run-custom-action-in-jupyter-notebook/17109/5\n", "\n", "[15] https://towardsdatascience.com/5-reasons-why-your-chatbot-needs-natural-language-processing-ed20fb0a3655\n", "\n", "[16] https://www.ultimate.ai/blog/ai-automation/how-nlp-text-based-chatbots-work" ] } ], "metadata": { "author": "Joanna Siwek", "email": "jsiwek@amu.edu.pl", "kernelspec": { "display_name": "Python 3 (ipykernel)", "language": "python", "name": "python3" }, "lang": "pl", "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.9.2" }, "subtitle": "4. Empatia w systemach dialogowych", "title": "Sztuczna empatia", "year": "2021" }, "nbformat": 4, "nbformat_minor": 4 }