Try to execute a simple example from wiki doc #61

zikapanam · 2023-06-01T09:51:59Z

zikapanam
Jun 1, 2023

Hello,

Thx for all this work. It is impressive !

I'm new to AI and I'm eager to make it work and try to converse with the AI using quickai.

I hope you can help me.

I've this python code:

from quickai import gpt_neo
while True:
    message = input("Veuillez saisir un message : ")
    if message == "quit":
        break
    generated_text = gpt_neo(message, "2.7B")
    print(generated_text)

Also it's not clear to me what i have to do to install gptneo.

I git clone quickai and run

pip install -r requirements.txt 
Defaulting to user installation because normal site-packages is not writeable
Collecting git+https://github.com/huggingface/transformers (from -r requirements.txt (line 3))
  Cloning https://github.com/huggingface/transformers to /tmp/pip-req-build-ohjddw9t
  Running command git clone --filter=blob:none --quiet https://github.com/huggingface/transformers /tmp/pip-req-build-ohjddw9t
  Resolved https://github.com/huggingface/transformers to commit fabe17a726bbf6081cfbcc975d8ac451a81f3e2d
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
  Preparing metadata (pyproject.toml) ... done
Requirement already satisfied: torch in /home/zap/.local/lib/python3.10/site-packages (from -r requirements.txt (line 1)) (2.0.1)
Requirement already satisfied: torchvision in /home/zap/.local/lib/python3.10/site-packages (from -r requirements.txt (line 2)) (0.15.2)
Requirement already satisfied: numpy~=1.22.0rc1 in /home/zap/.local/lib/python3.10/site-packages (from -r requirements.txt (line 4)) (1.22.4)
Requirement already satisfied: scikit-learn~=0.24.1 in /home/zap/.local/lib/python3.10/site-packages (from -r requirements.txt (line 5)) (0.24.2)
Requirement already satisfied: matplotlib~=3.4.1 in /home/zap/.local/lib/python3.10/site-packages (from -r requirements.txt (line 6)) (3.4.3)
Requirement already satisfied: coremltools in /home/zap/.local/lib/python3.10/site-packages (from -r requirements.txt (line 7)) (6.3.0)
Requirement already satisfied: pillow>=8.3.2 in /home/zap/.local/lib/python3.10/site-packages (from -r requirements.txt (line 8)) (9.5.0)
Requirement already satisfied: protobuf>=3.20.2 in /home/zap/.local/lib/python3.10/site-packages (from -r requirements.txt (line 9)) (3.20.3)
Requirement already satisfied: wheel>=0.38.0 in /home/zap/.local/lib/python3.10/site-packages (from -r requirements.txt (line 10)) (0.40.0)
Requirement already satisfied: setuptools>=65.5.1 in /home/zap/.local/lib/python3.10/site-packages (from -r requirements.txt (line 11)) (67.8.0)
Requirement already satisfied: filelock in /home/zap/.local/lib/python3.10/site-packages (from torch->-r requirements.txt (line 1)) (3.12.0)
Requirement already satisfied: typing-extensions in /home/zap/.local/lib/python3.10/site-packages (from torch->-r requirements.txt (line 1)) (4.6.2)
Requirement already satisfied: sympy in /home/zap/.local/lib/python3.10/site-packages (from torch->-r requirements.txt (line 1)) (1.12)
Requirement already satisfied: networkx in /usr/local/lib/python3.10/dist-packages (from torch->-r requirements.txt (line 1)) (3.0)
Requirement already satisfied: jinja2 in /home/zap/.local/lib/python3.10/site-packages (from torch->-r requirements.txt (line 1)) (3.1.2)
Requirement already satisfied: nvidia-cuda-nvrtc-cu11==11.7.99 in /home/zap/.local/lib/python3.10/site-packages (from torch->-r requirements.txt (line 1)) (11.7.99)
Requirement already satisfied: nvidia-cuda-runtime-cu11==11.7.99 in /home/zap/.local/lib/python3.10/site-packages (from torch->-r requirements.txt (line 1)) (11.7.99)
Requirement already satisfied: nvidia-cuda-cupti-cu11==11.7.101 in /home/zap/.local/lib/python3.10/site-packages (from torch->-r requirements.txt (line 1)) (11.7.101)
Requirement already satisfied: nvidia-cudnn-cu11==8.5.0.96 in /home/zap/.local/lib/python3.10/site-packages (from torch->-r requirements.txt (line 1)) (8.5.0.96)
Requirement already satisfied: nvidia-cublas-cu11==11.10.3.66 in /home/zap/.local/lib/python3.10/site-packages (from torch->-r requirements.txt (line 1)) (11.10.3.66)
Requirement already satisfied: nvidia-cufft-cu11==10.9.0.58 in /home/zap/.local/lib/python3.10/site-packages (from torch->-r requirements.txt (line 1)) (10.9.0.58)
Requirement already satisfied: nvidia-curand-cu11==10.2.10.91 in /home/zap/.local/lib/python3.10/site-packages (from torch->-r requirements.txt (line 1)) (10.2.10.91)
Requirement already satisfied: nvidia-cusolver-cu11==11.4.0.1 in /home/zap/.local/lib/python3.10/site-packages (from torch->-r requirements.txt (line 1)) (11.4.0.1)
Requirement already satisfied: nvidia-cusparse-cu11==11.7.4.91 in /home/zap/.local/lib/python3.10/site-packages (from torch->-r requirements.txt (line 1)) (11.7.4.91)
Requirement already satisfied: nvidia-nccl-cu11==2.14.3 in /home/zap/.local/lib/python3.10/site-packages (from torch->-r requirements.txt (line 1)) (2.14.3)
Requirement already satisfied: nvidia-nvtx-cu11==11.7.91 in /home/zap/.local/lib/python3.10/site-packages (from torch->-r requirements.txt (line 1)) (11.7.91)
Requirement already satisfied: triton==2.0.0 in /home/zap/.local/lib/python3.10/site-packages (from torch->-r requirements.txt (line 1)) (2.0.0)
Requirement already satisfied: cmake in /home/zap/.local/lib/python3.10/site-packages (from triton==2.0.0->torch->-r requirements.txt (line 1)) (3.26.3)
Requirement already satisfied: lit in /home/zap/.local/lib/python3.10/site-packages (from triton==2.0.0->torch->-r requirements.txt (line 1)) (16.0.5)
Requirement already satisfied: requests in /usr/lib/python3/dist-packages (from torchvision->-r requirements.txt (line 2)) (2.25.1)
Requirement already satisfied: huggingface-hub<1.0,>=0.14.1 in /home/zap/.local/lib/python3.10/site-packages (from transformers==4.30.0.dev0->-r requirements.txt (line 3)) (0.14.1)
Requirement already satisfied: packaging>=20.0 in /usr/lib/python3/dist-packages (from transformers==4.30.0.dev0->-r requirements.txt (line 3)) (21.3)
Requirement already satisfied: pyyaml>=5.1 in /usr/lib/python3/dist-packages (from transformers==4.30.0.dev0->-r requirements.txt (line 3)) (5.4.1)
Requirement already satisfied: regex!=2019.12.17 in /home/zap/.local/lib/python3.10/site-packages (from transformers==4.30.0.dev0->-r requirements.txt (line 3)) (2023.5.5)
Requirement already satisfied: tokenizers!=0.11.3,<0.14,>=0.11.1 in /home/zap/.local/lib/python3.10/site-packages (from transformers==4.30.0.dev0->-r requirements.txt (line 3)) (0.13.3)
Requirement already satisfied: safetensors>=0.3.1 in /home/zap/.local/lib/python3.10/site-packages (from transformers==4.30.0.dev0->-r requirements.txt (line 3)) (0.3.1)
Requirement already satisfied: tqdm>=4.27 in /usr/local/lib/python3.10/dist-packages (from transformers==4.30.0.dev0->-r requirements.txt (line 3)) (4.65.0)
Requirement already satisfied: scipy>=0.19.1 in /usr/local/lib/python3.10/dist-packages (from scikit-learn~=0.24.1->-r requirements.txt (line 5)) (1.10.1)
Requirement already satisfied: joblib>=0.11 in /home/zap/.local/lib/python3.10/site-packages (from scikit-learn~=0.24.1->-r requirements.txt (line 5)) (1.2.0)
Requirement already satisfied: threadpoolctl>=2.0.0 in /home/zap/.local/lib/python3.10/site-packages (from scikit-learn~=0.24.1->-r requirements.txt (line 5)) (3.1.0)
Requirement already satisfied: cycler>=0.10 in /home/zap/.local/lib/python3.10/site-packages (from matplotlib~=3.4.1->-r requirements.txt (line 6)) (0.11.0)
Requirement already satisfied: kiwisolver>=1.0.1 in /home/zap/.local/lib/python3.10/site-packages (from matplotlib~=3.4.1->-r requirements.txt (line 6)) (1.4.4)
Requirement already satisfied: pyparsing>=2.2.1 in /usr/lib/python3/dist-packages (from matplotlib~=3.4.1->-r requirements.txt (line 6)) (2.4.7)
Requirement already satisfied: python-dateutil>=2.7 in /usr/lib/python3/dist-packages (from matplotlib~=3.4.1->-r requirements.txt (line 6)) (2.8.1)
Requirement already satisfied: fsspec in /home/zap/.local/lib/python3.10/site-packages (from huggingface-hub<1.0,>=0.14.1->transformers==4.30.0.dev0->-r requirements.txt (line 3)) (2023.5.0)
Requirement already satisfied: MarkupSafe>=2.0 in /home/zap/.local/lib/python3.10/site-packages (from jinja2->torch->-r requirements.txt (line 1)) (2.1.2)
Requirement already satisfied: mpmath>=0.19 in /home/zap/.local/lib/python3.10/site-packages (from sympy->torch->-r requirements.txt (line 1)) (1.3.0)

All seems ok

I get the docker :

docker pull geekjr/quickai
Using default tag: latest
latest: Pulling from geekjr/quickai
Digest: sha256:55d571e64249f5153ce351743da6893094f573f43ba8c7ba23315b5450b29abe
Status: Image is up to date for geekjr/quickai:latest
docker.io/geekjr/quickai:latest

I run it using the given command :
docker run -it ufoym/deepo:cpu bash

when i ran the other option :

docker run --gpus all -it ufoym/deepo bash
Unable to find image 'ufoym/deepo:latest' locally
latest: Pulling from ufoym/deepo
7b1a6ab2e44d: Pull complete 
e5463b2e9adf: Pull complete 
ed2316ffaa06: Pull complete 
31bb16b40717: Pull complete 
904b9c02b731: Pull complete 
6f00cb6bdad5: Pull complete 
f66e480af366: Pull complete 
10716515766f: Pull complete 
4422d8a6c792: Pull complete 
95734c6571c8: Pull complete 
00f7ad0c439f: Pull complete 
Digest: sha256:d69aac9284f3198ee205ba4b848193a7db9c0e6e789f1eb7307ba0ac4b6bf4f8
Status: Downloaded newer image for ufoym/deepo:latest
docker: Error response from daemon: could not select device driver "" with capabilities: [[gpu]].
ERRO[0201] error waiting for container:

and run my python script and get this message :

python3 q_and_a-chat-quickai.py 
2023-06-01 11:38:09.239717: I tensorflow/core/util/port.cc:110] oneDNN custom operations are on. You may see slightly different numerical results due to floating-point round-off errors from different computation orders. To turn them off, set the environment variable `TF_ENABLE_ONEDNN_OPTS=0`.
2023-06-01 11:38:09.241927: I tensorflow/tsl/cuda/cudart_stub.cc:28] Could not find cuda drivers on your machine, GPU will not be used.
2023-06-01 11:38:09.287460: I tensorflow/tsl/cuda/cudart_stub.cc:28] Could not find cuda drivers on your machine, GPU will not be used.
2023-06-01 11:38:09.287829: I tensorflow/core/platform/cpu_feature_guard.cc:182] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.
To enable the following instructions: AVX2 AVX512F AVX512_VNNI FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.
2023-06-01 11:38:10.044999: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT
RuntimeError: module compiled against API version 0x10 but this version of numpy is 0xf
Traceback (most recent call last):
  File "/var/www/zap/docker/quickai/q_and_a-chat-quickai.py", line 1, in <module>
    from quickai import gpt_neo
  File "/home/zap/.local/lib/python3.10/site-packages/quickai/__init__.py", line 5, in <module>
    from .image_classification import ImageClassification, ImageClassificationPredictor
  File "/home/zap/.local/lib/python3.10/site-packages/quickai/image_classification.py", line 12, in <module>
    import matplotlib.pyplot as plt
  File "/home/zap/.local/lib/python3.10/site-packages/matplotlib/__init__.py", line 107, in <module>
    from . import _api, cbook, docstring, rcsetup
  File "/home/zap/.local/lib/python3.10/site-packages/matplotlib/rcsetup.py", line 26, in <module>
    from matplotlib.colors import Colormap, is_color_like
  File "/home/zap/.local/lib/python3.10/site-packages/matplotlib/colors.py", line 82, in <module>
    from matplotlib import _api, cbook, scale
  File "/home/zap/.local/lib/python3.10/site-packages/matplotlib/scale.py", line 18, in <module>
    from matplotlib.ticker import (
  File "/home/zap/.local/lib/python3.10/site-packages/matplotlib/ticker.py", line 179, in <module>
    from matplotlib import transforms as mtransforms
  File "/home/zap/.local/lib/python3.10/site-packages/matplotlib/transforms.py", line 46, in <module>
    from matplotlib._path import (
ImportError: numpy.core.multiarray failed to import

I tried to build the docker image but i ran into errors :

docker build ./ -t zap-bot-quickai
--------------------
ERROR: failed to solve: process "/bin/sh -c APT_INSTALL=\"apt-get install -y --no-install-recommends\" &&     PIP_INSTALL=\"python -m pip --no-cache-dir install --upgrade\" &&     GIT_CLONE=\"git clone --depth 10\" &&     rm -rf /var/lib/apt/lists/*     /etc/apt/sources.list.d/cuda.list     /etc/apt/sources.list.d/nvidia-ml.list &&     apt-get update &&     DEBIAN_FRONTEND=noninteractive $APT_INSTALL     build-essential     apt-utils     ca-certificates     wget     git     vim     libssl-dev     curl     unzip     unrar     &&     $GIT_CLONE https://github.com/Kitware/CMake ~/cmake &&     cd ~/cmake &&     ./bootstrap &&     make -j\"$(nproc)\" install &&     DEBIAN_FRONTEND=noninteractive $APT_INSTALL     software-properties-common     &&     add-apt-repository ppa:deadsnakes/ppa &&     apt-get update &&     DEBIAN_FRONTEND=noninteractive $APT_INSTALL     python3.7     python3.7-dev     python3-distutils-extra     &&     wget -O ~/get-pip.py     https://bootstrap.pypa.io/get-pip.py &&     python3.7 ~/get-pip.py &&     ln -s /usr/bin/python3.7 /usr/local/bin/python3 &&     ln -s /usr/bin/python3.7 /usr/local/bin/python &&     $PIP_INSTALL     setuptools     &&     $PIP_INSTALL     numpy     scipy     pandas     cloudpickle     scikit-image>=0.14.2     scikit-learn     matplotlib     Cython     tqdm     &&     DEBIAN_FRONTEND=noninteractive $APT_INSTALL     sudo     &&     $GIT_CLONE https://github.com/nagadomi/distro.git ~/torch --recursive &&     cd ~/torch &&     bash install-deps &&     sed -i 's/${THIS_DIR}\\/install/\\/usr\\/local/g' ./install.sh &&     ./install.sh &&     $PIP_INSTALL     future     numpy     protobuf     enum34     pyyaml     typing     &&     $PIP_INSTALL     --pre torch torchvision -f     https://download.pytorch.org/whl/nightly/cpu/torch_nightly.html     &&     $PIP_INSTALL     tensorflow     &&     $PIP_INSTALL     transformers     opencv-python     quickai     &&     ldconfig &&     apt-get clean &&     apt-get autoremove &&     rm -rf /var/lib/apt/lists/* /tmp/* ~/*" did not complete successfully: exit code: 1

I'm probably doing something wrong ... Can you help me ?

BR,
Laurent

geekjr · 2023-06-01T14:34:48Z

geekjr
Jun 1, 2023
Maintainer

HI,

What are the specs of your computer? Also, what is your operating system+version, python version, and Numpy version?

0 replies

zikapanam · 2023-06-01T14:54:10Z

zikapanam
Jun 1, 2023
Author

Hi,

I use Ubuntu Linux 22.04,
from uname -a
5.15.0-72-lowlatency #79-Ubuntu SMP PREEMPT Thu Apr 20 12:16:31 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

from pip install numpy
Requirement already satisfied: numpy in /.local/lib/python3.10/site-packages (1.22.4)

Python 3.10.6

EDIT:
My graphical card is Mesa Intel® Graphics (RKL GT1)

0 replies

geekjr · 2023-06-01T17:57:02Z

geekjr
Jun 1, 2023
Maintainer

Ok. So you seem to be doing both set up procedures, when you need to only do 1. You need either Docker or Pip setup.

Try running a these commands (for a docker CPU setup) and please report back what happens:

docker pull geekjr/quickai

docker run -it ufoym/deepo:cpu bash

0 replies

zikapanam · 2023-06-01T21:18:07Z

zikapanam
Jun 1, 2023
Author

$ docker pull geekjr/quickai
Using default tag: latest
latest: Pulling from geekjr/quickai
Digest: sha256:55d571e64249f5153ce351743da6893094f573f43ba8c7ba23315b5450b29abe
Status: Image is up to date for geekjr/quickai:latest
docker.io/geekjr/quickai:latest

$ docker run -it ufoym/deepo:cpu bash
root@4b59488a04e2:/#

It works. I get a root prompt inside the docker after running it but i don't know what i'm supposed to do once there ?

Do i have to put my python file in the Dockerfile or should i set a docker port to use in the quickai API ?

Thx for your advice and your time.

BR,
Laurent

0 replies

geekjr · 2023-06-02T11:47:08Z

geekjr
Jun 2, 2023
Maintainer

Perfect! So you should get your python file and dataset inside the docker container(see below). The docker container is self contained, and should have all the dependencies in it. Once you put the data and python file in docker container, you execute the python script from that bash prompt. If I remember correctly, within the docker container, there is a path you can access local files from. Try running the container with the -v flag. Then, the file and data should be at the path inside container.

-v /path/on/host:/path/inside/container

0 replies

zikapanam · 2023-06-02T12:54:19Z

zikapanam
Jun 2, 2023
Author

$ docker run -v ./userapp:/userapp -it ufoym/deepo:cpu bash
root@3f42e467a2f2:/# cd userapp/
root@3f42e467a2f2:/userapp# ls
q_and_a_quickai.py  zapapp-quickai-prompt.md
root@3f42e467a2f2:/userapp# python3 q_and_a_quickai.py 
Traceback (most recent call last):
  File "q_and_a_quickai.py", line 2, in <module>
    from quickai import q_and_a
ModuleNotFoundError: No module named 'quickai'
root@3f42e467a2f2:/userapp#

Any ideas ?.

0 replies

geekjr · 2023-06-02T12:59:22Z

geekjr
Jun 2, 2023
Maintainer

Hmm that's strange. Can you try running which python in docker?

0 replies

zikapanam · 2023-06-02T14:16:53Z

zikapanam
Jun 2, 2023
Author

$ docker run -v ./userapp:/userapp -it ufoym/deepo:cpu bash
root@6233d91852b8:/# which python3
/usr/bin/python3
root@6233d91852b8:/# python3 --version
Python 3.8.10
root@6233d91852b8:/#

0 replies

zikapanam · 2023-06-02T14:18:21Z

zikapanam
Jun 2, 2023
Author

I already tried to install quickai in the image but it returned me an error.

0 replies

geekjr · 2023-06-02T14:20:02Z

geekjr
Jun 2, 2023
Maintainer

Try running pip3 list and pip list in docker.

0 replies

zikapanam · 2023-06-02T14:20:57Z

zikapanam
Jun 2, 2023
Author

$ docker run -v ./userapp:/userapp -it ufoym/deepo:cpu bash
root@4e45befdddbe:/# pip list
Package                      Version
---------------------------- ----------------------
absl-py                      1.0.0
anyio                        3.5.0
argon2-cffi                  21.3.0
argon2-cffi-bindings         21.2.0
astor                        0.8.1
asttokens                    2.0.5
astunparse                   1.6.3
attrs                        21.4.0
Babel                        2.9.1
backcall                     0.2.0
beautifulsoup4               4.10.0
bleach                       4.1.0
cachetools                   5.0.0
certifi                      2021.10.8
cffi                         1.15.0
chainer                      7.8.1
charset-normalizer           2.0.12
cycler                       0.11.0
Cython                       0.29.28
debugpy                      1.6.0
decorator                    5.1.1
defusedxml                   0.7.1
entrypoints                  0.4
enum34                       1.1.10
executing                    0.8.3
filelock                     3.6.0
flatbuffers                  2.0
fonttools                    4.31.2
future                       0.18.2
gast                         0.5.3
google-auth                  2.6.2
google-auth-oauthlib         0.4.6
google-pasta                 0.2.0
graphviz                     0.8.4
grpcio                       1.44.0
h5py                         3.6.0
idna                         3.3
imageio                      2.16.1
importlib-metadata           4.11.3
importlib-resources          5.6.0
ipykernel                    6.10.0
ipython                      8.2.0
ipython-genutils             0.2.0
ipywidgets                   7.7.0
jedi                         0.18.1
Jinja2                       3.1.1
joblib                       1.1.0
json5                        0.9.6
jsonschema                   4.4.0
jupyter                      1.0.0
jupyter-client               7.2.0
jupyter-console              6.4.3
jupyter-core                 4.9.2
jupyter-server               1.16.0
jupyterlab                   3.3.2
jupyterlab-pygments          0.1.2
jupyterlab-server            2.12.0
jupyterlab-widgets           1.1.0
keras                        2.8.0
Keras-Preprocessing          1.1.2
kiwisolver                   1.4.2
libclang                     13.0.0
Markdown                     3.3.6
MarkupSafe                   2.1.1
matplotlib                   3.5.1
matplotlib-inline            0.1.3
mistune                      0.8.4
mxnet                        1.9.0
nbclassic                    0.3.7
nbclient                     0.5.13
nbconvert                    6.4.5
nbformat                     5.2.0
nest-asyncio                 1.5.4
networkx                     2.7.1
notebook                     6.4.10
notebook-shim                0.1.0
numpy                        1.22.3
oauthlib                     3.2.0
onnx                         1.11.0
onnxruntime                  1.11.0
opt-einsum                   3.3.0
packaging                    21.3
paddlepaddle                 2.2.2
pandas                       1.4.1
pandocfilters                1.5.0
parso                        0.8.3
pexpect                      4.8.0
pickleshare                  0.7.5
Pillow                       9.0.1
pip                          22.0.4
prometheus-client            0.13.1
prompt-toolkit               3.0.28
protobuf                     3.19.4
psutil                       5.9.0
ptyprocess                   0.7.0
pure-eval                    0.2.2
pyasn1                       0.4.8
pyasn1-modules               0.2.8
pycparser                    2.21
Pygments                     2.11.2
pyparsing                    3.0.7
pyrsistent                   0.18.1
python-dateutil              2.8.2
pytz                         2022.1
PyWavelets                   1.3.0
PyYAML                       6.0
pyzmq                        22.3.0
qtconsole                    5.3.0
QtPy                         2.0.1
requests                     2.27.1
requests-oauthlib            1.3.1
rsa                          4.8
scikit-image                 0.19.2
scikit-learn                 1.0.2
scipy                        1.8.0
Send2Trash                   1.8.0
setuptools                   61.2.0
six                          1.16.0
sniffio                      1.2.0
soupsieve                    2.3.1
stack-data                   0.2.0
tensorboard                  2.8.0
tensorboard-data-server      0.6.1
tensorboard-plugin-wit       1.8.1
tensorflow                   2.8.0
tensorflow-io-gcs-filesystem 0.24.0
termcolor                    1.1.0
terminado                    0.13.3
testpath                     0.6.0
tf-estimator-nightly         2.8.0.dev2021122109
threadpoolctl                3.1.0
tifffile                     2022.3.25
torch                        1.12.0.dev20220327+cpu
torchaudio                   0.12.0.dev20220327+cpu
torchvision                  0.13.0.dev20220327+cpu
tornado                      6.1
tqdm                         4.63.1
traitlets                    5.1.1
typing                       3.7.4.3
typing_extensions            4.1.1
urllib3                      1.26.9
wcwidth                      0.2.5
webencodings                 0.5.1
websocket-client             1.3.2
Werkzeug                     2.1.0
wheel                        0.37.1
widgetsnbextension           3.6.0
wrapt                        1.14.0
zipp                         3.7.0
WARNING: You are using pip version 22.0.4; however, version 23.1.2 is available.
You should consider upgrading via the '/usr/bin/python3.8 -m pip install --upgrade pip' command.

0 replies

geekjr · 2023-06-02T14:22:37Z

geekjr
Jun 2, 2023
Maintainer

Try pip3 list

also what error do you get when you try pip/pip3 install quickai?

0 replies

zikapanam · 2023-06-02T14:24:05Z

zikapanam
Jun 2, 2023
Author

Sorry, the pip install quickai works but my program raise an error :

root@4e45befdddbe:/# cd userapp/
root@4e45befdddbe:/userapp# ls
q_and_a_quickai.py  zapapp-quickai-prompt.md
root@4e45befdddbe:/userapp# python3 q_and_a_quickai.py 
2023-06-02 14:22:39.921239: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2023-06-02 14:22:39.921264: I tensorflow/stream_executor/cuda/cudart_stub.cc:29] Ignore above cudart dlerror if you do not have a GPU set up on your machine.
Traceback (most recent call last):
  File "q_and_a_quickai.py", line 2, in <module>
    from quickai import q_and_a
  File "/usr/local/lib/python3.8/dist-packages/quickai/__init__.py", line 8, in <module>
    from .yolo.train import YOLOV4_Train
  File "/usr/local/lib/python3.8/dist-packages/quickai/yolo/__init__.py", line 5, in <module>
    from .detect import YOLOV4
  File "/usr/local/lib/python3.8/dist-packages/quickai/yolo/detect.py", line 7, in <module>
    import cv2
ModuleNotFoundError: No module named 'cv2'

0 replies

zikapanam · 2023-06-02T14:24:59Z

zikapanam
Jun 2, 2023
Author

root@4e45befdddbe:/userapp# pip install cv2
ERROR: Could not find a version that satisfies the requirement cv2 (from versions: none)
ERROR: No matching distribution found for cv2
WARNING: You are using pip version 22.0.4; however, version 23.1.2 is available.
You should consider upgrading via the '/usr/bin/python3.8 -m pip install --upgrade pip' command.

0 replies

geekjr · 2023-06-02T14:25:27Z

geekjr
Jun 2, 2023
Maintainer

pip3 install opencv-python

0 replies

zikapanam · 2023-06-02T14:26:28Z

zikapanam
Jun 2, 2023
Author

Ok, thx, next error :

root@4e45befdddbe:/userapp# python3 q_and_a_quickai.py 
2023-06-02 14:25:34.230729: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2023-06-02 14:25:34.230752: I tensorflow/stream_executor/cuda/cudart_stub.cc:29] Ignore above cudart dlerror if you do not have a GPU set up on your machine.
Traceback (most recent call last):
  File "q_and_a_quickai.py", line 2, in <module>
    from quickai import q_and_a
  File "/usr/local/lib/python3.8/dist-packages/quickai/__init__.py", line 8, in <module>
    from .yolo.train import YOLOV4_Train
  File "/usr/local/lib/python3.8/dist-packages/quickai/yolo/__init__.py", line 5, in <module>
    from .detect import YOLOV4
  File "/usr/local/lib/python3.8/dist-packages/quickai/yolo/detect.py", line 7, in <module>
    import cv2
  File "/usr/local/lib/python3.8/dist-packages/cv2/__init__.py", line 181, in <module>
    bootstrap()
  File "/usr/local/lib/python3.8/dist-packages/cv2/__init__.py", line 153, in bootstrap
    native_module = importlib.import_module("cv2")
  File "/usr/lib/python3.8/importlib/__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
ImportError: libGL.so.1: cannot open shared object file: No such file or directory

0 replies

geekjr · 2023-06-02T14:27:45Z

geekjr
Jun 2, 2023
Maintainer

try apt-get update && apt-get install libgl1 inside the docker container

0 replies

zikapanam · 2023-06-02T14:29:37Z

zikapanam
Jun 2, 2023
Author

Thx, next error :

root@4e45befdddbe:/userapp# python3 q_and_a_quickai.py 
2023-06-02 14:28:54.643953: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2023-06-02 14:28:54.643976: I tensorflow/stream_executor/cuda/cudart_stub.cc:29] Ignore above cudart dlerror if you do not have a GPU set up on your machine.
Traceback (most recent call last):
  File "q_and_a_quickai.py", line 2, in <module>
    from quickai import q_and_a
  File "/usr/local/lib/python3.8/dist-packages/quickai/__init__.py", line 8, in <module>
    from .yolo.train import YOLOV4_Train
  File "/usr/local/lib/python3.8/dist-packages/quickai/yolo/__init__.py", line 5, in <module>
    from .detect import YOLOV4
  File "/usr/local/lib/python3.8/dist-packages/quickai/yolo/detect.py", line 15, in <module>
    from .yolov4 import filter_boxes
  File "/usr/local/lib/python3.8/dist-packages/quickai/yolo/yolov4.py", line 7, in <module>
    from .utils import *
  File "/usr/local/lib/python3.8/dist-packages/quickai/yolo/utils.py", line 6, in <module>
    from .config import cfg
  File "/usr/local/lib/python3.8/dist-packages/quickai/yolo/config.py", line 3, in <module>
    from easydict import EasyDict as edict
ModuleNotFoundError: No module named 'easydict'

0 replies

geekjr · 2023-06-02T14:30:06Z

geekjr
Jun 2, 2023
Maintainer

pip3 install easydict

0 replies

zikapanam · 2023-06-02T14:30:40Z

zikapanam
Jun 2, 2023
Author

Ok and next and perhaprs last :

root@4e45befdddbe:/userapp# python3 q_and_a_quickai.py 
2023-06-02 14:29:59.942032: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcudart.so.11.0'; dlerror: libcudart.so.11.0: cannot open shared object file: No such file or directory
2023-06-02 14:29:59.942055: I tensorflow/stream_executor/cuda/cudart_stub.cc:29] Ignore above cudart dlerror if you do not have a GPU set up on your machine.
Traceback (most recent call last):
  File "q_and_a_quickai.py", line 2, in <module>
    from quickai import q_and_a
  File "/usr/local/lib/python3.8/dist-packages/quickai/__init__.py", line 8, in <module>
    from .yolo.train import YOLOV4_Train
  File "/usr/local/lib/python3.8/dist-packages/quickai/yolo/__init__.py", line 5, in <module>
    from .detect import YOLOV4
  File "/usr/local/lib/python3.8/dist-packages/quickai/yolo/detect.py", line 15, in <module>
    from .yolov4 import filter_boxes
  File "/usr/local/lib/python3.8/dist-packages/quickai/yolo/yolov4.py", line 7, in <module>
    from .utils import *
  File "/usr/local/lib/python3.8/dist-packages/quickai/yolo/utils.py", line 138, in <module>
    classes=read_class_names(YOLO_CLASSES),
  File "/usr/local/lib/python3.8/dist-packages/quickai/yolo/utils.py", line 82, in read_class_names
    with open(class_file_name, 'r') as data:
FileNotFoundError: [Errno 2] No such file or directory: './coco.names'

0 replies

geekjr · 2023-06-02T14:31:19Z

geekjr
Jun 2, 2023
Maintainer

Note: Even if you are not using YOLO, you will still need a file in your current working directory called coco.names. If you are not using YOLO, this file can be empty.

0 replies

geekjr · 2023-06-02T14:31:58Z

geekjr
Jun 2, 2023
Maintainer

The issues that you had with the Docker dependencies is strange... The Dockerfile in the repo has all the modules listed as dependencies.

3 replies

zikapanam Jun 2, 2023
Author

Does it mean, the image has been modified by someone else ?

geekjr Jun 2, 2023
Maintainer

It shouldn't.

geekjr Jun 2, 2023
Maintainer

I am gonna try it myself on a clean docker install and see if it works.

zikapanam · 2023-06-02T14:38:34Z

zikapanam
Jun 2, 2023
Author

Thx for your help, i'm trying now to understand if the IA can give me an complete answer to my question regarding the prompt that contains a list of questions and answers.

0 replies

geekjr · 2023-06-02T14:39:36Z

geekjr
Jun 2, 2023
Maintainer

No problem! Also, just a heads up, without GPU any language task will take a very very long time.

2 replies

zikapanam Jun 2, 2023
Author

It takes a few seconds to give me an answer but the answers are not relevant for now.

geekjr Jun 2, 2023
Maintainer

That can happen. Sometimes you have to play with it to get good results.

zikapanam · 2023-06-02T14:41:21Z

zikapanam
Jun 2, 2023
Author

Does it understand french ? Or is there some limitations on other language than english ?

1 reply

geekjr Jun 2, 2023
Maintainer

Depends on the model used. On the README under NLP models, you can search those models in huggingface and see what languages they support.

zikapanam · 2023-06-02T15:13:11Z

zikapanam
Jun 2, 2023
Author

Ok i found this page : huggingface

It seems it links different files to download.

Can i use all of them for q_and_a ?

Where should i install them ?

BR,
Laurent

0 replies

geekjr · 2023-06-02T18:38:05Z

geekjr
Jun 2, 2023
Maintainer

You don't need to download any of them. Find one that supports French and use it by passing it(in huggingface format) as model_name parm to function q_and_a.

0 replies

zikapanam · 2023-06-02T20:51:25Z

zikapanam
Jun 2, 2023
Author

Ok, i have found one model that give relatively good result but the answer are very short ...

I use : "etalab-ia/camembert-base-squadFR-fquad-piaf"

Is it possible to ask for elaborate answers with quickai ?

Thx for your help, i could not get here without your help !

0 replies

geekjr · 2023-06-02T21:47:58Z

geekjr
Jun 2, 2023
Maintainer

Hmm. That's a great idea actually. Right now, there is no functionality built in for that, but if you want something you can edit the source code of the q_and_a function. In the nlp call, set max_length equal to how many tokens you want.

I know it's a crude solution. I'll consider implementing this in the future.

3 replies

zikapanam Jun 3, 2023
Author

Hi,

I tried to modify the code as you suggested but the answer is still very short.

def q_and_a(context, question, model="distilbert-base-cased-distilled-squad", max_length=1024):
    nlp = pipeline("question-answering", model=model)
    result = nlp(question=question, context=context, max_length=max_length)
    return [
        result['answer'],
        round(
            result['score'],
            4),
        result['start'],
        result['end']]

answer = q_and_a(prompt, question, model='etalab-ia/camembert-base-squadFR-fquad-piaf', max_length=1024)

Veuillez saisir un message : Zikapanam ?
All model checkpoint layers were used when initializing TFCamembertForQuestionAnswering.

All the layers of TFCamembertForQuestionAnswering were initialized from the model checkpoint at etalab-ia/camembert-base-squadFR-fquad-piaf.
If your task is similar to the task the model of the checkpoint was trained on, you can already use TFCamembertForQuestionAnswering for predictions without further training.
[' Le système de gestion des rencontres', 0.6403, 1116, 1153]

zikapanam Jun 3, 2023
Author

It's perhaps a model limitation ... It can only respond short answer.

geekjr Jun 3, 2023
Maintainer

Yea that's possible, especially for Q/A.

Try to execute a simple example from wiki doc #61

zikapanam Jun 1, 2023

Replies: 29 comments · 9 replies

geekjr Jun 1, 2023 Maintainer

zikapanam Jun 1, 2023 Author

geekjr Jun 1, 2023 Maintainer

zikapanam Jun 1, 2023 Author

geekjr Jun 2, 2023 Maintainer

zikapanam Jun 2, 2023 Author

geekjr Jun 2, 2023 Maintainer

zikapanam Jun 2, 2023 Author

zikapanam Jun 2, 2023 Author

geekjr Jun 2, 2023 Maintainer

zikapanam Jun 2, 2023 Author

geekjr Jun 2, 2023 Maintainer

zikapanam Jun 2, 2023 Author

zikapanam Jun 2, 2023 Author

geekjr Jun 2, 2023 Maintainer

zikapanam Jun 2, 2023 Author

geekjr Jun 2, 2023 Maintainer

zikapanam Jun 2, 2023 Author

geekjr Jun 2, 2023 Maintainer

zikapanam Jun 2, 2023 Author

geekjr Jun 2, 2023 Maintainer

geekjr Jun 2, 2023 Maintainer

zikapanam Jun 2, 2023 Author

geekjr Jun 2, 2023 Maintainer

geekjr Jun 2, 2023 Maintainer

zikapanam Jun 2, 2023 Author

geekjr Jun 2, 2023 Maintainer

zikapanam Jun 2, 2023 Author

geekjr Jun 2, 2023 Maintainer

zikapanam Jun 2, 2023 Author

geekjr Jun 2, 2023 Maintainer

zikapanam Jun 2, 2023 Author

geekjr Jun 2, 2023 Maintainer

zikapanam Jun 2, 2023 Author

geekjr Jun 2, 2023 Maintainer

zikapanam Jun 3, 2023 Author

zikapanam Jun 3, 2023 Author

geekjr Jun 3, 2023 Maintainer

zikapanam
Jun 1, 2023

Replies: 29 comments 9 replies

geekjr
Jun 1, 2023
Maintainer

zikapanam
Jun 1, 2023
Author

geekjr
Jun 1, 2023
Maintainer

zikapanam
Jun 1, 2023
Author

geekjr
Jun 2, 2023
Maintainer

zikapanam
Jun 2, 2023
Author

geekjr
Jun 2, 2023
Maintainer

zikapanam
Jun 2, 2023
Author

zikapanam
Jun 2, 2023
Author

geekjr
Jun 2, 2023
Maintainer

zikapanam
Jun 2, 2023
Author

geekjr
Jun 2, 2023
Maintainer

zikapanam
Jun 2, 2023
Author

zikapanam
Jun 2, 2023
Author

geekjr
Jun 2, 2023
Maintainer

zikapanam
Jun 2, 2023
Author

geekjr
Jun 2, 2023
Maintainer

zikapanam
Jun 2, 2023
Author

geekjr
Jun 2, 2023
Maintainer

zikapanam
Jun 2, 2023
Author

geekjr
Jun 2, 2023
Maintainer

geekjr
Jun 2, 2023
Maintainer

zikapanam Jun 2, 2023
Author

geekjr Jun 2, 2023
Maintainer

geekjr Jun 2, 2023
Maintainer

zikapanam
Jun 2, 2023
Author

geekjr
Jun 2, 2023
Maintainer

zikapanam Jun 2, 2023
Author

geekjr Jun 2, 2023
Maintainer

zikapanam
Jun 2, 2023
Author

geekjr Jun 2, 2023
Maintainer

zikapanam
Jun 2, 2023
Author

geekjr
Jun 2, 2023
Maintainer

zikapanam
Jun 2, 2023
Author

geekjr
Jun 2, 2023
Maintainer

zikapanam Jun 3, 2023
Author

zikapanam Jun 3, 2023
Author

geekjr Jun 3, 2023
Maintainer