Update packages and resurrect Feluda

[dennyabrain]

Tickets

• Update packages
• Server and Store are running but not tested
• Run Queue and Test it
• Document the uptodate method to bring up feluda locally

[duggalsu]

The Feluda packages are old and compatible for Python v3.9 (cp39).

Trying to setup via docker gives the following issues

• ElasticSearch - AccessDeniedException

  • This is resolved by - https://stackoverflow.com/questions/65668188/elastic-search-accessdeniedexception-usr-share-elasticsearch-data-nodes-0-a

• RabbitMQ docker - invalid mount config for type "bind": bind source path does not exist

  • This is resolved by - https://stackoverflow.com/questions/61316142/invalid-mount-config-for-type-bind-bind-mount-source-path-does-not-exist-ho

• We cannot replace the docker python image from the current slim (debian) to alpine, without modifying Dockerfile commands. Refer - https://stackoverflow.com/questions/55736391/apt-get-not-found-in-docker

• pip-compile gives no space left on device issues. This is resolved by - https://askubuntu.com/questions/1326304/cannot-install-pip-module-because-there-is-no-space-left-on-device

• Cannot generate hashes for requirements.txt using pip-compile since pytorch cpu version is not available on pypi and has to be downloaded from the official site. Refer

  • CPU version of PyTorch on PyPI pytorch/pytorch#26340
  • --find-links equivalent python-poetry/poetry#1391

[duggalsu]

Docker - RabbitMQ and elasticsearch spin-up successfully.
Flask url does not open - possibly refer - https://www.freecodecamp.org/news/how-to-dockerize-a-flask-app/
Need to setup/start server

[duggalsu]

Moving all operator packages to requirements. These packages are installed during server start, so there is no reason to keep them in separate files.

• This prevents system-wide root pip install that can damage linux machines. Packages will get installed in venv.
• This also makes package management easier from one place.
• Package dependency checks can later be performed to remove unused packages (if that was a reason for keeping operator packages within specific files).