Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

More additions about AI #12245

Merged
merged 3 commits into from
Sep 27, 2024
Merged

More additions about AI #12245

Show file tree
Hide file tree
Changes from 2 commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
140c458
Admin docs: Add a note about VRAM usage
marcelklehr Sep 27, 2024
80b4679
TaskProcessing docs: Add a note about multilingual prompts and testing
marcelklehr Sep 27, 2024
d043436
fix(AI/assistant): Don't mention old apps
marcelklehr Sep 27, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 5 additions & 1 deletion admin_manual/ai/app_assistant.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,13 +38,17 @@ Artificial intelligence at Nextcloud is built in a modular way, allowing you to

**Note**: At Nextcloud we focus on creating on-premise AI apps that run fully self-hosted on your own servers in order to preserve your privacy and data sovereignty. However, you can also offload these resource-heavy tasks to an :ref:`"AI as a Service" provider<ai-ai_as_a_service>`.

**Note**: When using our on-premise AI apps, make sure you have a GPU with enough VRAM that fits all the features you need. For each app documented here you will find its hardware requirements.

Machine translation
~~~~~~~~~~~~~~~~~~~

In order to make use of machine translation features in the assistant, you will need an app that provides a translation backend:

* :ref:`translate<ai-app-translate>` - Runs open source AI translation models locally on your own server hardware (Customer support available upon request)
* :ref:`translate2 (ExApp)<ai-app-translate2>` - Runs open source AI translation models locally on your own server hardware (Customer support available upon request)
* *integration_deepl* - Integrates with the deepl API to provide translation functionality from Deepl.com servers (Only community supported)
* *integration_libretranslate* - Integrates with the open source LibreTranslate API to provide translation functionality hosted commercially or on your own hardware (Only community supported)

Speech-To-Text
~~~~~~~~~~~~~~
Expand All @@ -67,7 +71,7 @@ Text-To-Image

In order to make use of Text-To-Image features, you will need an app that provides an image generation backend:

* text2image_stablediffusion (Customer support available upon request)
* text2image_stablediffusion2 (Customer support available upon request)
* *integration_openai* - Integrates with the OpenAI API to provide AI functionality from OpenAI servers (Customer support available upon request; see :ref:`AI as a Service<ai-ai_as_a_service>`)
* *integration_replicate* - Integrates with the replicate API to provide AI functionality from replicate servers (see :ref:`AI as a Service<ai-ai_as_a_service>`)

Expand Down
15 changes: 15 additions & 0 deletions developer_manual/digging_deeper/task_processing.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -87,6 +87,21 @@ The following built-in task types are available:
* Output shape:
* ``output``: ``ListOfImages``

LLM Prompts and multilingual I/O
################################

When writing prompts for the TextToText task type in your apps, we recommend testing it with at least

* OpenAI GPT-3.5
* Llama 3.1

Also, make sure that you instruct the model to use the correct language in its output. By default most models will answer in English if the main prompt is in English, even though the source data is in another language.
A tweak to make sure of this is to instruct the model as follows:

.. code-block:: php

"Detect the language used in the text and make sure to answer in the same language without mentioning the language explicitly."

Input and output shapes
~~~~~~~~~~~~~~~~~~~~~~~

Expand Down
Loading