2.3.9 Satellite: cmdh

cmdh

Handle: cmdh URL: -

Starting

cmdh is a CLI-only service that tries to generate a bash command from your input. Be advised that it works best with larger models. Expect acceptable results from codestral and above.

[!INFO] Harbor runs patched version of cmdh that uses Ollama json format and has a slightly tweaked system prompt.

Harbor mounts $PWD to the service, so it can work with it directly. The $PWD will match those of a host, but be aware that only the child directories are actually available.

# Go where you'd run the command
# "z" is from pazi-jump
z cache
cd ~/.cache/huggingface

harbor cmdh 'find all the ggufs here'

user@os:~/.cache/huggingface$ ▼ harbor cmdh 'find all the ggufs here'
✔ Retrieving command... find all the ggufs here
desired command: find / -type f -name "*.gguf"
assistant message: The 'find' command is a powerful utility that searches for files and directories in a specified path. In this case, it will search the entire file system from root (/) for any files with the extension '.gguf'. The options used ensure that only regular files are considered, not directories or other types of files.
? Choose an option: Run desired command
Running: find / -type f -name "*.gguf"
/home/everlier/.cache/huggingface/gguf/llama3-simpo-expo-q8_0.gguf
/home/everlier/.cache/huggingface/gguf/llama3-simpo-expo-q2_k.gguf
/home/everlier/.cache/huggingface/gguf/llama3-simpo-expo-q4_k.gguf
/home/everlier/.cache/huggingface/gguf/phi-3-mini-128k-instruct.Q4_K_M.gguf
/home/everlier/.cache/huggingface/Tess-v2.5-Phi-3-medium-128k-14B-Q6_K.gguf

Configuration

Ollama

You should select a model for the cmdh to use.

# Set cmdh to use ollama (if not already set)
harbor cmdh host ollama

# See what's currently available
harbor ollama list

# See currently configured model
harbor cmdh model

# Set the model to run
harbor cmdh model codestral

OpenAI

cmdh should also work with OpenAI-compatible APIs.

# Note the casing - required by library
harbor cmdh host OpenAI

# Point cmdh to OpenAI API
harbor cmdh key <key>
harbor cmdh url <url>

# Set the model to run
harbor cmdh model gpt-3.5-turbo