llm-fireworks

Access fireworks.ai models via API

Installation

Install this plugin in the same environment as LLM.

llm install llm-fireworks

Obtain a Fireworks API key and save it like this:

llm keys set fireworks
# <Paste key here>

Run llm models to get a list of models.

Run prompts like this:

llm -m fireworks/models/llama-v3-70b-instruct 'five great names for a pet ocelot'

To set up this plugin locally, first checkout the code. Then create a new virtual environment:

cd llm-fireworks
python3 -m venv venv
source venv/bin/activate

Now install the dependencies and test dependencies:

llm install -e '.[test]'

To run the tests:

pytest