We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
The "Whisper Turbo" package comes from Ratchet, a new project by Huggingface.
Also included is an example of using Moondream. Moondream is a model that can describe images.
If a user uploads an image to Discord or Twitter, we want to get the description of the image for Ruby as context. i.e. the agent can "see" the image.
We can use Moondream directly with WebGPU here: https://github.com/huggingface/ratchet/tree/master/examples/ratchet-moondream
If this proves to be difficult, we can use Moondream from Replicate: https://replicate.com/lucataco/moondream2
However our goal is to have everything running locally.
The text was updated successfully, but these errors were encountered:
Merge pull request #5 from ai16z/main
714bf6f
merge from main
docs: Update "What Did You Get Done This Week? elizaOS#5" spaces notes
6dedc9e
vladkashka56
No branches or pull requests
The "Whisper Turbo" package comes from Ratchet, a new project by Huggingface.
Also included is an example of using Moondream. Moondream is a model that can describe images.
If a user uploads an image to Discord or Twitter, we want to get the description of the image for Ruby as context. i.e. the agent can "see" the image.
We can use Moondream directly with WebGPU here:
https://github.com/huggingface/ratchet/tree/master/examples/ratchet-moondream
If this proves to be difficult, we can use Moondream from Replicate: https://replicate.com/lucataco/moondream2
However our goal is to have everything running locally.
The text was updated successfully, but these errors were encountered: