Skip to content

MorpheusAIs/Morpheus-Lumerin-Node

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Morpheus Lumerin Node

Simple-Overview The purpose of this software is to enable interaction with distributed, decentralized LLMs on the Morpheus network through a desktop chat experience.

  1. PreRequisites: Arbitrum Layer 2 Blockchain, Arbitrum MOR and Arbitrum ETH for staking and bidding
  2. Existing, Hosted AI model that is available for inference via the Morpheus network
  3. The proxy-router talks to and listens to the blockchain, routes prompts and inference between the providers’ models and the consumers that purchase and use the models
  4. Providers register their models via bids on the blockchain
  5. The consumer node is the “client” that will be purchasing bids from the blockchain, sending prompts via the proxy-router and receiving inference back from the provider’s models
  6. Consumers purchase the bid and stake MOR for their session time
  7. Once the bid has been purchased, prompt and inference (ChatGPT-like) can start

Components that are included in this repository are:

  • Local Llama.cpp and tinyllama model to run locally for demonstration purposes only
  • Lumerin proxy-router is a background process that monitors sepcific blockchain contract events, manages secure sessions between consumers and providers and routes prompts and responses between them
  • Lumerin MorpheusUI is the front end UI to interact with LLMs and the Morpheus network via the proxy-router as a consumer
  • Lumerin cli is the cli client to interact with LLMs and the Morpheus network via the proxy-router as a consumer

Tokens and Contract Information (update 11/15/2024)

MainNet: (MAIN Branch and MAIN-* Releases)

TestNet (TEST Branch and TEST-* Releases)

Funds

  • WALLET: For testing as a provider or consumer, you will need both MOR and ETH tokens in your wallet.
    • MOR is the token used to pay for the model provider staking and consumer usage
    • ETH is the token used to pay for the gas fees on the network

Installation & Operation

  • 00-Overview - This provides a comprehensive picture of the Provider, Blockchain and Consumer environments and how they interact. This will also link to other documents for more advanced setup and configuration.

  • 04-Consumer-Setup - This is the simplest way to get started with the Morpheus Lumerin Node as a Consumer. This will allow you to interact with the Morpheus network and the models offered on the network as a consumer running from packaged releases.

  • 02-Provider-Setup - This is the simplest way to get started with the Morpheus Lumerin Node as a Provider. This will allow you to connect your existing AI-Model to the Morpheus network and offer it for use by consumers.