Possible to add RAG and small GUI?

[fxtoofaan]

Would love to see some kind of RAG and UI implemented. Thank you

[hugofreire]

RAG will be awesome

[fxtoofaan]

local RAG and local ollama llm model(s) example code please :)

[joaomdmoura]

Nice, okay I hear you, I'll look into a specific simple RAG default tool maybe and add more ollama examples

[okoliechykwuka]

Thanks, @joaomdmoura , I noticed you implemented RAG in the financial analyst example.

https://youtu.be/e0Uj4yWdaAg

[mindwellsolutions]

@joaomdmoura Thank you for working on adding RAG, this will be huge. The ability for CrewAI to read through a whole folder of documents, pdfs (potentially spreadsheets, ebooks, datasets) as its research source, in place of DuckDuckGoSearch using the internet for research. This would allow people to point the agent towards larger bodies of documents, knowledge, pdfs and ebooks, to help agents tap into local sources for research and responses. This could be incredibly powerful :)

Support for API Embedding to VectorDBs (ChromaDB or Pinecone) using Gemini/ChatGPT API and Local Embedding (Like Instructor-XL) would be great. Although API is likely the preferred option for ease of scalability and speed.

[ceramicv]

Especially useful would be to be able to sense an update of the RAG environment automatically so that you don't have to re-read everything back in if you just add a new document. This is maybe outside of CrewAI itself as all it does is read the RAG database but I haven't seen an elegant way to deal with adds, deleted, modifications to the RAG database so a best practice recommendation would be great.

[ewebgh33]

+1

I would really, really like to be able to
a) give agents bodies of specific knowledge via RAG

And
b) also give them examples of their expected output as docs they can reference.

Maybe (b) can be achieved in prompt, but this would be clunky I feel.
Or (b) maybe if we're using ChatGPT4.x, we can feed it a document and hope it understands the format enough to mimic on output.

But definitely (a) giving them specific knowledge would be the next logical step to empowering the agents to do different jobs?

[joaomdmoura]

This is getting prioritized to be worked on next

[ewebgh33]

Excellent news! Very excited.

I think this would really supercharge crewAI and give it the best of both worlds that Autogen (agents) and taskweaver (code-first) have. One of the main things I would love to try is mixing general knowledge with coding ability, and with Autogen/Taskweaver I feel you get one or the other - not both!

[WismutHansen]

Would this help with implementing RAG: https://github.com/KillianLucas/aifs

[scaruslooner]

excited

[slavakurilyak]

AI File System can be used as a tool for crewAI that would unlock RAG-pipelines for local search (file or folder search)

[slavakurilyak]

RAG is now part of the crewai-tools library

[slavakurilyak]

Excited to see the new UI

[bhargav-11]

bump!!!

[airtonix]

don't waste time on a UI. it's orthogonal to the purpose of this library.

[joaomdmoura]

Yup UI us coming, we kept on pushing it to build the backbones of the lib but we will also need it ourselves, so expected it sooner than later

[joaomdmoura]

#18 (comment)
About RAG ^

[magedhelmy1]

Dear @joaomdmoura, sorry to bother you on this. What is the ETA?
PS, keep the good work up!

[joaomdmoura]

UI is in the works and scheduled to drop in the next 30d :) Rag is now supported over tools :D -- João Moura @joaomdmoura <http://twitter.com/joaomdmoura> Em ter., 30 de abr. de 2024 às 18:19, Maged Helmy ***@***.***> escreveu:

…

Dear @joaomdmoura <https://github.com/joaomdmoura>, sorry to bother you on this. What is the ETA? PS, keep the good work up! — Reply to this email directly, view it on GitHub <#18 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAFC3N6JZQS4MDOVERYFNS3ZAADGXAVCNFSM6AAAAABBE2PH6CVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAOBXGM3DANJTGI> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[shawnholt]

Please consider teaming up with Langflow, Flowise or similar.

[shawnholt]

A lot of people have been drawn to autogen because it's much more comfortable to work with a GUI , rather than code. I see a lot of abandoned attempts and "coming soon", but based on this thread alone it does not seem like it is a priority, please help us understand where it fits into the roadmap. Thank you!

[YohanReddy]

UI is in the works and scheduled to drop in the next 30d :) Rag is now supported over tools :D -- João Moura @joaomdmoura http://twitter.com/joaomdmoura Em ter., 30 de abr. de 2024 às 18:19, Maged Helmy @.> escreveu:
…
Dear @joaomdmoura https://github.com/joaomdmoura, sorry to bother you on this. What is the ETA? PS, keep the good work up! — Reply to this email directly, view it on GitHub <#18 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAFC3N6JZQS4MDOVERYFNS3ZAADGXAVCNFSM6AAAAABBE2PH6CVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAOBXGM3DANJTGI . You are receiving this because you were mentioned.Message ID: @.>

Any update on the UI? Can't wait to get hands-on

[cbarkinozer]

Is there any news or an ETA from UI?

[beevelop]

Langflow announced support for CrewAI recently which could be a feasible interim option: https://github.com/langflow-ai/langflow/releases/tag/v1.0.10

[shawnholt]

Frustrating that every AI framework and tool has to build everything themselves rather than collaborating.

[0xStuart]

What is the UI shown on Crews website? Is that for enterprise users?

[joaomdmoura]

UI is coming live this October, just test it yesterday is looking 🔥
I'll be online on out website but will be free to use :D

[joaomdmoura]

This took way longer than expected btw, sorry about that 🙇 quick sneak peek as token for forgiveness 😅

[shawnholt]

why not team up with Langflow, Flowise or one of the dozen visual builders? They are open and you have the same goals. Many competitors like autogen are focused on this and hard to focus on everything!