Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add HF embedings, add custom tuned prompts, add GPU accel #45

Merged
merged 74 commits into from
May 15, 2023
Merged

Add HF embedings, add custom tuned prompts, add GPU accel #45

merged 74 commits into from
May 15, 2023

Commits on May 12, 2023

  1. update requirements.txt

    @hippalectryon-0
    hippalectryon-0 committed May 12, 2023
    Configuration menu
    Copy the full SHA
    b40a8ef View commit details
    Browse the repository at this point in the history

  2. Merge branch 'su77ungr:main' into main

    @hippalectryon-0
    hippalectryon-0 authored May 12, 2023
    Configuration menu
    Copy the full SHA
    3aa1d16 View commit details
    Browse the repository at this point in the history

Commits on May 14, 2023

  1. Merge branch 'su77ungr:main' into main

    @hippalectryon-0
    hippalectryon-0 authored May 14, 2023
    Configuration menu
    Copy the full SHA
    599362d View commit details
    Browse the repository at this point in the history

  2. remove state_of_the_union.txt 

    update gitignore
add multithreading
    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    1861358 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'origin/main' into main-fork 

    # Conflicts:
#	startLLM.py
    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    a4b5724 View commit details
    Browse the repository at this point in the history

  4. add poetry config

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    66d0677 View commit details
    Browse the repository at this point in the history

  5. update streamlit version

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    42b9454 View commit details
    Browse the repository at this point in the history

  6. update Dockerfile

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    c4b2a33 View commit details
    Browse the repository at this point in the history

  7. update Dockerfile

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    f5cdbcb View commit details
    Browse the repository at this point in the history

  8. fix Dockerfile

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    3621789 View commit details
    Browse the repository at this point in the history

  9. update Dockerfile

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    5eae6c2 View commit details
    Browse the repository at this point in the history

  10. update README.md

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    d932557 View commit details
    Browse the repository at this point in the history

  11. update README.md

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    a35f7c0 View commit details
    Browse the repository at this point in the history

  12. update convert.py & pyproject.toml

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    1cd7df1 View commit details
    Browse the repository at this point in the history

  13. Merge remote-tracking branch 'fork/main' into main-fork

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    b14b601 View commit details
    Browse the repository at this point in the history

  14. add tokenizer model

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    82f6af6 View commit details
    Browse the repository at this point in the history

  15. update README & lint

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    e371e23 View commit details
    Browse the repository at this point in the history

  16. Merge remote-tracking branch 'fork/main' into main-fork

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    6ffcf25 View commit details
    Browse the repository at this point in the history

  17. add pre-commit

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    83b8454 View commit details
    Browse the repository at this point in the history

  18. run pre-commit

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    8a9ba1f View commit details
    Browse the repository at this point in the history

  19. merge

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    e3a0b6a View commit details
    Browse the repository at this point in the history

  20. fix README.md

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    01c27f2 View commit details
    Browse the repository at this point in the history

  21. fix (?) convert.py

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    44f0e18 View commit details
    Browse the repository at this point in the history

  22. fix (?) convert.py

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    6c0a46d View commit details
    Browse the repository at this point in the history

  23. fix package versions

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    1b3e653 View commit details
    Browse the repository at this point in the history

  24. clean for merge

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    568ece2 View commit details
    Browse the repository at this point in the history

  25. Merge branch 'main' into main-mr 

    # Conflicts:
#	README.md
    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    821c28e View commit details
    Browse the repository at this point in the history

  26. fix README.md

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    4c132e5 View commit details
    Browse the repository at this point in the history

  27. update README.md for new convert

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    f070eae View commit details
    Browse the repository at this point in the history

  28. redirect to main repo

    @su77ungr
    su77ungr authored May 14, 2023
    Configuration menu
    Copy the full SHA
    0cdfd80 View commit details
    Browse the repository at this point in the history

  29. fix ingest.py

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    f41263d View commit details
    Browse the repository at this point in the history

  30. Merge branch 'main-fork' into main-mr

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    09b4c1a View commit details
    Browse the repository at this point in the history

  31. pre-commit formatting

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    5b23c15 View commit details
    Browse the repository at this point in the history

  32. Merge branch 'main-fork' into main-mr 

    # Conflicts:
#	README.md
    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    b4d5c1b View commit details
    Browse the repository at this point in the history

  33. rollback README.md

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    e306509 View commit details
    Browse the repository at this point in the history

  34. Merge branch 'main-fork' into main-mr

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    1b4cc3a View commit details
    Browse the repository at this point in the history

  35. fix Dockerfile and README.md for streamlit

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    249d2f6 View commit details
    Browse the repository at this point in the history

  36. Merge branch 'main' into main-fork

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    488e59d View commit details
    Browse the repository at this point in the history

  37. Merge branch 'main-fork' into main-mr

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    925b779 View commit details
    Browse the repository at this point in the history

  38. fix README.md

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    6231aa9 View commit details
    Browse the repository at this point in the history

  39. cleaner document handling in ingest.py 

    remove CI
    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    d3ff124 View commit details
    Browse the repository at this point in the history

  40. add support for ptt, docx

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    595a75f View commit details
    Browse the repository at this point in the history

  41. add sample documents 

    clean gitignore
bump package version
    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    0901716 View commit details
    Browse the repository at this point in the history

  42. load env variables in centralized file 

    load more variables from env
lint
    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    520c211 View commit details
    Browse the repository at this point in the history

  43. Merge branch 'main' into main-fork 

    # Conflicts:
#	.github/workflows/docker-image.yml
#	README.md
    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    e403170 View commit details
    Browse the repository at this point in the history

  44. Merge branch 'main-fork' into main-mr 

    # Conflicts:
#	.gitignore

+ clean for merge
    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    9fd396e View commit details
    Browse the repository at this point in the history

  45. remove CI on merge

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    c7c367a View commit details
    Browse the repository at this point in the history

  46. check for empty query

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    f61e571 View commit details
    Browse the repository at this point in the history

  47. Merge remote-tracking branch 'origin/main'

    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    5d7c81c View commit details
    Browse the repository at this point in the history

  48. print embedding progress 

    allow reusing collection
add env USE_MLOCK
    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    26a8ef6 View commit details
    Browse the repository at this point in the history

  49. Merge branch 'main' into main-fork 

    # Conflicts:
#	.github/workflows/docker-image.yml
#	example.env
#	gui.py
#	ingest.py
#	load_env.py
#	startLLM.py
    @hippalectryon-0
    hippalectryon-0 committed May 14, 2023
    Configuration menu
    Copy the full SHA
    1f37b66 View commit details
    Browse the repository at this point in the history

Commits on May 15, 2023

  1. Merge branch 'main-fork' into main-mr 

    # Conflicts:
#	.gitignore
    @hippalectryon-0
    hippalectryon-0 committed May 15, 2023
    Configuration menu
    Copy the full SHA
    273b818 View commit details
    Browse the repository at this point in the history

  2. fix model_stop

    @hippalectryon-0
    hippalectryon-0 committed May 15, 2023
    Configuration menu
    Copy the full SHA
    3c0f7da View commit details
    Browse the repository at this point in the history

  3. fix model_stop

    @hippalectryon-0
    hippalectryon-0 committed May 15, 2023
    Configuration menu
    Copy the full SHA
    37216f8 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into main-mr

    @hippalectryon-0
    hippalectryon-0 committed May 15, 2023
    Configuration menu
    Copy the full SHA
    94b4ed4 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'main' into main-fork

    @hippalectryon-0
    hippalectryon-0 committed May 15, 2023
    Configuration menu
    Copy the full SHA
    b25d551 View commit details
    Browse the repository at this point in the history

  6. several minor improvements to startLLM.py 

    fix empty MODEL_STOP
add CHAIN_TYPE in env
    @hippalectryon-0
    hippalectryon-0 committed May 15, 2023
    Configuration menu
    Copy the full SHA
    40c4f8a View commit details
    Browse the repository at this point in the history

  7. pre-commit formatting

    @hippalectryon-0
    hippalectryon-0 committed May 15, 2023
    Configuration menu
    Copy the full SHA
    7775490 View commit details
    Browse the repository at this point in the history

  8. Add support for HuggingFace embeddings

    @hippalectryon-0
    hippalectryon-0 committed May 15, 2023
    Configuration menu
    Copy the full SHA
    2bd0591 View commit details
    Browse the repository at this point in the history

  9. - add custom prompt templates tailored for vic7b-5, and better than t… 

    …he default ones

- update vic7b to 5.1
- add instructions for GPU support
    @hippalectryon-0
    hippalectryon-0 committed May 15, 2023
    Configuration menu
    Copy the full SHA
    8bf70da View commit details
    Browse the repository at this point in the history

  10. Merge branch 'main' into main-fork

    @hippalectryon-0
    hippalectryon-0 committed May 15, 2023
    Configuration menu
    Copy the full SHA
    1cb53d4 View commit details
    Browse the repository at this point in the history

  11. update example.env

    @hippalectryon-0
    hippalectryon-0 committed May 15, 2023
    Configuration menu
    Copy the full SHA
    9dbfdad View commit details
    Browse the repository at this point in the history

  12. Merge remote-tracking branch 'origin/main'

    @hippalectryon-0
    hippalectryon-0 committed May 15, 2023
    Configuration menu
    Copy the full SHA
    d1a8f34 View commit details
    Browse the repository at this point in the history

  13. update prompts

    @hippalectryon-0
    hippalectryon-0 committed May 15, 2023
    Configuration menu
    Copy the full SHA
    ce14ee9 View commit details
    Browse the repository at this point in the history

  14. Merge branch 'main-fork' into main-mr 

    # Conflicts:
#	startLLM.py
    @hippalectryon-0
    hippalectryon-0 committed May 15, 2023
    Configuration menu
    Copy the full SHA
    e351a51 View commit details
    Browse the repository at this point in the history

  15. fix typo

    @hippalectryon-0
    hippalectryon-0 committed May 15, 2023
    Configuration menu
    Copy the full SHA
    432f307 View commit details
    Browse the repository at this point in the history

  16. fix typo

    @hippalectryon-0
    hippalectryon-0 committed May 15, 2023
    Configuration menu
    Copy the full SHA
    46b2d47 View commit details
    Browse the repository at this point in the history

  17. Merge branch 'main-fork' into main-mr

    @hippalectryon-0
    hippalectryon-0 committed May 15, 2023
    Configuration menu
    Copy the full SHA
    1f3e5c2 View commit details
    Browse the repository at this point in the history

  18. update example.env

    @hippalectryon-0
    hippalectryon-0 committed May 15, 2023
    Configuration menu
    Copy the full SHA
    1ba7d27 View commit details
    Browse the repository at this point in the history

  19. Merge branch 'main-fork' into main-mr

    @hippalectryon-0
    hippalectryon-0 committed May 15, 2023
    Configuration menu
    Copy the full SHA
    ae56b96 View commit details
    Browse the repository at this point in the history

  20. re-add strip

    @hippalectryon-0
    hippalectryon-0 committed May 15, 2023
    Configuration menu
    Copy the full SHA
    28b021f View commit details
    Browse the repository at this point in the history

  21. Merge branch 'main-fork' into main-mr

    @hippalectryon-0
    hippalectryon-0 committed May 15, 2023
    Configuration menu
    Copy the full SHA
    d8b89f2 View commit details
    Browse the repository at this point in the history

  22. Add N_GPU_LAYERS to .env 

    fix GPU instructions
    @hippalectryon-0
    hippalectryon-0 committed May 15, 2023
    Configuration menu
    Copy the full SHA
    078281f View commit details
    Browse the repository at this point in the history

  23. Merge branch 'main-fork' into main-mr

    @hippalectryon-0
    hippalectryon-0 committed May 15, 2023
    Configuration menu
    Copy the full SHA
    3af2ae5 View commit details
    Browse the repository at this point in the history