Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

server: init functional tests #5566

Merged
merged 100 commits into from
Feb 24, 2024
Merged

server: init functional tests #5566

merged 100 commits into from
Feb 24, 2024

Commits on Feb 20, 2024

  1. server: init functional test

    @phymbert
    phymbert committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    157bcf2 View commit details
    Browse the repository at this point in the history

  2. server: tests: reduce number of files, all in one tests shell script

    @phymbert
    phymbert committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    9b63d70 View commit details
    Browse the repository at this point in the history

  3. server: tests: fix ci workflow

    @phymbert
    phymbert committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    6497755 View commit details
    Browse the repository at this point in the history

  4. server: tests: fix ci workflow

    @phymbert
    phymbert committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    4e5245e View commit details
    Browse the repository at this point in the history

  5. server: tests: fix ci workflow

    @phymbert
    phymbert committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    30aa323 View commit details
    Browse the repository at this point in the history

  6. server: tests: use ngxson llama_xs_q4.bin

    @phymbert
    phymbert committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    fe9866a View commit details
    Browse the repository at this point in the history

  7. server: tests: build only the server

    @phymbert
    phymbert committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    1680599 View commit details
    Browse the repository at this point in the history

  8. server: tests: add health check and concurrent request example

    @phymbert
    phymbert committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    8bb586b View commit details
    Browse the repository at this point in the history

  9. server: tests: change model to: @karpathy's tinyllamas

    @phymbert
    phymbert committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    6c95ec6 View commit details
    Browse the repository at this point in the history

  10. server: tests: refactor steps and vocabulary

    @phymbert
    phymbert committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    56583be View commit details
    Browse the repository at this point in the history

  11. server: tests: add OAI stream test, fix file end of line, fast fail b… 

    …ehave
    @phymbert
    phymbert committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    9b7ea97 View commit details
    Browse the repository at this point in the history

  12. server: tests: add OAI multi user scenario

    @phymbert
    phymbert committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    11adf1d View commit details
    Browse the repository at this point in the history

  13. server: tests: slots endpoint checks

    @phymbert
    phymbert committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    c355f76 View commit details
    Browse the repository at this point in the history

  14. server: tests: check for infinite loops

    @phymbert
    phymbert committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    367b59a View commit details
    Browse the repository at this point in the history

  15. server: tests: check for infinite loops

    @phymbert
    phymbert committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    b9f8390 View commit details
    Browse the repository at this point in the history

  16. server: tests: add a constant seed in completion request

    @phymbert
    phymbert committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    0772884 View commit details
    Browse the repository at this point in the history

  17. server: tests: add infinite loop

    @phymbert
    phymbert committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    6b9dc4f View commit details
    Browse the repository at this point in the history

  18. server: tests: add infinite loop scenario

    @phymbert
    phymbert committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    68574c6 View commit details
    Browse the repository at this point in the history

  19. server: tests: add infinite loop scenario

    @phymbert
    phymbert committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    b0b6d83 View commit details
    Browse the repository at this point in the history

  20. server: tests: disable issue 3969 scenario

    @phymbert
    phymbert committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    1ecda0d View commit details
    Browse the repository at this point in the history

  21. server: tests: add embeddings scenario

    @phymbert
    phymbert committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    e6d4820 View commit details
    Browse the repository at this point in the history

  22. server: tests: add tokenize/detokenize scenario

    @phymbert
    phymbert committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    1065f6d View commit details
    Browse the repository at this point in the history

  23. server: tests: detokenize endpoint issue reference added

    @phymbert
    phymbert committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    19664b9 View commit details
    Browse the repository at this point in the history

  24. server: tests: simplify completion scenario

    @phymbert
    phymbert committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    6dcbcfe View commit details
    Browse the repository at this point in the history

Commits on Feb 21, 2024

  1. server: tests: CORS and api key checks scenario

    @phymbert
    phymbert committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    672d98f View commit details
    Browse the repository at this point in the history

  2. server: tests: add a small check to be sure all started threads have … 

    …generated response
    @phymbert
    phymbert committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    3322bfa View commit details
    Browse the repository at this point in the history

  3. server: tests: change CI workflow trigger

    @phymbert
    phymbert committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    469af4b View commit details
    Browse the repository at this point in the history

  4. server: tests: fix the multi users infinite loop test

    @phymbert
    phymbert committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    2a37bd6 View commit details
    Browse the repository at this point in the history

  5. server : fix initialization thread issues

    @ggerganov
    ggerganov committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    f1d4138 View commit details
    Browse the repository at this point in the history

  6. server: test: ci change the GitHub workflow trigger

    @phymbert
    phymbert committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    600cbeb View commit details
    Browse the repository at this point in the history

  7. Merge remote-tracking branch 'origin/master' into test/server-add-ci-… 

    …test
    @phymbert
    phymbert committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    68b8d4e View commit details
    Browse the repository at this point in the history

  8. server: tests: 

      * start the server at each scenario
  * split the features as each requires different server config
    @phymbert
    phymbert committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    6406208 View commit details
    Browse the repository at this point in the history

  9. server: tests: ci fix model download path

    @phymbert
    phymbert committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    01cca66 View commit details
    Browse the repository at this point in the history

  10. server: tests: ci tests.sh exit code

    @phymbert
    phymbert committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    534998d View commit details
    Browse the repository at this point in the history

Commits on Feb 22, 2024

  1. minor : fix missing new line

    @ggerganov
    ggerganov committed Feb 22, 2024
    Configuration menu
    Copy the full SHA
    a697cd1 View commit details
    Browse the repository at this point in the history

  2. ci : actually no reason to exclude GPU code from triggers

    @ggerganov
    ggerganov committed Feb 22, 2024
    Configuration menu
    Copy the full SHA
    41676d9 View commit details
    Browse the repository at this point in the history

  3. server: fix health/slots endpoint slot state access available race co… 

    …ndition
    @phymbert
    phymbert committed Feb 22, 2024
    Configuration menu
    Copy the full SHA
    016b221 View commit details
    Browse the repository at this point in the history

  4. server: tests: switch to asyncio for concurrent tests, match result c… 

    …ontent with regex
    @phymbert
    phymbert committed Feb 22, 2024
    Configuration menu
    Copy the full SHA
    e43406e View commit details
    Browse the repository at this point in the history

  5. server: tests: ci do not take a model anymore, fix trigger patch

    @phymbert
    phymbert committed Feb 22, 2024
    Configuration menu
    Copy the full SHA
    597c181 View commit details
    Browse the repository at this point in the history

  6. Merge remote-tracking branch 'origin/master' into test/server-add-ci-… 

    …test
    @phymbert
    phymbert committed Feb 22, 2024
    Configuration menu
    Copy the full SHA
    8b96bda View commit details
    Browse the repository at this point in the history

  7. server: tests: ci ensure the server is stopped before scenario, and d… 

    …o not quit while the server is listening
    @phymbert
    phymbert committed Feb 22, 2024
    Configuration menu
    Copy the full SHA
    f820e10 View commit details
    Browse the repository at this point in the history

  8. server: tests: add Multi users with total number of tokens to predict… 

    … exceeds the KV Cache size
    @phymbert
    phymbert committed Feb 22, 2024
    Configuration menu
    Copy the full SHA
    aa591ef View commit details
    Browse the repository at this point in the history

  9. server: tests: Fix some random behavior where the wait for busy statu… 

    …s is missing
    @phymbert
    phymbert committed Feb 22, 2024
    Configuration menu
    Copy the full SHA
    26b66c5 View commit details
    Browse the repository at this point in the history

  10. server: tests: ci triggered on any changes on server example path

    @phymbert
    phymbert committed Feb 22, 2024
    Configuration menu
    Copy the full SHA
    51f5274 View commit details
    Browse the repository at this point in the history

  11. server: tests: minor fix missing param.

    @phymbert
    phymbert committed Feb 22, 2024
    Configuration menu
    Copy the full SHA
    cba6d4e View commit details
    Browse the repository at this point in the history

Commits on Feb 23, 2024

  1. server: tests: assert embeddings are actually computed, make the embe… 

    …ddings endpoint configurable.

Add logs to investigate why the CI server test job is not starting
    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    1bd07e5 View commit details
    Browse the repository at this point in the history

  2. server: tests: minor color change

    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    14b6ede View commit details
    Browse the repository at this point in the history

  3. server: tests: minor fix server --alias param passed twice

    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    b38b9e6 View commit details
    Browse the repository at this point in the history

  4. server: tests: add log in server start to identify why the server doe… 

    …s not listen on the CI
    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    70e9055 View commit details
    Browse the repository at this point in the history

  5. server: tests: allow to override the server port before launching tests

    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    2f756f8 View commit details
    Browse the repository at this point in the history

  6. server: tests: ci adding container to specify server port and allow t… 

    …he server to listen to
    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    6a215e5 View commit details
    Browse the repository at this point in the history

  7. server: tests: ci adding cmake as it is not present by default in ubu… 

    …ntu base
    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    2bb4732 View commit details
    Browse the repository at this point in the history

  8. server: tests: ci adding python3-pip as it is not present by default … 

    …in ubuntu base
    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    d0e0050 View commit details
    Browse the repository at this point in the history

  9. server: tests: ci adding curl as it is not present by default in ubun… 

    …tu base for the hf.sh script
    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    6e71126 View commit details
    Browse the repository at this point in the history

  10. server: tests: ci adding psmisc as it is not present by default in ub… 

    …untu base killall
    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    6bba3be View commit details
    Browse the repository at this point in the history

  11. server: tests: fix coloring console

    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    5110de0 View commit details
    Browse the repository at this point in the history

  12. server: tests: reducing n_ctx and n_predict for // prompts as it is t… 

    …oo slow in the CI.
    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    bedf37c View commit details
    Browse the repository at this point in the history

  13. server: tests: reducing sleep time during scenario

    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    530d3ae View commit details
    Browse the repository at this point in the history

  14. server: tests: parallel fix server is started twice, add colors to he… 

    …lp to monitor in the CI jobs
    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    36ddb96 View commit details
    Browse the repository at this point in the history

  15. server: tests: ci : build and run tests for all matrix defines, sanit… 

    …izer and type
    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    0b0f056 View commit details
    Browse the repository at this point in the history

  16. server: tests: ci : fix wget missing

    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    29f8833 View commit details
    Browse the repository at this point in the history

  17. server: tests: ci : add git

    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    12bb797 View commit details
    Browse the repository at this point in the history

  18. server: tests: ci : matrix cuda

    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    68cd1a4 View commit details
    Browse the repository at this point in the history

  19. server: tests: ci : continue on error

    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    86896aa View commit details
    Browse the repository at this point in the history

  20. server: tests: ci : fix step id duplicated

    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    334902b View commit details
    Browse the repository at this point in the history

  21. server: tests: ci : fix cuda install

    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    fce2e00 View commit details
    Browse the repository at this point in the history

  22. server: test: ci fix cuda build

    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    e4fb790 View commit details
    Browse the repository at this point in the history

  23. server: test: ci fix cublas build

    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    2edd995 View commit details
    Browse the repository at this point in the history

  24. server: test: ci fix matrix

    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    fa51bac View commit details
    Browse the repository at this point in the history

  25. server: test: ci fix clblast

    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    606738e View commit details
    Browse the repository at this point in the history

  26. server: test: ci fix openblas build

    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    d159e29 View commit details
    Browse the repository at this point in the history

  27. server: test: ci matrix

    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    13863ef View commit details
    Browse the repository at this point in the history

  28. server: test: ci matrix, experimental on matrix avx512 entry which fa… 

    …il test
    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    4d3791a View commit details
    Browse the repository at this point in the history

  29. server: test: ci cmake remove all warning as it is done by the classi… 

    …cal build and does not matter for testing
    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    b94809b View commit details
    Browse the repository at this point in the history

  30. server: test: ci make arch not available pass the test

    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    5a621e7 View commit details
    Browse the repository at this point in the history

  31. server: test: ax512 experimental

    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    54ea4d4 View commit details
    Browse the repository at this point in the history

  32. server: test: display server logs in case of failure

    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    5b2ce45 View commit details
    Browse the repository at this point in the history

  33. server: test: fix CUDA LD PATH

    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    6dc3af5 View commit details
    Browse the repository at this point in the history

  34. server: test: ci debug LD path

    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    83c386f View commit details
    Browse the repository at this point in the history

  35. server: test: ci debug CI LD path

    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    0d380ae View commit details
    Browse the repository at this point in the history

  36. server: test: ci switch to nvidia based docker image for cuda

    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    c75e0e1 View commit details
    Browse the repository at this point in the history

  37. server: test: ci give up with nvidia as it requires the nvidia docker… 

    … runtime
    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    2c8bf24 View commit details
    Browse the repository at this point in the history

  38. server: test: ci rename step name to Test, change matrix order for be… 

    …tter clarity
    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    777bdcf View commit details
    Browse the repository at this point in the history

  39. server: test: ci rename job name to Server

    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    e10b83a View commit details
    Browse the repository at this point in the history

  40. server: tests: move all requests call to asyncio

    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    4d27466 View commit details
    Browse the repository at this point in the history

  41. server: tests: allow to pass argument to the test file 

     add wrong_usage.feature to demonstrate user issue which will not be fixed.
    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    1c1fd40 View commit details
    Browse the repository at this point in the history

  42. server: tests: print server logs only on github action

    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    2109743 View commit details
    Browse the repository at this point in the history

  43. server: tests: check if the server has not crashed after a scenario

    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    30f802d View commit details
    Browse the repository at this point in the history

  44. server: tests: adding concurrent embedding in issue ggerganov#5655 

          allow to enable VERBOSE mode
    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    6c0e6f4 View commit details
    Browse the repository at this point in the history

  45. server: tests: linter

    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    77b8589 View commit details
    Browse the repository at this point in the history

  46. server: tests: fix concurrent OAI streaming request

    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    7183149 View commit details
    Browse the repository at this point in the history

  47. server: tests: add a note regarding inference speed.

    @phymbert
    phymbert committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    2d107ba View commit details
    Browse the repository at this point in the history

Commits on Feb 24, 2024

  1. server: tests: removing debug print

    @phymbert
    phymbert committed Feb 24, 2024
    Configuration menu
    Copy the full SHA
    124ca77 View commit details
    Browse the repository at this point in the history

  2. server: tests - allow print on debug

    @phymbert
    phymbert committed Feb 24, 2024
    Configuration menu
    Copy the full SHA
    5957a2d View commit details
    Browse the repository at this point in the history

  3. server: tests - README.md add build instruction and notice on @bug an… 

    …d @wrong_usage.
    @phymbert
    phymbert committed Feb 24, 2024
    Configuration menu
    Copy the full SHA
    482eb30 View commit details
    Browse the repository at this point in the history

  4. server: tests - add explanation about KV Cache.

    @phymbert
    phymbert committed Feb 24, 2024
    Configuration menu
    Copy the full SHA
    60781f0 View commit details
    Browse the repository at this point in the history

  5. server: tests - print only in case of DEBUG

    @phymbert
    phymbert committed Feb 24, 2024
    Configuration menu
    Copy the full SHA
    a779a4b View commit details
    Browse the repository at this point in the history

  6. server: add link to tests in the README.md

    @phymbert
    phymbert committed Feb 24, 2024
    Configuration menu
    Copy the full SHA
    a2a928c View commit details
    Browse the repository at this point in the history

  7. server: tests: improved README.md

    @phymbert
    phymbert committed Feb 24, 2024
    Configuration menu
    Copy the full SHA
    5ed4452 View commit details
    Browse the repository at this point in the history

  8. github issue template: add link to the tests server framework

    @phymbert
    phymbert committed Feb 24, 2024
    Configuration menu
    Copy the full SHA
    99163c8 View commit details
    Browse the repository at this point in the history