is it possible to change /embeddings with prefix of /v1/embeddings?

[jacobahtan]

i'm looking for a quick solution if it's possible to prefix /v1/ to the root or even some subpaths to models & embeddings..
e.g. /v1/models & /v1/embeddings

i've tried using nginx but it seems like it's not working.

Configure nginx for reverse proxy

RUN echo "events { use epoll; worker_connections 128; } \
    http { \
        server { \
                    listen 7997; \
                        location ^~ /v1/models/ { \
                            proxy_pass http://localhost:7997/models/; \
                            proxy_set_header Host \$host; \
                            proxy_set_header X-Real-IP \$remote_addr; \
                            proxy_set_header X-Forwarded-For \$proxy_add_x_forwarded_for; \
                            proxy_set_header X-Forwarded-Proto \$scheme; \
                        } \
                        location ^~ /v1/embeddings/ { \
                            proxy_pass http://localhost:7997/embeddings/; \
                            proxy_set_header Host \$host; \
                            proxy_set_header X-Real-IP \$remote_addr; \
                            proxy_set_header X-Forwarded-For \$proxy_add_x_forwarded_for; \
                            proxy_set_header X-Forwarded-Proto \$scheme; \
                        } \
                } \
        }" > /etc/nginx/nginx.conf && \
    chmod -R 777 /var/log/nginx /var/lib/nginx /run

thank you!

[michaelfeil]

Yes, there is an option for that even in the CLI. infinity_emb --help. The arg is called https://github.com/michaelfeil/infinity/blob/3259775694ddc7541a1f4c52a62e99cab1788e15/libs/infinity_emb/infinity_emb/infinity_server.py#L33C1-L33C26 url_prefix. Thank you and closing.

[jacobahtan]

Thank you Michael! --url-prefix "/v1" works!

[michaelfeil]

Awesome, happy to help! If you find a better description, feel free to edit the docs as a PR!