Expose http configurations to clipper_admin

[withsmilo]

• solved: Increase thread pool size in query front end #523
• exposed configurations
  • qf_http_thread_pool_size
    • int(optional)
    • The size of thread pool created in query frontend for http serving.
  • qf_http_timeout_request
    • int(optional)
    • The seconds of timeout on request handling in query frontend for http serving.
  • qf_http_timeout_content
    • int(optional)
    • The seconds of timeout on content handling in query frontend for http serving.

[AmplabJenkins]

Can one of the admins verify this patch?

[simon-mo]

@withsmilo Thanks for the PR. These changes are great.

I think we should expose these parameters but directly expose them at start_clipper seems to be too much.

Maybe in start_clipper, we can add an option field instead of three separate arguments:

     qf_options: (dict) extra configuration parameters for query frontend

My main concern is simply the usability and simplicity of our python API.

@dcrankshaw What's your thought on this?

[simon-mo]

jenkins test this please

[AmplabJenkins]

Can one of the admins verify this patch?

[withsmilo]

@simon-mo
Great suggestion! qf_options must contain the following parameters in start_clipper.

• cache_size
• http_thread_pool_size
• http_timeout_request
• http_timeout_content
• num_replicas (renamed from num_frontend_replicas)

[AmplabJenkins]

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Clipper-PRB/1624/
Test FAILed.

[withsmilo]

@simon-mo, @dcrankshaw :
How about this?

def start_clipper(self,
                      query_frontend_image,
                      mgmt_frontend_image,
                      frontend_exporter_image,
                      cache_size,
                      num_frontend_replicas,
                      qf_http_options=None):

    # qf_http_options: (dict) extra http configuration parameters for query frontend

    default_qf_http_options = {
        "http_thread_pool_size" : 1,
        "http_timeout_request" : 5,
        "http_timeout_content" : 300
    }

    if qf_http_options is not None and type(qf_http_options) is dict:
        default_qf_http_options.update(qf_http_options)

[withsmilo]

Jenkins test this please

[AmplabJenkins]

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Clipper-PRB/1780/
Test FAILed.

[withsmilo]

Jenkins test this please

[AmplabJenkins]

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Clipper-PRB/1781/
Test FAILed.

[withsmilo]

Jenkins ok to test

[AmplabJenkins]

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Clipper-PRB/1823/
Test FAILed.

[AmplabJenkins]

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Clipper-PRB/1855/
Test FAILed.

[AmplabJenkins]

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Clipper-PRB/1862/
Test FAILed.

[AmplabJenkins]

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Clipper-PRB/1867/
Test FAILed.

[withsmilo]

Jenkins test this please

[AmplabJenkins]

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Clipper-PRB/1868/
Test FAILed.

[AmplabJenkins]

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Clipper-PRB/1870/
Test FAILed.

[AmplabJenkins]

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Clipper-PRB/1874/
Test FAILed.

[AmplabJenkins]

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Clipper-PRB/1879/
Test PASSed.