If the string containing symbols in the query of loki log on grafana, the query will fail

[chown1987]

If the string containing symbols in the query of loki log on grafana, the query will fail

[akvlad]

Could you please provide the whole logql request you do? with the secret data hidden of course. But the symbols you're talking about in place?

And the error logs from the server as well, if possible?

[chown1987]

I installed grafana on the cloud server, and then ran cloki and clickhouse with docker compose. Finally, I used grafana to add cloki's data source. I found that I could not query the string containing special titles on grafana, and reported an internal server error. Even underscores did not work, which was very strange.

[lmangani]

@chown1987 are you running cloki (old) or qryn (current)?
We need details of the query (special characters? non-iso?) and the logs from the qryn service while this happens.

[chown1987]

I am running image: qxip/qryn:latest, and the query keyword contains double quotes and an internal server error is reported.

[lmangani]

@chown1987 "Internal Server Error" is what Grafana receives. We're asking for the qryn container logs please, which should show the actual internal error(s) just before the 500 is sent back to the client.

[chown1987]

Hello! The log is as shown in the attachment
error_log.txt

[akvlad]

@chown1987
Apparently you have something wrong with the clickhouse instance you use:

DB::Exception: Memory limit (total) exceeded: would use 1.11 GiB (attempt to allocate chunk of 4550387 bytes), current RSS 481.95 MiB, maximum: 921.60 MiB. OvercommitTracker decision: Query was selected to stop by OvercommitTracker

This error has nothing to do with the qryn request. Please check the clickhouse configuration or clickhouse instance capabilities.
1GB RAM is like nothing for a clickhouse instance. The latest versions of CH demand https://clickhouse.com/docs/en/operations/tips#using-less-than-16gb-of-ram 32GB RAM at least. 16GB are suboptimal.

[chown1987]

I increased the memory of clickhouse to 16GB, and then tried to query the keyword with double quotes, and it reported "invalid request". Can you help me take a look?

[chown1987]

The following is the internal log information of the container after querying in Grafana
error_log1.txt

[chown1987]

Please help me solve it again.