We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
目前以sharding模式部署pika集群,5台物理机(64C 256G SSD,8TB,分三个盘),每台物理机3个pika实例,1主2从。
目前主要使用的是string结构做kv存储,数据量大概在5TB左右,每天都会有抖动和慢查询,请问有没有地方能做优化和改进。
The text was updated successfully, but these errors were encountered:
1 数据抖动的时间是集中在写入的时候吗?如果是这样,可以认为写入操作时的flush 对性能的影响,新版rocksdb对这个问题做了优化,pika也在升级rocksdb中。 2 如果是查询抖动,可以考虑适当增加max-open-file,和max-memory。
Sorry, something went wrong.
我的应用是读多写少,抖动都是查询抖动,我看了下max-open-file目前是65535,而pika进程用到的才2w多,max-memory目前是无限制。
伴随着查询抖动都能看到物理机上iowait偏高,而单节点的qps不到1w,当时的慢查询有的快10s的请求耗时,导致那个时间点大量的超时。
No branches or pull requests
目前以sharding模式部署pika集群,5台物理机(64C 256G SSD,8TB,分三个盘),每台物理机3个pika实例,1主2从。
目前主要使用的是string结构做kv存储,数据量大概在5TB左右,每天都会有抖动和慢查询,请问有没有地方能做优化和改进。
The text was updated successfully, but these errors were encountered: