.SST Files #232
Comments
|
@GoatMasterXI I couldn't reproduce the issue. Could you write here the steps to reproduce? |
Can you please give me an answer to the following questions? |
|
We started using Hazelcast v5 recently and are also seeing that the management console storage directory is growing in size (ours is currently over 5GB), seemingly without bounds. Same as this issue report, lots of files with an .sst extension are stored. According to these, the default persistence of metrics should be 1 day: https://docs.hazelcast.com/management-center/5.0/metric-persistence But we see hundreds of SST files older than one day. We have not set "hazelcast.mc.metrics.disk.ttl.duration" in our system, as far as we know we are just using defaults which are advertised as being one day of retention. |
|
After setting hazelcast.mc.metrics.disk.ttl.duration to "P1D" in our code, we still see no reduction in the retention of SST files. Files older than one day are being retained. |
|
v5.0.2 of the management center reportedly fixes this: hazelcast/hazelcast#19851 |
|
any news over there? we also have alot of files, so need to understand how to cleanup |
Hi
I have the issue with a lot of .sst files filling the */metrics/datapoints/ from the pod of hazelcast.
[root@kuber01d datapoints]$ pwd /var/lib/kubelet/pods/dc5f6ab7-2905-45fb-97ae-5b2d79ab265a/volumes/kubernetes.io~csi/pvc-f27f201b-645e-4cdc-884b-4f866596ce7a/mount/metrics/datapoints [root@kuber01d datapoints]$ la total 5,6G 4,0K drwxrwsr-x. 2 65534 65534 4,0K jul 12 13:33 ./ 4,0K drwxrwsr-x. 4 65534 65534 4,0K mar 9 15:38 ../ 65M -rw-r--r--. 1 65534 65534 65M abr 18 20:09 000220.sst 65M -rw-r--r--. 1 65534 65534 65M abr 21 06:14 000233.sst 65M -rw-r--r--. 1 65534 65534 65M abr 23 16:18 000246.sst 65M -rw-r--r--. 1 65534 65534 65M abr 26 02:23 000259.sst 65M -rw-r--r--. 1 65534 65534 65M abr 28 09:03 000272.sst 59M -rw-r--r--. 1 65534 65534 59M abr 29 14:08 000284.sst 61M -rw-r--r--. 1 65534 65534 61M abr 30 16:26 000295.sst 63M -rw-r--r--. 1 65534 65534 63M may 1 18:06 000306.sst 64M -rw-r--r--. 1 65534 65534 64M may 2 21:29 000317.sst 61M -rw-r--r--. 1 65534 65534 61M may 3 23:49 000328.sst 63M -rw-r--r--. 1 65534 65534 63M may 5 01:53 000339.sst 64M -rw-r--r--. 1 65534 65534 64M may 6 03:47 000350.sst 65M -rw-r--r--. 1 65534 65534 65M may 7 05:44 000361.sst 65M -rw-r--r--. 1 65534 65534 65M may 8 08:04 000372.sst 63M -rw-r--r--. 1 65534 65534 63M may 9 10:58 000383.sst 61M -rw-r--r--. 1 65534 65534 61M may 10 14:06 000394.sst 60M -rw-r--r--. 1 65534 65534 60M may 11 17:05 000405.sst 61M -rw-r--r--. 1 65534 65534 61M may 12 19:39 000416.sst 61M -rw-r--r--. 1 65534 65534 61M may 13 22:25 000427.sst 60M -rw-r--r--. 1 65534 65534 60M may 15 00:49 000438.sst 61M -rw-r--r--. 1 65534 65534 61M may 16 03:33 000449.sst 61M -rw-r--r--. 1 65534 65534 61M may 17 06:10 000460.sst 62M -rw-r--r--. 1 65534 65534 62M may 18 08:18 000471.sst 62M -rw-r--r--. 1 65534 65534 62M may 19 10:22 000482.sst 61M -rw-r--r--. 1 65534 65534 61M may 20 11:51 000493.sst 64M -rw-r--r--. 1 65534 65534 64M may 21 13:38 000504.sst 63M -rw-r--r--. 1 65534 65534 63M may 22 14:47 000515.sst 64M -rw-r--r--. 1 65534 65534 64M may 23 16:43 000526.sst 62M -rw-r--r--. 1 65534 65534 62M may 24 18:31 000537.sst 62M -rw-r--r--. 1 65534 65534 62M may 25 19:09 000548.sst 65M -rw-r--r--. 1 65534 65534 65M may 26 20:19 000559.sst 148K -rw-r--r--. 1 65534 65534 147K may 26 20:19 000560.sst 64M -rw-r--r--. 1 65534 65534 64M may 27 22:30 000571.sst 61M -rw-r--r--. 1 65534 65534 61M may 29 00:08 000582.sst 62M -rw-r--r--. 1 65534 65534 62M may 30 01:54 000593.sst 61M -rw-r--r--. 1 65534 65534 61M may 31 03:34 000604.sst 61M -rw-r--r--. 1 65534 65534 61M jun 1 05:12 000615.sst 62M -rw-r--r--. 1 65534 65534 62M jun 2 07:11 000626.sst 61M -rw-r--r--. 1 65534 65534 61M jun 3 09:43 000637.sst 59M -rw-r--r--. 1 65534 65534 59M jun 4 12:05 000648.sst 58M -rw-r--r--. 1 65534 65534 58M jun 5 14:30 000659.sst 58M -rw-r--r--. 1 65534 65534 58M jun 6 16:52 000670.sst 59M -rw-r--r--. 1 65534 65534 59M jun 7 19:16 000681.sst 59M -rw-r--r--. 1 65534 65534 59M jun 8 21:37 000692.sst 59M -rw-r--r--. 1 65534 65534 59M jun 9 23:56 000703.sst 59M -rw-r--r--. 1 65534 65534 59M jun 11 02:30 000714.sst 59M -rw-r--r--. 1 65534 65534 59M jun 12 04:47 000725.sst 59M -rw-r--r--. 1 65534 65534 59M jun 13 07:17 000736.sst 59M -rw-r--r--. 1 65534 65534 59M jun 14 09:40 000747.sst 59M -rw-r--r--. 1 65534 65534 59M jun 15 10:36 000758.sst 63M -rw-r--r--. 1 65534 65534 63M jun 16 10:57 000769.sst 63M -rw-r--r--. 1 65534 65534 63M jun 17 11:09 000780.sst 64M -rw-r--r--. 1 65534 65534 64M jun 18 16:47 000793.sst 64M -rw-r--r--. 1 65534 65534 64M jun 19 16:46 000804.sst 64M -rw-r--r--. 1 65534 65534 64M jun 20 11:39 000813.sst 60M -rw-r--r--. 1 65534 65534 60M jun 21 12:47 000824.sst 60M -rw-r--r--. 1 65534 65534 60M jun 22 18:39 000837.sst 62M -rw-r--r--. 1 65534 65534 62M jun 23 18:15 000848.sst 62M -rw-r--r--. 1 65534 65534 62M jun 24 17:39 000859.sst 62M -rw-r--r--. 1 65534 65534 62M jun 25 17:09 000870.sst 63M -rw-r--r--. 1 65534 65534 63M jun 26 11:15 000879.sst 62M -rw-r--r--. 1 65534 65534 62M jun 27 12:00 000890.sst 60M -rw-r--r--. 1 65534 65534 60M jun 28 12:41 000901.sst 60M -rw-r--r--. 1 65534 65534 60M jun 29 17:39 000914.sst 62M -rw-r--r--. 1 65534 65534 62M jun 30 17:49 000925.sst 61M -rw-r--r--. 1 65534 65534 61M jul 1 17:33 000936.sst 62M -rw-r--r--. 1 65534 65534 62M jul 2 11:42 000945.sst 61M -rw-r--r--. 1 65534 65534 61M jul 3 12:16 000956.sst 59M -rw-r--r--. 1 65534 65534 59M jul 4 12:53 000967.sst 59M -rw-r--r--. 1 65534 65534 59M jul 5 13:28 000978.sst 59M -rw-r--r--. 1 65534 65534 59M jul 6 14:04 000989.sst 59M -rw-r--r--. 1 65534 65534 59M jul 7 14:41 001000.sst 58M -rw-r--r--. 1 65534 65534 58M jul 8 15:17 001011.sst 59M -rw-r--r--. 1 65534 65534 59M jul 9 15:30 001022.sst 60M -rw-r--r--. 1 65534 65534 60M jul 10 20:42 001035.sst 5,9M -rw-r--r--. 1 65534 65534 5,9M jul 11 14:13 001043.sst 63M -rw-r--r--. 1 65534 65534 63M jul 11 20:02 001046.sst 71M -rw-r--r--. 1 65534 65534 22M jul 12 15:48 001051.log 65M -rw-r--r--. 1 65534 65534 65M jul 12 13:33 001053.sst 6,8M -rw-r--r--. 1 65534 65534 6,8M jul 12 13:33 001054.sst 4,0K -rw-r--r--. 1 65534 65534 16 abr 7 09:01 CURRENT 4,0K -rw-rw-r--. 1 65534 65534 37 mar 9 15:38 IDENTITY 0 -rw-rw-r--. 1 65534 65534 0 mar 9 15:38 LOCK 92M -rw-r--r--. 1 65534 65534 92M jul 12 15:41 LOG 644K -rw-rw-r--. 1 65534 65534 550K abr 7 09:00 LOG.old.1617778866882699 4,0M -rw-r--r--. 1 65534 65534 73K jul 12 13:33 MANIFEST-000155 8,0K -rw-rw-r--. 1 65534 65534 5,1K abr 6 16:52 OPTIONS-000150 8,0K -rw-r--r--. 1 65534 65534 5,1K abr 7 09:01 OPTIONS-000158 [root@kuber01d datapoints]$So i have 3 questions:
1-What are these files?
2-What happens if they are erased ?
3- Is there any maintenance to delete them?
TY
The text was updated successfully, but these errors were encountered: