Skip to content

Releases: GreptimeTeam/greptimedb

Release v0.10.0-nightly-20240805

05 Aug 01:52
3b701d8
Compare
Choose a tag to compare
Pre-release

What's Changed

Full Changelog: v0.9.1...v0.10.0-nightly-20240805

Release v0.9.1

02 Aug 09:53
fe1cfbf
Compare
Choose a tag to compare

v0.9.1

Release date: August 02, 2024

This is a patch release, containing some important bug fixes:

  • #4447: Full-text search may miss some rows when a full-text index is applied.
  • #4476: Data ingestion can stall due to missing notifications.

It's highly recommended to upgrade to this version if you're using v0.9.0.

Breaking changes

  • refactor!: Remove Mode from FrontendOptions by @zyy17 in #4401

🚀 Features

🐛 Bug Fixes

  • fix: ensure keep alive is completed in time by @WenyXu in #4349
  • fix: user provider can't be configured by config file or environment variables by @zyy17 in #4398
  • fix: dictionary key type use u32 by @evenyag in #4396
  • fix(wal): handle WAL deletion on region drop by @v0y4g3r in #4400
  • fix: add back AuthBackend which is required by custom auth backend by @sunng87 in #4409
  • fix(fulltext-index): clean up 0-value timer by @zhongzc in #4423
  • fix(metrics): RowGroupLastRowCachedReader metrics by @v0y4g3r in #4418
  • fix: information_schema tables and views column value by @killme2008 in #4438
  • fix: remove to_timezone function by @killme2008 in #4439
  • fix: use heartbeat runtime instead of background runtime by @WenyXu in #4445
  • fix(fulltext-search): prune rows in row group forget to take remainder by @zhongzc in #4447
  • fix: use status code to http status mapping in error IntoResponse by @shuiyisong in #4455
  • fix: missing pre_write check on prometheus remote write by @shuiyisong in #4460
  • fix: check_partition uses unqualified name by @waynexia in #4452
  • fix: overflow when parsing default value with negative numbers by @killme2008 in #4459
  • fix: prometheus api only returns 200 by @shuiyisong in #4471
  • fix: generate unique timestamp for inserting tests by @WenyXu in #4472
  • fix: notify flush receiver after write buffer is released by @evenyag in #4476
  • fix: avoid total size overflow by @evenyag in #4487

🚜 Refactor

  • refactor: add &mut Plugins argument in plugins setup api and remove unnecessary mut by @zyy17 in #4389
  • refactor: add get_storage_path() and get_catalog_and_schema() by @zyy17 in #4397
  • refactor(query): Remove PhysicalPlanner trait by @leaf-potato in #4412
  • refactor: Remove PhysicalOptimizer and LogicalOptimizer trait by @leaf-potato in #4426
  • refactor: add RetryInterceptor to print detailed error by @zyy17 in #4434
  • refactor(servers): improve postgres error message by @leaf-potato in #4463

📚 Documentation

⚡ Performance

⚙️ Miscellaneous Tasks

Read more

Release v0.10.0-9d5d7c1f9-20240801-1722517551

01 Aug 14:33
9d5d7c1
Compare
Choose a tag to compare

What's Changed

New Contributors

Full Changelog: v0.10.0-nightly-20240722...v0.10.0-9d5d7c1f9-20240801-1722517551

Release v0.10.0-nightly-20240722

22 Jul 01:46
2ae2a66
Compare
Choose a tag to compare
Pre-release

What's Changed

  • fix: ensure keep alive is completed in time by @WenyXu in #4349
  • chore: support pattern as pipeline key name by @shuiyisong in #4368
  • ci: disable auto review by @evenyag in #4387
  • refactor: add &mut Plugins argument in plugins setup api and remove unnecessary mut by @zyy17 in #4389
  • fix: user provider can't be configured by config file or environment variables by @zyy17 in #4398
  • feat: FLOWS table in information_schema&SHOW FLOWS by @discord9 in #4386
  • feat: export database data by @fengjiachun in #4382
  • fix: dictionary key type use u32 by @evenyag in #4396
  • fix(wal): handle WAL deletion on region drop by @v0y4g3r in #4400
  • refactor: add get_storage_path() and get_catalog_and_schema() by @zyy17 in #4397

Full Changelog: v0.9.0...v0.10.0-nightly-20240722

Release v0.9.0

16 Jul 10:49
c595a56
Compare
Choose a tag to compare

v0.9.0

Release date: July 16, 2024

👍 Highlights

  • Log Engine: Supports logging ingestion, pipeline and full-text index. GreptimeDB is now a unified time-series database for both metrics, events, and logs (trace in plan).
  • Region Failover A lot of testing work has been done and is now recommended to turn on.
  • Table View: You can now CREATE VIEW on tables and treat them as logical table.
  • Short interval literal for user experience.
  • InfluxDB Merge Read: You can now use the merge_mode=last_non_null table option to allow SELECT result merges all the last non-null fields.
  • gRPC TLS: You can now set up the grpc.tls config to turn on TLS for gRPC connection.
  • Manually Compact in Strict Window: You can now use SELECT COMPACT_TABLE("monitor", "strict_window", "3600"); to manually schedule a compaction task, splitting SST files strictly into time windows. The third option is the time window's width in seconds.

Breaking changes

  • refactor!: unify FrontendOptions and DatanodeOptions by using GrpcOptions by @realtaobo in #4088
  • feat!: reduce sorted runs during compaction by @v0y4g3r in #3702
  • fix!: forbid to change information_schema by @CookiePieWw in #4233
  • feat!: remove alias metasrv-addr by @discord9 in #4239
  • feat!: Set merge mode while creating table in influx handler by @evenyag in #4299

🚀 Features

Read more

Release v0.9.0-b2c5f8eef-20240716-1721102282

16 Jul 05:23
7b28da2
Compare
Choose a tag to compare

What's Changed

Full Changelog: v0.9.0-nightly-20240709...v0.9.0-b2c5f8eef-20240716-1721102282

Release v0.9.0-nightly-20240709

09 Jul 13:13
1ddf19d
Compare
Choose a tag to compare
Pre-release

What's Changed

  • feat: add build info for flow heartbeat task by @fengjiachun in #4228
  • feat: register & deregister region failure detectors actively by @WenyXu in #4223
  • refactor: expose DatanodeBuilder::build_object_store_manager() and MitoConfig::sanitize() by @zyy17 in #4212
  • feat: forgot collect flownode clusterinfo handler by @fengjiachun in #4236
  • feat: basic implement of matches fn by @waynexia in #4222
  • feat: flow cli for distributed by @discord9 in #4226
  • feat(puffin): implement MokaCacheManager by @zhongzc in #4211
  • refactor: use ObjectStoreManagerRef type in open_compaction_region() and add related unit test by @zyy17 in #4238
  • build(deps): Upgrade OpenDAL to 0.47 by @tisonkun in #4224
  • refactor: add interceptor after Influxdb lines are converted to grpc row insert by @MichaelScofield in #4225
  • chore: add AUTHOR.md file by @tisonkun in #4241
  • feat(puffin): complete dir support by @zhongzc in #4240
  • feat: introduce the interface of RemoteJobScheduler by @zyy17 in #4181
  • feat(fulltext_index): introduce creator by @zhongzc in #4249
  • ci: update centos yum source and specify cargo-binstall version by @zyy17 in #4248
  • refactor: add RemoteCompaction error by @zyy17 in #4251
  • refactor: change InvertedIndexWriter method signature to offsets to f… by @v0y4g3r in #4250
  • chore: reduce insertion size of fuzz test by @WenyXu in #4243
  • feat: dbeaver mysql compatibility, use statement and information_schema.tables by @sunng87 in #4218
  • fix!: forbid to change information_schema by @CookiePieWw in #4233
  • chore(ci): add timeout (60min) for fuzz tests by @WenyXu in #4255
  • feat!: remove alias metasrv-addr by @discord9 in #4239
  • feat: provide a simple way to create metaclient by @fengjiachun in #4257
  • ci: push latest greptimedb nigthly build image by @zyy17 in #4260
  • fix(puffin): fix dependency by @v0y4g3r in #4267
  • feat: implement naive fuzz test for region migration by @WenyXu in #4252
  • feat: update dashboard to v0.5.3 by @ZonaHex in #4262
  • feat: introduce FlowRouteValue by @WenyXu in #4263
  • feat(fulltext_index): integrate puffin manager with inverted index applier by @zhongzc in #4266
  • feat: handle AND/OR and priority in matches fn by @waynexia in #4270
  • chore: add missing s for --metasrv-addr by @discord9 in #4278
  • fix(fuzz): generate valid string by @WenyXu in #4281
  • feat: store peer info in TableFlowValue by @WenyXu in #4280
  • feat(fuzz): enhance condition check of region migration finish by @WenyXu in #4283
  • refactor(puffin): adjust generic parameters by @zhongzc in #4279
  • refactor: use rwlock for modifiable session data by @sunng87 in #4232
  • fix: enhance ColumnOption::DefaultValue formatting for string values by @WenyXu in #4287
  • fix: enable space string in yaml value by @shuiyisong in #4286
  • fix: align pre-commit config with make file by @shuiyisong in #4292
  • fix: call df_func with literal by @discord9 in #4265
  • feat: delete pipeline by @shuiyisong in #4156
  • feat: add path prefix label to obejct storage metrics by @sunng87 in #4277
  • fix: prepare inserting with column defaults not work, #4244 by @killme2008 in #4272
  • feat: add naive region failover test for metric table by @WenyXu in #4269
  • refactor(inverted_index): integrate puffin manager with sst indexer by @zhongzc in #4285
  • feat: expose merge_mode option by @evenyag in #4289
  • ci: retry on error during installing operator by @WenyXu in #4295
  • chore: remove original region failover implementation by @WenyXu in #4237
  • feat: refine scan metrics logging by @evenyag in #4296
  • chore: bump OpenDAL to 0.47.2 by @WenyXu in #4297
  • feat: make flow distributed work&tests by @discord9 in #4256
  • feat(remote wal): set default compresion to LZ4 by @WenyXu in #4294
  • feat(sql): add iso-8601 format support for intervals by @etolbakov in #4291
  • feat(fulltext_index): integrate full-text indexer with sst writer by @zhongzc in #4302
  • fix: deregister failure detector in region migration by @WenyXu in #4293
  • ci: retry on error or timeout during installing operator by @WenyXu in #4308
  • build(deps): upgrade opendal to 0.47.3 by @tisonkun in #4307
  • feat: impl show table status by @killme2008 in #4303
  • feat!: Set merge mode while creating table in influx handler by @evenyag in #4299
  • chore: disable TraceLayer on_failure log by @paomian in #4315
  • refactor: split match arms in prom_expr_to_plan into smaller methods by @waynexia in #4317
  • feat: support inserting into binary value through string by @CookiePieWw in #4197
  • fix(ci): remove sqlness state in success by @waynexia in #4313
  • fix: test_fulltext_intm_path by @zhongzc in #4314
  • feat(inverted_index): inverted index cache by @v0y4g3r in #4309
  • fix: error on show databases in non-default catalog by @sunng87 in #4316
  • feat(fulltext_index): allow enable full-text index in SQL and gRPC way by @zhongzc in #4310
  • build(deps): switch to upstream by @tisonkun in #4319
  • fix: panic while reading information_schema. KEY_COLUMN_USAGE by @killme2008 in #4318
  • feat: handle parentheses with unary ops by @waynexia in #4290
  • feat: enhanced the retry logic by adding a random noise by @WenyXu in #4320
  • refactor: do not print error log on PlanQuery error by @sunng87 in #4322
  • fix: support unary operator in default value, partition rule and prepare statement by @waynexia in #4301
  • feat: flownode use Inserter to write to database by @discord9 in #4323

Full Changelog: v0.9.0-nightly-20240701...v0.9.0-nightly-20240709

Release v0.9.0-nightly-20240701

01 Jul 01:51
ddc7a80
Compare
Choose a tag to compare
Pre-release

What's Changed

  • refactor: add Compactor trait to abstract the compaction by @zyy17 in #4097
  • refactor: make region manifest checkpoint ran in background by @MichaelScofield in #4133
  • refactor: Decouple dedup and merge by @evenyag in #4139
  • feat(pipeline): transform support on_failure by @yuanbohan in #4123
  • feat(pipeline): gsub prosessor by @yuanbohan in #4121
  • feat: enable metasrv to accept flownode's heartbeats by @fengjiachun in #4160
  • feat(pipeline): join processor by @shuiyisong in #4158
  • feat: update default size of bgworkers, add hbworkers by @sunng87 in #4129
  • feat: implement the OrderedBatchProducer by @WenyXu in #4134
  • feat(flow): support datafusion scalar function by @discord9 in #4142
  • feat: Implement memtable range by @evenyag in #4162
  • refactor!: unify FrontendOptions and DatanodeOptions by using GrpcOptions by @realtaobo in #4088
  • chore: bump datafusion version to fix last_value regression by @MichaelScofield in #4169
  • feat: update dashboard to v0.5.1 by @ZonaHex in #4171
  • chore: enhance add pipeline http api return data by @paomian in #4167
  • feat: register flow node by @fengjiachun in #4166
  • feat: show database options by @killme2008 in #4174
  • feat: use the write runtime to handle the heartbeats by @fengjiachun in #4177
  • perf: optimize RecordBatch to HttpOutput conversion by @waynexia in #4178
  • feat: PREPARE and EXECUTE statement from mysql client by @CookiePieWw in #4125
  • feat: introduce chaos crds by @WenyXu in #4173
  • feat: add num_rows and num_row_groups to manifest by @waynexia in #4183
  • feat: make RegionScanner aware of PartitionRange by @waynexia in #4170
  • fix: region logical regions after catching up by @WenyXu in #4176
  • feat: update dashboard to v0.5.2 by @ZonaHex in #4185
  • chore: highlight our committers in CONTRIBUTING.md by @tisonkun in #4189
  • refactor: make RegionOptions and MergeOutput serializable by @zyy17 in #4180
  • fix(flow): fix call df func bug&sqlness test by @discord9 in #4165
  • refactor: add region_dir in CompactionRegion by @zyy17 in #4187
  • feat(puffin): support lz4 compression for footer by @zhongzc in #4194
  • fix: region_peers returns same region_id for multi logical tables by @realtaobo in #4190
  • feat: heartbeat task&peer lookup in proc by @discord9 in #4179
  • feat(puffin): introduce puffin manager trait by @zhongzc in #4195
  • feat(sql): improve interval expression, support shortened version by @etolbakov in #4182
  • fix(sql): improve compound signed number processing by @etolbakov in #4200
  • test: wait until checkpoint finish by @evenyag in #4202
  • feat: Dedup strategy that keeps the last not null field by @evenyag in #4184
  • fix: align workflows again for the troublesome GHA by @waynexia in #4196
  • fix: format error correctly by @WenyXu in #4204
  • feat(puffin): implement CachedPuffinWriter by @zhongzc in #4203
  • feat: FlownodeClient by @discord9 in #4206
  • feat: bulk memtable codec by @v0y4g3r in #4163
  • docs: remove outdated docs by @evenyag in #4205
  • refactor: migrate region failover implementation to region migration by @WenyXu in #4172
  • feat(puffin): implement CachedPuffinReader by @zhongzc in #4209
  • feat: validate partition rule on create table by @waynexia in #4213
  • refactor: add SerializedPickerOutput and field modification of CompactorRequest by @zyy17 in #4198
  • fix: wrong frontend registration address by @killme2008 in #4199
  • feat(servers): make http timeout and body limit optional by @fengjiachun in #4217
  • feat(sql): add casting support for shortened intervals by @etolbakov in #4220
  • feat: Implements merge_mode region options by @evenyag in #4208
  • refactor(flow): make from_substrait_* async& worker handle refactor by @discord9 in #4210
  • test: add e2e test for region failover by @WenyXu in #4188
  • feat!: reduce sorted runs during compaction by @v0y4g3r in #3702
  • feat: output multiple partition in MergeScanExec by @waynexia in #4227
  • fix: add serialize_ignore_column_ids() to fix deserialize region options failed from json string by @zyy17 in #4229

Full Changelog: v0.9.0-nightly-20240617...v0.9.0-nightly-20240701

Release v0.9.0-nightly-20240617

17 Jun 02:06
a2e3532
Compare
Choose a tag to compare
Pre-release

What's Changed

Full Changelog: v0.8.2...v0.9.0-nightly-20240617

Release v0.8.2

15 Jun 03:59
bf3ad44
Compare
Choose a tag to compare

What's Changed

🚀 Features

🐛 Bug Fixes

🚜 Refactor

⚙️ Miscellaneous Tasks

  • chore: bump version to v0.8.2 by @WenyXu in #4141
  • chore(ci): remove redundant sqlness test config by @WenyXu in #4106
  • chore(ci): switch to aws registry by @WenyXu in #4145
  • chore(common-macro): remove features covered by full by @evenyag in #4131
  • chore: enable strip for tests-fuzz crate by @WenyXu in #4093
  • chore: reduce some burden on the write path by @fengjiachun in #4110
  • chore: remove gc before running fuzz tests by @WenyXu in #4108
  • chore: remove unused code by @WenyXu in #4135
  • chore: run fuzz tests with disk cache by @WenyXu in #4118
  • chore: run fuzz tests with kafka remote wal by @WenyXu in #4105
  • ci: add 'make run-cluster-with-etcd' to run greptimedb cluster by using docker-compose by @zyy17 in #4103
  • ci: cargo gc all fuzz test runner by @waynexia in #4081
  • ci: cargo gc fuzz test runner by @waynexia in #4074
  • ci: try to free space after fuzz tests by @WenyXu in #4089
  • test: add fuzz tests for column data type alteration by @realtaobo in #4076
  • test: run test_flush_reopen_region and test_region_replay with KafkaLogStore by @WenyXu in #4083

Build

New Contributors

Full Changelog: v0.8.1...v0.8.2