v5.4.13-16512132

RELEASE NOTE

Feature enhancement

• support file storage quick-start
• support CREATE FileStorage {'OSS'| 'LOCAL_DISK' } with (xxx)
• support DROP FileStorage {'OSS'| 'LOCAL_DISK' }
• support CREATE TABLE t_oss LIKE t_innodb engine = {'OSS'| 'LOCAL_DISK' } archive_mode = {'empty' | 'loading' | 'ttl'}
• support ALTER TABLE new_table EXCHANGE PARTITION partition_name WITH TABLE old_table;
• support SELECT * from table AS OF TIMESTAMP 'yyyy-mm-dd hh:mm;dd'
• support ALTER TABLE table_name DROP FILE file_name [,file_name...]
• support SHOW FileStorage
• support SHOW FILES FROM oss_table
• support SHOW CACHE_STATS
• support SHOW ARCHIVE
• support UNARCHIVE table source_table

发布说明

特性更新

• 支持 file storage quick-start
• 支持 CREATE FileStorage {'OSS'| 'LOCAL_DISK' } with (xxx)
• 支持 DROP FileStorage {'OSS'| 'LOCAL_DISK' }
• 支持 CREATE TABLE t_oss LIKE t_innodb engine = {'OSS'| 'LOCAL_DISK' } archive_mode = {'empty' | 'loading' | 'ttl'}
• 支持 ALTER TABLE new_table EXCHANGE PARTITION partition_name WITH TABLE old_table;
• 支持 SELECT * from table AS OF TIMESTAMP 'yyyy-mm-dd hh:mm;dd'
• 支持 ALTER TABLE table_name DROP FILE file_name [,file_name...]
• 支持 SHOW FileStorage
• 支持 SHOW FILES FROM oss_table
• 支持 SHOW CACHE_STATS
• 支持 SHOW ARCHIVE
• 支持 UNARCHIVE table source_table

galaxysql-5.4.13-16512132-alpha-2

Merge pull request #50 from burhanxz/feature/support_create_filestorage

Feature/support create filestorage

galaxysql-5.4.13-16511320-alpha-1

support file storage

v5.4.13

RELEASE NOTE

Feature enhancement

• Support create database with auto mode (two optional mode: auto or drds mode) , drds is the default option
• Support create table with MySQL compatible syntax for partition-table， including hash/key/list/range types, but not support subpartition yet.
• Support dynamic partition pruning, including collapse conditions of constant/literal， prefix match prunning, combine overlapping range scan etc.
• Support join-wise push down for partitioning table.
• Support add/drop/split/merge/move partition operation for partitioning table.
• Support create GSI for hash/key/list/range partitioning table.
• Support use primary key as partition key and compute the partition member automatically for the tables in auto-mode database.
• Support to change the partition strategy for tables in auto-mode database.
• Support to add primary key as additional partition key for GSI to avoid the GSI table data skew.
• Support Scale-in.
• Support TTL in auto-mode database.
• Optimize check table to validate the meta consistency(including partitioning information, column information) for table and its GSI.
• Support broadcast table as candiate for SQL Advisor feature.
• Support instant add column.
• Support to collect all information for optimizer when use explain statistics command.
• Support limit the search space of CBO and reduce the optimization time of complex queries.
• Optimize the validation data phase of ddl operation to speed up the GSI/Scale in/out operation.
• Support MySQL compatible replica command.
• Support GalaxyEngine cluster.

Bugfix

• Fix the NPE and sort error issues of heuristic join reorder
• Fix the RelNode rowtype error cause by AccessPathRule
• Fix the GSI data inconsistency issue when the collaction is utf8mb4_0900_ai_ci
• Fix the maximum login times cannot take effect
• Fix inaccurate estimate size in some block data types
• Fix missing accuracy of Deciaml for GalaxySQL communication protocol.
• Fix the Byte and Char types error when push down execution plan to MySQL in GalaxySQL communition protocol.
• Fix index metadata is missing after alter table add/drop primary Key
• Fix the shards/partitions definition inconsistency issue caused by interrupt or timeout during alter Table
• Fix can't rollback automatically when all the sub-operations are failed for alter table
• Fix possible NPE when input the empty resultset for the sortAgg operation

发布说明

特性更新

• 新增 支持创建数据库指定建表模式(新的分区表模式与老的分库分表模式)，默认是分库分表模式
• 新增 支持使用 MySQL分区表语法 创建一级分区的分区表，分区策略包括Hash/Range/List等
• 新增 支持分区表的动态裁剪能力，包括支持分区列条件的常量折叠、区间合并以及前缀查询裁剪等功能
• 新增 支持分区表的JOIN计算下推
• 新增 提供分区表的分区管理能力，包括分区的添加、删除、分裂、合并与迁移等功能
• 新增 提供表组及其他能力（包括表组的创建、删除、变更等），支持分区变更期间JOIN计算下推不受影响
• 新增 支持全局索引表使用MySQL分区表语法并按Hash/Range/List等分区策略进行分区
• 新增 自动拆分支持使用分区表语法
• 新增 拆分变更增加支持分区表
• 新增 新分区表GSI自动拆分会携带主键，可以处理GSI热点问题
• 新增 支持实例的缩容
• 新增 支持分区表的TTL及其管理能力（包括调整TTL的初始时间与时间间隔等）
• 优化 Check Table 指令，支持校验主表分区、索引表分区与列定义等元数据一致性
• 新增 SQL Advisor支持推荐广播表
• 新增 支持Instant Add Column功能
• 新增 支持Explain Statistics拉取优化器优化需要的所有信息
• 新增 限制cbo的搜索空间，减少复杂查询的优化耗时
• 优化 部分DDL后台操作的数据校验任务的性能，使GSI/扩缩容DDL变更操作加速
• 新增 支持兼容MySQL的Replica相关指令
• 新增 支持存储节点PAXOS三节点集群

问题修复

• 修复 heuristic join reorder的空指针和排序报错的问题
• 修复 AccessPathRule导致的RelNode rowtype错误的问题
• 修复 当 collate 为 utf8mb4_0900_ai_ci 时，建 GSI 导致数据不一致的问题。
• 修复 最大登录次数无法生效的问题
• 修复 某些block中estimateSize不准确的问题
• 修复 私有协议下Deciaml精度缺失是问题
• 修复 私有协议下执行计划传输byte和char类型对比报错的问题
• 修复 Alter Table Add/Drop Primary Key后索引元数据缺失问题
• 修复 Alter Table期间外部中断或物理分片超时导致的表结构不一致问题
• 修复 Drop index所有物理分片都失败时不自动回滚的问题
• 修复 sortAgg在结果集为空时可能抛NPE的问题

galaxysql-5.4.13-alpha-1

5.4.13 release

v5.4.12

RELEASE NOTE

Feature enhancement

• Support access GalaxySQL from maxwell and debezium
• Support the separation of reading and writing for RW node
• Support set TLS version based on jdk version
• Support statement SHOW GRANTS FOR CURRENT_USER
• Support disable cost estimation for LogicalView with hint ENABLE_LOGICALVIEW_COST=false
• Support auto rollback for ALTER TABLE ddl task
• Add precheck for ALTER TABLE task
• Add records for information_shema in result of SHOW DATASOURCES
• Avoid pushing uncorrelate node into lv with variables set
• Try transform filter downside of projects with uncorrelate scalar subquery
• Change the level of spm null point log from error to info
• More literal expression supported for SET statement
• Optimize the execution of apply executor for IN subquery
• Optimize duplicate check for insert statement executed with logical multi write
• Optimize physical query with limit
• Remove PostPlanner segmented check
• Optimize Compare function for FactorCostComparator
• Support huge memory size in startup.sh
• Limit length of SHOW JOBS result to 500
• Add sample rate to accurate count num from TopN
• Rollback transaction after ERR_TRANS_DEADLOCK exception

Bugfix

• Fix AES encryption when key length greater than 16 bytes
• Fix the issue of LIMIT + physical sql cache leads to empty result set of SELECT statement with LIMIT clause
• Fix alter table add index without specifying index name issue that can cause failure of inserting index metadata
• Fix index meta missed issue when altering table add multiple indexes with the same columns
• Fix a NPE issue of simple sequence validation
• Fix DDL task issue of executed by 2 CN during leader election
• Fix a concurrent physical ddl issue that cannot recover ddl task after task paused
• Fix the issue of traceid of transaction changed after execution of ddl
• Fix the issue of subtask not exit correctly while there occurs an out of memory exception
• Fix the issue of MOVE DATABASE task cannot be recovered for some case
• Fix cn/dn mapping maintaining issue that can cause failure of scale out task
• Fix the invalidation of baseline caused by DDL
• Fix the NPE issue for baseline sync
• Fix the issue of plan leaking in baseline
• Fix backfillRows of show stats
• Fix memorypool leaking issue for some case
• Fix case sensitive issue for table meta initialization that can cause some column mata not loaded
• Fix virtual_statistic result not correct issue which is caused by lack of table meta
• Fix physical sql for statement using inventory hint
• Fix execution error of statement using SCAN HINT, which is caused by table name not surrounded by backquote
• Fix execution error of BkaJoin, which is caused by physical sql like ' xx in row(EMPTY)' generated
• Fix wrong physical sql of order by [index]
• Fix sql template cache when there exists scalar subquery in logicalview.
• Fix rex literal transform issue in subquery apply executor.
• Fix for get cost after execution
• Fix npe issue when optimizer trying to get the statisic of index
• Fix estimated size in some block
• Fix the issue of "Snapshot Too Old" for long-lasting transaction
• Fix the wrong UPDATE result issue for some case of using ON UPDATE TIMESTAMP column as partition key
• Fix the issue of UPDATE column with property AUTO_INCREMENT
• Fix UPSERT BIT type column issue that can cause UPSERT failure
• Fix UPDATE blob type column issue that in some case can cause wrong update result
• Fix setting value for AUTO_INCREMENT column issue for INSERT SELECT statement without target column
• Fix logical multi-write issue for REPLACE statement in isolation level read committed
• Fix ddl validation for not support using SET type column as sharding key
• Fix undefined user variable for sum
• Fix the issue of SetHandler#parserValue
• Fix DESC issue that can cause executeion failure on system table
• Fix execution issue of statament EXPLAIN ANALYZE LIMIT
• Fix exception "Failed to create vectorized expression"
• Fix aggregation function execution issue for UNION statement without actual table
• Fix the issue of SHOW DS STATUS and KILL ALL not work at RO instance in some case
• Fix execution issue of SHOW TABLES using readonly connection
• Fix the issue that condition derivation not adapted for subquery materialize
• Fix a issue about login
• Fix issues about MySQL compatibility

发布说明

特性更新

• 新增 ALTER TABLE 校验，提前拒绝执行不支持的 ALTER TABLE 语句
• 新增 CN 启动参数，支持设置 LargePage
• 新增 SHOW DATASOURCES 中加入 information_schema 的相关信息
• 新增 兼容 debezium 使用到的特殊 sql 语句
• 新增 在主实例上引入读写分离能力
• 新增 基于 JDK 版本自适应设置 TLS 版本号
• 新增 支持 SHOW GRANTS FOR CURRENT_USER 语句
• 新增 通过 HINT ENABLE_LOGICALVIEW_COST 关闭 LogicalView 的代价估算
• 新增 限制 SHOW JOBS 的 phyProcess 最长为500
• 优化 非相关联子查询物理 SQL 结构
• 优化 IN 类 APPLY 子查询的执行效率, APPLY 执行器支持物化方式执行
• 优化 逻辑多写 Duplicate Check 的执行性能
• 优化 SET 语句支持的表达式范围
• 优化 ALTER TABLE 支持自动回滚
• 优化 物理 SQL 包含 LIMIT 的场景
• 优化 去除 PostPlanner segmented check
• 优化 禁用集合类型作为拆分键
• 优化 FactorCostComparator 中的 Compare 函数性能

问题修复

• 修复 AES加密函数当密钥长度超过16字节时结果不正确
• 修复 LIMIT + 物理 SQL CACHE 导致 LIMIT 查询结果为空的问题
• 修复 ALTER TABLE 为同一列多次新增不带索引名的索引时元数据插入失败的问题
• 修复 ALTER TABLE 新增多个包含同一字段的索引后，部分索引元数据缺失
• 修复 ALTER TABLE 语句通过 Auto_Increment 子句修改 Sequence 起始值时发生 NPE
• 修复 CN 发生切主时，2 个 CN 可能同时执行同一个 DDL 任务的问题
• 修复 DDL 分库间并行策略下的任务中断后，任务恢复执行卡住的问题
• 修复 DDL 导致事务 ID 发生变化
• 修复 OOM 时 DDL 引擎中子线程没有正确退出的问题
• 修复 MOVE DATABASE 任务中断恢复的问题
• 修复 创建建连接池异常，导致 scaleout 任务中断的问题
• 修复 SPM 在 fix sql 时不会受 DDL 影响而失效
• 修复 baseline fix 时会概率性 sync 失败的问题
• 修复 在复杂 SQL 较多的场景中, baseline 存储的 plan 有概率超出最大值泄露的问题
• 修复 TopN 因采集数据过大导致的估算问题
• 修复 SHOW STATS 中的 backfillRows 统计
• 修复 异常情况下，memory pool 对象未被 destory 情况
• 修复 批量加载 table meta 时候，表名的大小写会导致列加载不到的问题
• 修复 virtual_statistic 视图因 table meta 获取不到导致的展示问题
• 修复 热点更新的下推 SQL
• 修复 通过 HINT 下推的 SQL 表名没有带反引号，导致报错的问题
• 修复 物理 SQL 中出现' xx in row(EMPTY)' 导致报错的问题 ...

v5.4.12-alpha-1

galaxysql-5.4.12-alpha-1

5.4.12 release