Commit Graph

15179 Commits

Author SHA1 Message Date
da03a50824 [refine](pipelineX) refine dataqueue set source ready block (#27733) 2023-11-30 13:00:18 +08:00
7f13dcc726 [refactor](cluster)(step-3) remove cluster related to Auth (#27718)
Remove `default_cluster` prefix related to:
1. User
2. Role
3. UserManager
4. RoleManager
5. UserRoleManager
6. UserProperty
7. Create/Drop user Stmt
8. Create/Drop role Stmt
9. Grant/Revoke
2023-11-30 12:46:08 +08:00
112ae59aa4 [fix](move-memtable) add timeout for load stream close wait (#27439) 2023-11-30 12:00:06 +08:00
34e53acaea [pipelineX](fix) Fix local exchange on pipelineX engine (#27763) 2023-11-30 11:16:20 +08:00
5739167142 [feature](window_function) support to secondary argument to ignore null values in first_value/last_value (#27623) 2023-11-30 09:56:43 +08:00
e9debca97c [Improve](sort) avoid too may tmp vectors for get_columns (#27734) 2023-11-30 09:47:31 +08:00
1f9aa8ab16 [fix](group commit) Fix some group commit problems (#27769) 2023-11-29 23:43:21 +08:00
d96e2dfefb [feature-wip](arrow-flight)(step5) Support JDBC and PreparedStatement and Fix Bug (#27661) 2023-11-29 21:17:20 +08:00
19ecb3a8a2 [opt](stats) Use escape rather than base64 for min/max value (#27746) 2023-11-29 21:13:33 +08:00
acc14d7e4c [feature](Planner): Push down LimitDistinct through Union (#27745) 2023-11-29 21:12:42 +08:00
83ed8d3cba [Feat](Nereids) join hint support stage one (#27378)
support view as a independent unit of leading hint
add random test check of leading hint query
add more test with data of leading hint query
add random test check of distribute hint
2023-11-29 21:08:08 +08:00
6cdaf8ea32 [bugfix](profile) insert into select profile could not build successfully(#27756)
Co-authored-by: yiguolei <yiguolei@gmail.com>
2023-11-29 20:44:25 +08:00
d00c04ccc1 [enhancement](stats) limit bq cap size for analyze task (#27685) 2023-11-29 20:35:56 +08:00
ba6219c3c3 [fix](stats) Fix show auto analyze missing jobs bug (#27755) 2023-11-29 20:33:29 +08:00
ce271ff382 [fix](parquet)fix can not read parquet lz4 compress. (#27383)
Fixed the problem of not being able to read parquet lz4 compressed format. By default, it is decompressed according to the Hadoop lz4 format. If it fails, it will fall back to the standard lz4 compression format.
2023-11-29 19:04:53 +08:00
c99eb5d80f [fix](multi-catalog)add properties converter fe ut (#27254) 2023-11-29 19:01:29 +08:00
573f0eaad9 [fix](regression)fix parquet data page v2 unstable case (#27753) 2023-11-29 18:58:37 +08:00
f1e9e6dba8 [fix](pipelineX) make RuntimeFilterTimerQueue graceful exit (#27653)
make RuntimeFilterTimerQueue graceful exit
2023-11-29 18:53:13 +08:00
498d27c905 [improve](json_reader) add prompt when all fields is null (#27630) 2023-11-29 18:26:42 +08:00
e208072a06 [fix](gc tablet) fix get shutdown tablet cost a lot time (#27693) 2023-11-29 17:35:14 +08:00
b152abc292 [fix](faststring) fix memtracking in faststring free (#27731) 2023-11-29 17:05:14 +08:00
4633a5c49b [chore](log) Warning log to trace send fragment #27738 2023-11-29 16:43:25 +08:00
9daa7dc6b5 [refactor](http) disable snapshot and get_log_file api (#27724)
Disable 2 http api by default:

1. BE's `/api/snapshot`
2. FE's `/get_log_file`
2023-11-29 16:11:51 +08:00
c30299cbf7 [docs](partition) Improve auto partitions document (#27662) 2023-11-29 15:08:52 +08:00
d9d5468621 [feature](audit-log) add audit-log in insert into (#27641) 2023-11-29 15:01:57 +08:00
32367c6d97 [chore](checkstyle): forbid lombok in Nereids (#27700) 2023-11-29 14:06:20 +08:00
d456515675 [fix](ci) fix bug when comment endwith \r (#27742)
Co-authored-by: stephen <hello-stephen@qq.com>
2023-11-29 13:39:51 +08:00
f3a1abf20b [chore](compile) fix compile error in ColumnObject (#27739)
This is issue is caused by the two PR merged without conflict
2023-11-29 13:39:32 +08:00
2b375f66e0 [feature](Nereids): add functional dependencies (#27051)
Add functional dependencies: including

- uniform slot, which means ndv <= 0
- unique slot, which means ndv = row cound
2023-11-29 12:46:25 +08:00
2a66a5d167 [doc](fix) k8s operator docs fix (#27479) 2023-11-29 10:52:33 +08:00
7923365dd4 [fix](doc)add config for delete timeout job (#27629) 2023-11-29 10:51:46 +08:00
7398c3daf1 [Feature-Variant](Variant Type) support variant type query and index (#27676) 2023-11-29 10:37:28 +08:00
3bc09e55f6 [Improvement](unset_variable) add docs for unset-variable stmt and update privilege check (#27672) 2023-11-29 10:30:18 +08:00
6371dbab33 [Pipeline](load) fix may oom in pipeline load (#27714) 2023-11-29 10:20:59 +08:00
9870817def add query queue regression test (#27613) 2023-11-29 10:00:20 +08:00
b3111e47ff [Improvement](statistics)Add config for the threshold of column count for auto analyze (#27713) 2023-11-29 09:30:26 +08:00
0078a445d2 [fix](pipelineX) make union source do not block (#27721) 2023-11-28 23:24:56 +08:00
d771f16b79 [fix](parquet)fix bug that can not read parquet data page v2 (#27655) 2023-11-28 22:43:46 +08:00
aa6573db4f [fix](statistics)Fix sample min max npe bug (#27702)
Min and max value may be NULL, need to handle this case in sample analyze.
2023-11-28 21:24:20 +08:00
8910772cb8 [pipelineX](log) refine debug string (#27712) 2023-11-28 21:15:52 +08:00
c6f43e4241 [Fix](show-load)Show load npe(userinfo is null) (#27698) 2023-11-28 21:07:32 +08:00
f54db85ea3 [Opt](compression) Opt gzip decompress by libdeflate on X86 and X86_64 platforms: 2. Opt gzip decompression by libdeflate lib. (#27669)
Opt gzip decompress by libdeflate on X86 and X86_64 platforms: 2. Opt gzip decompression by libdeflate after adding libdeflate lib in #27542.
2023-11-28 20:05:24 +08:00
Pxl
d969047b50 [Refactor](join) refactor of hash join (#27557)
Improve the performance under the tpch data set by reconstructing the join related code and the use of hash table

Co-authored-by: HappenLee <happenlee@hotmail.com>
Co-authored-by: BiteTheDDDDt <pxl290@qq.com>
2023-11-28 19:46:00 +08:00
1b509ab13c [Fix](statistics)Need to recalculate health value when table row count become 0 (#27673)
Need to recalculate health value when table row count become 0. Otherwise, when user truncate a table, the old statistics will not be updated.
2023-11-28 18:47:12 +08:00
38d30f21f1 [pipelineX](bug) Fix scan dependency timeout (#27696) 2023-11-28 18:21:11 +08:00
Pxl
91b0edfaa2 [Bug](join) try fix wrong _has_null_in_build_side setted (#27684)
try fix wrong _has_null_in_build_side setted
2023-11-28 17:42:14 +08:00
b93dd1d5f7 [enhancement](load) improve error msg for load when cancelled by mem gc (#26809)
Signed-off-by: freemandealer <freeman.zhang1992@gmail.com>
2023-11-28 17:36:11 +08:00
7087250b4a [fix](insert) txn insert and group commit should write \N string corr… (#27637) 2023-11-28 17:32:50 +08:00
f0dbce4cf5 [fix](Nereids) compound predicate need cast children to boolean (#27649) 2023-11-28 16:55:44 +08:00
3d46643dab [feature](Nereids): rewrite count(null) to 0 (#27471)
select count(null) --> select 0
2023-11-28 16:25:34 +08:00