Commit Graph

13726 Commits

Author SHA1 Message Date
8ee2e40812 [enhancement](zone_map_index) use direct_copy_may_cut instead of direct_copy(#24880) 2023-09-25 22:32:18 +08:00
8191cd1dad [Bug](ScanNode) Fix potential incorrect query result caused by concurrent NewOlapScanNode initialization and Compaction (#24638)
* Optimize fetch delete predicates

* Fix incorrect query result when compaction eliminate delete predicates between `NewOlapScanNode::_init_scanners` and `NewOlapScanner::init`

* Fix be ut
2023-09-25 22:24:35 +08:00
8d4fd76a16 [Feature](StreamLoad2PC) Support commit and abort streamload2PC by label (#24613) 2023-09-25 22:21:27 +08:00
158570787a [fix](multi-catalog)The external catalog does not have verification parameters, causing an error to be reported when creating the catalog. (#24393) 2023-09-25 21:35:52 +08:00
12bee54cf7 [fix](Nereids) function implict cast for json is not work well (#24852)
for sql like:

SELECT JSONB_EXTRACT('{"k1":"v31","k2":300}','$.k1');

the result should be

+------------------------------------------------+
| jsonb_extract('{"k1":"v31","k2":300}', '$.k1') |
+------------------------------------------------+
| "v31"                                          |
+------------------------------------------------+

but curent result is

+------------------------------------------------+
| jsonb_extract('{"k1":"v31","k2":300}', '$.k1') |
+------------------------------------------------+
| <null>                                         |
+------------------------------------------------+
2023-09-25 21:10:04 +08:00
b38b8b4494 [pipelineX](fix) Fix BE crash caused by join and constant expr (#24862) 2023-09-25 21:01:09 +08:00
6502da8917 [bugfix](restore) add partition id into convert_rowset_ids() (#24834) 2023-09-25 20:07:24 +08:00
9dff620471 [feature](binlog) add truncate table binlog (#24868)
Signed-off-by: Jack Drogon <jack.xsuperman@gmail.com>
2023-09-25 19:53:42 +08:00
59c494eb27 [fix](Docs) Modify documents about SELECT INTO OUTFILE and EXPORT (#24641) 2023-09-25 19:51:15 +08:00
3e686f4306 [feature](javaudf)support no input java udf (#24457)
* support no input java udf

* add license
2023-09-25 18:56:44 +08:00
8679095e5c [feature](debug) support debug point used in debug code (#24502) 2023-09-25 17:56:12 +08:00
90791f0b19 [fix](nereids)fix bug of exists subquery with limit clause (#24630)
create table t1(c1 int, c2 int);
create table t2(c1 int, c2 int);
insert into t1 values (1,1);
insert into t2 values (1,1);

select * from t1 where exists (select * from t2 where t1.c1 = t2.c1 limit 0);

the result should be empty set.
2023-09-25 17:15:08 +08:00
60af62b41e [enhancement](Nereids) remove deriveStats jobs for some groupExpression (#24835)
Don't call DeriveStatJob for follow group expressions:

- the group expression that is generated by the joinCommute rule
- the group expression that is generated by the implementation rule without creating a new group
2023-09-25 17:14:16 +08:00
3b4d8b4ac8 [pipelineX](feature) Support schema scan operator (#24850) 2023-09-25 14:42:25 +08:00
9412775686 remove useless variable in scanctx (#24849)
remove useless variable in scanctx
2023-09-25 14:36:18 +08:00
xfz
1b95ce1d93 [feature](json-function) add json_insert, json_replace, json_set functions (#24384)
[feature](json-function) add three json funcitons
2023-09-25 12:52:29 +08:00
82b393314c [enhancement](Nereids) check unimplemented func in nereids (#24766) 2023-09-25 12:45:11 +08:00
2d0ac7117a [enhancement](show-frontends-disks) Add disk info corresponding to deploy dir in frontend disk info (#24726) 2023-09-25 11:14:03 +08:00
cdc8189697 [Impro](regression-test) More test cases for function round (#24791) 2023-09-25 10:39:45 +08:00
c9ef5ef2b1 [refactor](profile) refactor join node profile when build side shared hash table (#24785)
refactor join node profile when build side shared hash table
2023-09-25 10:28:16 +08:00
312576b93c [typo](docs) modify flink connector document error (#23967) 2023-09-25 10:11:33 +08:00
39e6512a21 [bug](scanner) Fix memory out of bound in scanner scheduler (#24840) 2023-09-25 09:58:26 +08:00
ec93ea22b3 [bugfix](Coordinator) The error msg hide host info exclude localhost (#24817)
Exception information is incomplete when localhost exists in the log.
2023-09-25 09:45:00 +08:00
129ffb7dd7 [docs](docs)fix display error #24775 2023-09-25 08:38:51 +08:00
9579634eac [Debug](pipeline) add log of pipeline scan bug (#24804) 2023-09-25 08:38:31 +08:00
aea0279f25 [chore](build) Fix issues with GLIBC dependency (#24837)
Linking with libabsl_random_internal_seed_material.a instead of glibc to fix this issue #24838 .
2023-09-25 08:21:19 +08:00
8fd27a852c [fix](transaction) fix profile null exception cause txn stuck (#24813) 2023-09-24 23:46:38 +08:00
ef72321878 [fix](regression-text)fix test_path_partition_keys regression test (#24796)
fix test_path_partition_keys regression test
2023-09-24 23:32:33 +08:00
16aee69911 [improvement](tablet schedule) disk balance skip cooldown storage (#24580) 2023-09-24 23:09:29 +08:00
900b06d14e [improvement](disk balancer) reduce disk balance sensitivity (#24637) 2023-09-24 22:02:53 +08:00
b9496b2a8f [feature](docker) regression test support run suite in docker (#24508) 2023-09-24 21:44:16 +08:00
fa0e0a606b [Fix](autoinc) Ensure that _fetch_autoinc_id_executor is destructed after the destructions of AutoIncIDBuffers (#24832) 2023-09-24 21:44:02 +08:00
27eed937b3 [pipelineX](es scan) Support ES scan operator (#24824)
Support ES scan operator
2023-09-24 00:32:38 +08:00
ece2e3cd70 [fix](nereids) support cte rf pushdown for exttable (#24806)
Currently, cte inside rf pushdown doesn't support external table, this pr open this restriction.
And since rf for schema scan, for example tables under information_schema, currently isn't supported by be, this pr also check and prevent to generate rf on them.
2023-09-23 23:00:05 +08:00
9cd9e195d8 [test](load) add some s3 load regression test (#24399) 2023-09-23 22:40:45 +08:00
5a4d51716c [fix](pipelineX) fix null ptr when unionoperator only have constexpr #24822 2023-09-23 20:28:38 +08:00
11b6fb9d10 [PipelineX](feature) Support data gen operator (#24823) 2023-09-23 19:28:47 +08:00
a0de08255d [pipelineX](profile) Add necessary metrics (#24820) 2023-09-23 19:27:45 +08:00
329c22da00 [pipelineX](feature) Support table function operator (#24818) 2023-09-23 19:26:53 +08:00
bacc310502 [Docs](StartUp)Add StartUp methods docs and metadata recovery docs (#24816) 2023-09-23 18:45:57 +08:00
ce8dfd3561 [Chore](dependency)grpc library dependencies are unified (#24794) 2023-09-23 14:29:34 +08:00
bf07415ff0 [fix](es catalog) remove _default_ field when parsing mapping. (#24781) 2023-09-23 10:58:55 +08:00
ce79711b0d [FIX](serde) fix map/array deserialize string with quote pair (#24808) 2023-09-23 01:12:20 +08:00
3d786c58de [pipelineX](sink) Support async writer (#24793) 2023-09-22 23:04:23 +08:00
8ca300f70b [Opt](pipeline) disable shared scan in key point search (#24797) 2023-09-22 22:46:11 +08:00
923402df71 [test](fix) fix case bug for lateral_view.groovy (#24779) 2023-09-22 21:21:34 +08:00
f3062e3d74 [fix](insert) Make insert group commit regression stable (#24584) 2023-09-22 20:18:14 +08:00
b86f09418f [chore](build) Fix the FE build on CentOS 6 (#24798)
Using grpc-java whose version is newer than 1.34.0 will break the build on CentOS 6 due to the obsolete GLIBC.
2023-09-22 19:58:12 +08:00
3bf95b2cfe [fix](merge-on-write) fix duplicate key in schema change (#24782) 2023-09-22 19:50:31 +08:00
f4b1e2b343 [Fix](core) Fix segment cache core when output rowset is nullptr (#24778) 2023-09-22 19:48:42 +08:00