Commit Graph

13759 Commits

Author SHA1 Message Date
a689a2fbb1 [pipelineX](fix) Fix projection expression (#24923) 2023-09-26 21:48:28 +08:00
90c5461ad2 [fix](Nereids) let dml work well (#24748)
Co-authored-by: sohardforaname <organic_chemistry@foxmail.com>

TODO:
1. support agg_state type
2. support implicit cast literal exception
3. use nereids execute dml for these regression cases:

- test_agg_state_nereids (for TODO 1)
- test_array_insert_overflow (for TODO 2)
- nereids_p0/json_p0/test_json_load_and_function (for TODO 2)
- nereids_p0/json_p0/test_json_unique_load_and_function (for TODO 2)
- nereids_p0/jsonb_p0/test_jsonb_load_and_function (for TODO 2)
- nereids_p0/jsonb_p0/test_jsonb_unique_load_and_function (for TODO 2)
- json_p0/test_json_load_and_function (for TODO 2)
- json_p0/test_json_unique_load_and_function (for TODO 2)
- jsonb_p0/test_jsonb_load_and_function (for TODO 2)
- jsonb_p0/test_jsonb_unique_load_and_function (for TODO 2)
- test_multi_partition_key (for TODO 2)
2023-09-26 21:08:24 +08:00
a6a0e78f32 [Enhancement](streamload) stream tvf support compress (#24303) 2023-09-26 20:58:20 +08:00
55d1090137 [feature](insert) Support group commit stream load (#24304) 2023-09-26 20:57:02 +08:00
fe2879d8fe [fix](merge-on-write) MergeIndexDeleteBitmapCalculator stack overflow (#24913) 2023-09-26 20:32:23 +08:00
e9eaf49db5 [feature](alter colocate group) Support alter colocate group replica allocation (#23320) 2023-09-26 19:55:25 +08:00
77e864df12 [enhancement](delete) use column id in delete push task instead of column name (#24549) 2023-09-26 19:54:55 +08:00
ded8ba108f [test](be-ut) skip some be ut case (#24917)
skip be ut "VTimestampFunctionsTest.convert_tz_test"
2023-09-26 19:51:15 +08:00
c9cf9499b6 [impro](regression test) Add case for time cast #24895 2023-09-26 19:47:38 +08:00
28869b0f82 [fix](Outfile) Use data_type_serde to export data to orc file format (#24812) 2023-09-26 19:46:42 +08:00
6cef918a71 [docs](doc)Add FAQ for "trustAnchors parameter must be non-empty" (#24848) 2023-09-26 19:23:23 +08:00
04bf9bce54 [fix](planner)update explode slot's nullable info in analyze phase (#24879) 2023-09-26 18:14:04 +08:00
94082ae59c [Fix](inverted index) fix tokenize function coredump (#24896) 2023-09-26 17:31:10 +08:00
156b7b80a4 [pipelineX](bug) Fix scan operator if aggregation type is COUNT_ON_INDEX (#24909) 2023-09-26 16:42:29 +08:00
1abda1c446 [Fix](merge-on-write) Correct the alignment process when the existing rows with same key has marked delete sign (#24877) 2023-09-26 16:09:20 +08:00
bc747be511 [Improvement](regression-test) add stream load case (#24396) 2023-09-26 15:35:19 +08:00
082bcd820b [feature](insert) Support wal for group commit insert (#23053) 2023-09-26 14:46:24 +08:00
422170ccb1 [Bugfix](tablet) change WriteCooldownMetaExecutors's thread pool type to prevent singleton's dtor order (#23834) 2023-09-26 14:29:35 +08:00
983f948ec4 [fix](Nereids): fix SimplifyComparisonPredicate (#24899)
#16061 exist BUG, it causes wrong cast
2023-09-26 14:28:03 +08:00
43433c3fab [improvement](processlist) Add more information for show processlist (#24000) 2023-09-26 14:25:42 +08:00
a3427cb822 [pipelineX](fix) Fix nested loop join operator (#24885) 2023-09-26 13:27:34 +08:00
733b71828c [fix](pipelineX) fix do not set per_fragment_instance_idx (#24890) 2023-09-26 13:10:30 +08:00
6890e5bf0f [test](Nereids): add test for SimplifyComparisonPredicate (#24865) 2023-09-26 12:50:31 +08:00
dae0dc1652 [test](load) add some S3 TVF load regression tests (#24719) 2023-09-26 12:21:42 +08:00
eb9d68a640 [opt](Nereids) add json literal for constant folding (#24878) 2023-09-26 11:37:53 +08:00
1f8e0b48bc [fix](S3)delete main function because hardcoded ip is not safe (#24872) 2023-09-26 10:49:16 +08:00
33630e1c4d [fix](multi-catalog) SecureRandom is used to replace Random in FederationBackendPolicy to enhance security (#24860) 2023-09-26 10:44:22 +08:00
e887653dde [fix](auth) Remove printing passwords in the log (#24866) 2023-09-26 10:17:44 +08:00
e4c0c98efa [fix](Nereids): round microsecond when specify scale of microsecond (#24854) 2023-09-26 10:11:53 +08:00
513e37bdbf [pipelineX](node)support jdbc scan operator (#24851) 2023-09-26 10:02:51 +08:00
b9472bf5d3 [fix](LOG)change printStackTracker to LOG (#24884) 2023-09-26 08:28:53 +08:00
4c9ffd210d [typo][doc]modify incorrect argument type. (#24095) 2023-09-26 00:25:39 +08:00
60ce1ed8a3 [improvement](tablet clone) fix balanced new replica will be removed when load txn continuously and none-stop (#24845) 2023-09-25 22:51:08 +08:00
8ee2e40812 [enhancement](zone_map_index) use direct_copy_may_cut instead of direct_copy(#24880) 2023-09-25 22:32:18 +08:00
8191cd1dad [Bug](ScanNode) Fix potential incorrect query result caused by concurrent NewOlapScanNode initialization and Compaction (#24638)
* Optimize fetch delete predicates

* Fix incorrect query result when compaction eliminate delete predicates between `NewOlapScanNode::_init_scanners` and `NewOlapScanner::init`

* Fix be ut
2023-09-25 22:24:35 +08:00
8d4fd76a16 [Feature](StreamLoad2PC) Support commit and abort streamload2PC by label (#24613) 2023-09-25 22:21:27 +08:00
158570787a [fix](multi-catalog)The external catalog does not have verification parameters, causing an error to be reported when creating the catalog. (#24393) 2023-09-25 21:35:52 +08:00
12bee54cf7 [fix](Nereids) function implict cast for json is not work well (#24852)
for sql like:

SELECT JSONB_EXTRACT('{"k1":"v31","k2":300}','$.k1');

the result should be

+------------------------------------------------+
| jsonb_extract('{"k1":"v31","k2":300}', '$.k1') |
+------------------------------------------------+
| "v31"                                          |
+------------------------------------------------+

but curent result is

+------------------------------------------------+
| jsonb_extract('{"k1":"v31","k2":300}', '$.k1') |
+------------------------------------------------+
| <null>                                         |
+------------------------------------------------+
2023-09-25 21:10:04 +08:00
b38b8b4494 [pipelineX](fix) Fix BE crash caused by join and constant expr (#24862) 2023-09-25 21:01:09 +08:00
6502da8917 [bugfix](restore) add partition id into convert_rowset_ids() (#24834) 2023-09-25 20:07:24 +08:00
9dff620471 [feature](binlog) add truncate table binlog (#24868)
Signed-off-by: Jack Drogon <jack.xsuperman@gmail.com>
2023-09-25 19:53:42 +08:00
59c494eb27 [fix](Docs) Modify documents about SELECT INTO OUTFILE and EXPORT (#24641) 2023-09-25 19:51:15 +08:00
3e686f4306 [feature](javaudf)support no input java udf (#24457)
* support no input java udf

* add license
2023-09-25 18:56:44 +08:00
8679095e5c [feature](debug) support debug point used in debug code (#24502) 2023-09-25 17:56:12 +08:00
90791f0b19 [fix](nereids)fix bug of exists subquery with limit clause (#24630)
create table t1(c1 int, c2 int);
create table t2(c1 int, c2 int);
insert into t1 values (1,1);
insert into t2 values (1,1);

select * from t1 where exists (select * from t2 where t1.c1 = t2.c1 limit 0);

the result should be empty set.
2023-09-25 17:15:08 +08:00
60af62b41e [enhancement](Nereids) remove deriveStats jobs for some groupExpression (#24835)
Don't call DeriveStatJob for follow group expressions:

- the group expression that is generated by the joinCommute rule
- the group expression that is generated by the implementation rule without creating a new group
2023-09-25 17:14:16 +08:00
3b4d8b4ac8 [pipelineX](feature) Support schema scan operator (#24850) 2023-09-25 14:42:25 +08:00
9412775686 remove useless variable in scanctx (#24849)
remove useless variable in scanctx
2023-09-25 14:36:18 +08:00
xfz
1b95ce1d93 [feature](json-function) add json_insert, json_replace, json_set functions (#24384)
[feature](json-function) add three json funcitons
2023-09-25 12:52:29 +08:00
82b393314c [enhancement](Nereids) check unimplemented func in nereids (#24766) 2023-09-25 12:45:11 +08:00