database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
13,780 Commits 1 Branch 0 Tags
a6d1da0db90db76eaadab1dacaa8df23151cd416
Commit Graph

13780 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
ZhenchaoXu
a6d1da0db9 [typo](doc)modify error link description in fe-config-template (#24676) 2023-09-27 02:51:47 -05:00
Gabriel
aa4dbbedc7 [pipelineX](bug) Fix dead lock in exchange sink operator (#24947) 2023-09-27 15:40:25 +08:00
Xinyi Zou
87a30dc41d [feature-wip](arrow-flight)(step3) Support authentication and user session (#24772) 2023-09-27 14:53:58 +08:00
Ashin Gau
26818de9c8 [feature](jni) support complex types in jni framework (#24810) 
Support complex types in jni framework, and successfully run end-to-end on hudi.
### How to Use
Other scanners only need to implement three interfaces in `ColumnValue`:
```
// Get array elements and append into values
void unpackArray(List<ColumnValue> values);

// Get map key array&value array, and append into keys&values
void unpackMap(List<ColumnValue> keys, List<ColumnValue> values);

// Get the struct fields specified by `structFieldIndex`, and append into values
void unpackStruct(List<Integer> structFieldIndex, List<ColumnValue> values);
```
Developers can take `HudiColumnValue` as an example.
 2023-09-27 14:47:41 +08:00
xzj7019
a1ab8f96a1 [fix](nereids) mark two phase partition topn global to notice be passthrough logic (#24886) 
mark partition topn phase to notice be to handle passthrough logic well, this pr is fe part code.
be side logic: the the phase equals to PTopNPhase.TWO_PAHSE_GLOBAL, it should skip the bypass logic and do the second phase ptopn operation anyway.
 2023-09-27 14:08:59 +08:00
Gabriel
1b0e3246ea [pipelineX](fix) Fix exception reporting and Nereids plan (#24936) 2023-09-27 13:15:40 +08:00
zhangstar333
c04e5bac39 [bug](pipelineX) fix java-udaf failed with open pipelineX (#24939) 2023-09-27 13:14:10 +08:00
zzzzzzzs
452318a9fc [Enhancement](streamload) stream tvf support user specified label (#24219) 
stream tvf support user specified label
example:

curl -v --location-trusted -u root: -H "sql: insert into test.t1 WITH LABEL label1 select c1,c2 from http_stream(\"format\" = \"CSV\", \"column_separator\" = \",\")" -T example.csv http://127.0.0.1:8030/api/_http_stream
return:

{
    "TxnId": 2064,
    "Label": "label1",
    "Comment": "",
    "TwoPhaseCommit": "false",
    "Status": "Success",
    "Message": "OK",
    "NumberTotalRows": 2,
    "NumberLoadedRows": 2,
    "NumberFilteredRows": 0,
    "NumberUnselectedRows": 0,
    "LoadBytes": 27,
    "LoadTimeMs": 152,
    "BeginTxnTimeMs": 0,
    "StreamLoadPutTimeMs": 83,
    "ReadDataTimeMs": 92,
    "WriteDataTimeMs": 41,
    "CommitAndPublishTimeMs": 24
}
 2023-09-27 12:09:35 +08:00
Pxl
18b5f70a7c [Bug](materialized-view) enable rewrite on select materialized index with aggregate mode (#24691) 
enable rewrite on select materialized index with aggregate mode
 2023-09-27 11:30:36 +08:00
caoliang-web
6b64b7fec7 [typo](doc)Add flink to read the doris table and use doris.filter.query to configure the display (#24736) 2023-09-27 11:22:58 +08:00
minghong
a8f312794e [feature](nereids)support stats estimation for is-null predicate (#24764) 
1. condition order: filter/hashCondition/otherCondition,
2. update regression out
3. remove tpch_sf500 shape case(covered by tpch sf1000)
4. implement is-null stats estimation
5. update ssb shape
 2023-09-27 10:04:35 +08:00
starocean999
b9928a017b [fix](fe)add variant type in decimalv3's compatibilityMatrix table (#24749) 2023-09-27 10:03:13 +08:00
starocean999
0dd57b1982 [feature](nereids)support subquey in join condition (#24598) 2023-09-27 10:02:56 +08:00
zzzzzzzs
6d27a016b9 [Improvement](regression-test) add http_stream case (#24930) 2023-09-27 09:55:52 +08:00
zzzzzzzs
2e8f9a6429 [improvement](streamload) QeProcessorImpl#registerQuery should be removed (#24836) 2023-09-27 09:48:27 +08:00
DongLiang-0
f7f359d36c [fix](analysis)fix use regex determine whether time part exists may cause backtracking (#24882) 2023-09-27 09:26:42 +08:00
HappenLee
24ee3607e1 [Bug](pipeline) nullprt may be close the sink if init failed (#24926) 2023-09-27 09:11:06 +08:00
Jack Drogon
f59e69b852 [feature](autobucekt) Add support autobucket min buckets config Add support autobucket (#24920) 
Signed-off-by: Jack Drogon <jack.xsuperman@gmail.com>
 2023-09-27 08:13:53 +08:00
Guangdong Liu
504ab2d726 [fix](es-catalog) If the returned data is incorrect, it will be directly unified as the index was not found (#24831) 2023-09-26 22:59:38 +08:00
jakevin
841e6188bf [fix](Nereids): fix roundFloor (#24901) 
"roundFloor()" does not consider the issue of carry.
 2023-09-26 22:37:42 +08:00
Mryange
9a78681d6f [fix](pipelineX) remove cases with conflicting table names (#24922) 2023-09-26 22:24:48 +08:00
Gabriel
a689a2fbb1 [pipelineX](fix) Fix projection expression (#24923) 2023-09-26 21:48:28 +08:00
morrySnow
90c5461ad2 [fix](Nereids) let dml work well (#24748) 
Co-authored-by: sohardforaname <organic_chemistry@foxmail.com>

TODO:
1. support agg_state type
2. support implicit cast literal exception
3. use nereids execute dml for these regression cases:

- test_agg_state_nereids (for TODO 1)
- test_array_insert_overflow (for TODO 2)
- nereids_p0/json_p0/test_json_load_and_function (for TODO 2)
- nereids_p0/json_p0/test_json_unique_load_and_function (for TODO 2)
- nereids_p0/jsonb_p0/test_jsonb_load_and_function (for TODO 2)
- nereids_p0/jsonb_p0/test_jsonb_unique_load_and_function (for TODO 2)
- json_p0/test_json_load_and_function (for TODO 2)
- json_p0/test_json_unique_load_and_function (for TODO 2)
- jsonb_p0/test_jsonb_load_and_function (for TODO 2)
- jsonb_p0/test_jsonb_unique_load_and_function (for TODO 2)
- test_multi_partition_key (for TODO 2)
 2023-09-26 21:08:24 +08:00
zzzzzzzs
a6a0e78f32 [Enhancement](streamload) stream tvf support compress (#24303) 2023-09-26 20:58:20 +08:00
meiyi
55d1090137 [feature](insert) Support group commit stream load (#24304) 2023-09-26 20:57:02 +08:00
zhannngchen
fe2879d8fe [fix](merge-on-write) MergeIndexDeleteBitmapCalculator stack overflow (#24913) 2023-09-26 20:32:23 +08:00
yujun
e9eaf49db5 [feature](alter colocate group) Support alter colocate group replica allocation (#23320) 2023-09-26 19:55:25 +08:00
Siyang Tang
77e864df12 [enhancement](delete) use column id in delete push task instead of column name (#24549) 2023-09-26 19:54:55 +08:00
zclllyybb
ded8ba108f [test](be-ut) skip some be ut case (#24917) 
skip be ut "VTimestampFunctionsTest.convert_tz_test"
 2023-09-26 19:51:15 +08:00
zhiqqqq
c9cf9499b6 [impro](regression test) Add case for time cast #24895 2023-09-26 19:47:38 +08:00
Tiewei Fang
28869b0f82 [fix](Outfile) Use data_type_serde to export data to orc file format (#24812) 2023-09-26 19:46:42 +08:00
alan_rodriguez
6cef918a71 [docs](doc)Add FAQ for "trustAnchors parameter must be non-empty" (#24848) 2023-09-26 19:23:23 +08:00
starocean999
04bf9bce54 [fix](planner)update explode slot's nullable info in analyze phase (#24879) 2023-09-26 18:14:04 +08:00
airborne12
94082ae59c [Fix](inverted index) fix tokenize function coredump (#24896) 2023-09-26 17:31:10 +08:00
Gabriel
156b7b80a4 [pipelineX](bug) Fix scan operator if aggregation type is COUNT_ON_INDEX (#24909) 2023-09-26 16:42:29 +08:00
bobhan1
1abda1c446 [Fix](merge-on-write) Correct the alignment process when the existing rows with same key has marked delete sign (#24877) 2023-09-26 16:09:20 +08:00
HHoflittlefish777
bc747be511 [Improvement](regression-test) add stream load case (#24396) 2023-09-26 15:35:19 +08:00
huanghaibin
082bcd820b [feature](insert) Support wal for group commit insert (#23053) 2023-09-26 14:46:24 +08:00
AlexYue
422170ccb1 [Bugfix](tablet) change WriteCooldownMetaExecutors's thread pool type to prevent singleton's dtor order (#23834) 2023-09-26 14:29:35 +08:00
jakevin
983f948ec4 [fix](Nereids): fix SimplifyComparisonPredicate (#24899) 
#16061 exist BUG, it causes wrong cast
 2023-09-26 14:28:03 +08:00
yagagagaga
43433c3fab [improvement](processlist) Add more information for show processlist (#24000) 2023-09-26 14:25:42 +08:00
Gabriel
a3427cb822 [pipelineX](fix) Fix nested loop join operator (#24885) 2023-09-26 13:27:34 +08:00
Mryange
733b71828c [fix](pipelineX) fix do not set per_fragment_instance_idx (#24890) 2023-09-26 13:10:30 +08:00
jakevin
6890e5bf0f [test](Nereids): add test for SimplifyComparisonPredicate (#24865) 2023-09-26 12:50:31 +08:00
Siyang Tang
dae0dc1652 [test](load) add some S3 TVF load regression tests (#24719) 2023-09-26 12:21:42 +08:00
morrySnow
eb9d68a640 [opt](Nereids) add json literal for constant folding (#24878) 2023-09-26 11:37:53 +08:00
lsy3993
1f8e0b48bc [fix](S3)delete main function because hardcoded ip is not safe (#24872) 2023-09-26 10:49:16 +08:00
zy-kkk
33630e1c4d [fix](multi-catalog) SecureRandom is used to replace Random in FederationBackendPolicy to enhance security (#24860) 2023-09-26 10:44:22 +08:00
zy-kkk
e887653dde [fix](auth) Remove printing passwords in the log (#24866) 2023-09-26 10:17:44 +08:00
jakevin
e4c0c98efa [fix](Nereids): round microsecond when specify scale of microsecond (#24854) 2023-09-26 10:11:53 +08:00