Commit Graph

17338 Commits

Author SHA1 Message Date
9541fb2602 [chore](ci) remove required of pipelinex (#31791) 2024-03-06 13:07:49 +08:00
9d2e5f1c00 [feature](doris compose) doris compose use jdk 17 image (#31775) 2024-03-06 13:07:49 +08:00
11903d29a1 [fix](jdbc catalog) fix close abort in sqlserver (#31718) 2024-03-06 13:07:49 +08:00
ca59579bf6 fix](Nereids): support max_value in range partition (#31721) 2024-03-06 13:07:08 +08:00
7998da4691 [fix](cast) wrong result while cast const to double then to string (#31657)
Issue Number: close #31514
2024-03-06 13:06:27 +08:00
5ed3c7eeef [opt](doc) update release verify (#31773) 2024-03-06 13:06:27 +08:00
2c26a308d1 [fix](broker-load) fix broker load statement type conversion failure (#31746)
Co-authored-by: Luwei <814383175@qq.com>
2024-03-06 13:06:27 +08:00
7c30cb20fd [Fix](partial update) Fix partial update load false when schema includes auto increment column (#31725)
Problem:
When partially updating columns without specifying the auto-increment column, and the imported data contains new keys, an error stating the auto-increment column could not be found occurs.

Reason:
The logic for partial column updates does not account for new keys in auto-increment columns. Since auto-increment columns can be generated by the system, it's possible to omit this column data during import. However, partial column updates treat this as a regular column, expecting it to be nullable or have a default value for automatic filling, overlooking the fact that auto-increment columns can also be auto-filled. This oversight leads to the error.

Solution:
Incorporate a check for auto-increment columns into the partial column update logic, and include the logic for generating auto-increment column values in the process of completing partial updates.
2024-03-06 13:06:27 +08:00
2a1c00f180 [docs](kafka-connector) Add doris-kafka-connector usage documentation (#31729) 2024-03-06 13:06:26 +08:00
cca0773261 [feature](function) round function defaults to rounding normally 2024-03-06 13:06:26 +08:00
231768db0d [Performance](exec) Support runtime filter in <=> join (#31754) 2024-03-06 13:06:26 +08:00
31a03e7183 [fix](cloud) Fix regression case test_nereids_row_policy run in cloud mode (#31726) 2024-03-06 13:06:06 +08:00
fa499cc200 [Enhencement](env) Checking Master branch must use JDK17 (#31587)
Add to check the JDK version in `env.sh`,  and force master to use java 17 version
2024-03-06 13:05:58 +08:00
294cb1729d [fix](feut) fix TabletRepairAndBalanceTest (#31653) 2024-03-06 13:05:31 +08:00
d7d8b4ee4a [fix](fe) Fix NPE in FrontendServiceImpl.loadTxnCommit if table is dropped (#31715) 2024-03-06 13:05:31 +08:00
a26b1eeee7 [fix](connections) fix connection hang after too many connections (#31594)
Issue Number: close #31569

Fix fe connection hang after too high qps

After fix, the third SQL will return error instead of hang:
ERROR 1203 (HY000): #42000Too many connections
2024-03-06 13:05:22 +08:00
Pxl
0c71b666d7 [Bug](resource) fix npe on Resource read from json (#31723)
fix npe on Resource read from json
2024-03-06 13:05:22 +08:00
Pxl
25d1934289 [Feature](topn) support multiple topn filter on backend (#31665)
support multiple topn filter on backend
2024-03-06 13:05:22 +08:00
3777ffb43f [enhancement](nereids)support null partition for list partition (#31613) 2024-03-06 13:05:22 +08:00
33c356e6d8 fix in stats estimation (#31684)
the valid in option should

! (op.min > expr.max or op.max < expr.min) 
=============> 
op.min <= expr.max and op.max >= expr.min
2024-03-06 13:04:54 +08:00
e2ebf9d566 [feature](Nereids) parallel output file (#31623)
legacy planner impl PR: #6539
2024-03-06 13:04:30 +08:00
a5b9127656 [refactor](jdbc catalog) split sqlserver jdbc executor (#31679) 2024-03-06 13:04:29 +08:00
8198a31563 [fix](testcases) make all auto partition P2 cases nonConcurrent (#31708) (#31821)
make all auto partition P2 cases nonConcurrent
2024-03-06 09:12:02 +08:00
91efb6a43d Revert "[fix](meta-tool) Fix compile meta tool (#31457)"
This reverts commit 60de835d48536977e25c1841f4eed6abb0f2a311.
2024-03-04 21:49:07 +08:00
792907ff89 doris-2.1.0-rc11 2024-03-04 18:15:17 +08:00
8ef3b634cc 2.1.0 release 2024-03-04 18:04:43 +08:00
65d45daf8a [Bug](coredump) fix regresstion test coredump in multi thread access map (#31664) 2024-03-03 19:30:55 +08:00
bc898e3cdc [pipelineX](bug) Fix incorrect join operator judgement (#31690)
* [pipelineX](bug) Fix incorrect join operator judgement

* update
2024-03-03 19:22:41 +08:00
344e80fbbc [fix](jdbc catalog) Change Druid Pool dependency to version 1.2.11 2024-03-03 17:58:54 +08:00
4386a71709 [bugfix](wgcore) map at only get reference and it will core in multithread
f
2024-03-03 15:54:26 +08:00
47d330c74d [enhancement](Nereids) New optimizer support check column privileges (#31700)
* [enhancement](Nereids) New optimizer support check column privileges (#31494)

(cherry picked from commit accfcfcae5a3343a9e2b7241453e56738255de1b)

* column privilege

* column privilege
2024-03-03 13:48:31 +08:00
de9b5f7b69 [improvement](statistics)Log one bdbje record for one load transaction. #31619 (#31697) 2024-03-02 23:04:26 +08:00
c1dcce42d4 [Chore](dependency)Upgrade some dependencies of FE (#31667)
- upgrade aws-java-sdk to 1.12.669
-binding netty component version
- exclude ranger's storage plugins(es and solr)
2024-03-02 17:12:49 +08:00
cacbd048ec [fix](arrow-flight)Fix the prompt that be arrow_flight_sql_port is not set (#31668) 2024-03-02 17:12:49 +08:00
b248d3a27e [Refactor](rf) Refactor the rf code interface to remove update filter v1 (#31643) 2024-03-02 17:12:49 +08:00
0794fe3e21 [Bug](regression) fix bug of null in topn opt (#31669) 2024-03-02 17:12:34 +08:00
5e684c23ba [regression test]Test the unique model by modify a key type from BOOLEAN to other type (#31540)
* Test the unique model by modify a value type from BOOLEAN to other type

* Test the unique model by modify a key type from BOOLEAN to other type

* Test the unique model by modify a key type from BOOLEAN to other type
2024-03-02 17:12:34 +08:00
ff5e9341bf [fix](pipelineX)error output_block settings result in excessive memory usage. #31680 2024-03-02 01:09:10 +08:00
8a44c180bf [opt](scan) read scan ranges in the order of partitions (#31630) 2024-03-02 01:09:10 +08:00
daa171ee3a [Update](cloud) add inverted index tmp dir support (#31484) 2024-03-02 01:08:51 +08:00
794d9405de [ci](jdk17) adjust fe.conf (#31683) 2024-03-02 01:08:51 +08:00
52025bfccd move 3 cases to p2, reducing regression pipeline runtime (#31663) 2024-03-02 01:08:51 +08:00
4654ec7226 [fix](profile)Fix load profile print by default (#31677)
only enable_profile is true, print profile.
2024-03-02 01:08:51 +08:00
874f4c693b [feat](nereids) support nullSafeEqual estimation (#31616) 2024-03-01 19:07:00 +08:00
38cb17567a [opt](plsql) Fix plsql exception and doris exception compatibility (#31647) 2024-03-01 19:07:00 +08:00
248ea20901 Revert "[test](regression) add regression test for schange change of complex …" (#31660)
This reverts commit dcd2afdb4e857791fed66a46f28ab3adc25494e1.
Reverts #31207
2024-03-01 19:06:59 +08:00
b26dcf2677 [opt](nereids) Composite predicate supports range predicate when rewritting by materialzied view (#31538)
It supports predicate composite as following:
materialized view define
>        select l_shipdate, o_orderdate, l_partkey, l_suppkey
>        from lineitem_1
>        left join orders_1
>        on lineitem_1.l_orderkey = orders_1.o_orderkey
>        where l_shipdate > '2023-10-19'


the query as following can be rewritten by the materialized view above
>        select l_shipdate, o_orderdate, l_partkey, l_suppkey
>        from lineitem_1
>        left join orders_1
>        on lineitem_1.l_orderkey = orders_1.o_orderkey
>        where l_shipdate > '2023-10-25'
2024-03-01 19:06:59 +08:00
493c9d49ea [fix](Nereids) check slot from children may produce wrong format err (#31638) 2024-03-01 17:00:13 +08:00
535e3b23ea [Fix](nereids) fix leading with left join without leftside condition (#31387)
When left join with no edge in outer side, we should add outer side to minimal require of left tables


Co-authored-by: libinfeng <libinfeng@selectdb.com>
2024-03-01 16:59:53 +08:00
4888b4405b [Chore](Docs)Update release guide (#31654) 2024-03-01 16:59:43 +08:00