Commit Graph

3465 Commits

Author SHA1 Message Date
ec068049c7 branch-2.1: [fix](meta-cache) fix refreshOnlyCatalogCache when use_meta_cache = false #44363 (#44461)
Cherry-picked from #44363

Co-authored-by: Socrates <suyiteng@selectdb.com>
2024-11-22 22:41:10 +08:00
702abbff0f [Opt](orc)Optimize the merge io when orc reader read multiple tiny stripes. (#42004) (#44239)
bp #42004

Co-authored-by: kaka11chen <kaka11.chen@gmail.com>
2024-11-22 11:01:41 +08:00
75f8323f45 [opt](regression-test) move some cases to p2 to accelerate the testing speed of p0 (#37590) (#44389)
pick #37590

move some cases to p2 to accelerate the testing speed of p0
2024-11-21 23:07:57 +08:00
4ae4833bdc [test](routine load) add routine load doc case (#43230) (#44382)
pick #43230

Add routine load doc case.
2024-11-21 23:06:14 +08:00
fbf573f8c8 [fix](hive)fix hive catalog miss partition that have special characters. #42906 (#44152)
cherry pick from #42906

---------

Co-authored-by: daidai <2017501503@qq.com>
2024-11-21 14:11:22 +08:00
c9801f7a38 branch-2.1: [Bug](function) fix cut_ipv6 function error about modify the input column data #43921 (#44180)
Cherry-picked from #43921

Co-authored-by: zhangstar333 <zhangsida@selectdb.com>
2024-11-19 17:27:29 +08:00
83b74827aa branch-2.1: [fix](iceberg)Fix count(*) error with dangling delete problem #44039 (#44101)
Cherry-picked from #44039

Co-authored-by: wuwenchi <wuwenchi@selectdb.com>
2024-11-19 17:19:25 +08:00
161d76328d branch-2.1: [fix](iceberg)Delete the data files when deleting the table #43441 (#44138)
Cherry-picked from #43441

Co-authored-by: wuwenchi <wuwenchi@selectdb.com>
2024-11-18 18:00:13 +08:00
1d21b6ea47 [test](doc) add test case for error data handling doc #43468 (#44132)
cherry pick from #43468
2024-11-18 14:06:12 +08:00
8fcce4f591 [improvement](nereids) support extract from disjunction in join on condition (#38479) (#43670)
cherry-pick #38479 to branch-2.1
2024-11-16 17:15:39 +08:00
b120e895f1 branch-2.1: [fix](test) fix mysql jdbc catalog test out #43867 (#43916)
Cherry-picked from #43867

Co-authored-by: zy-kkk <zhongyongkang@selectdb.com>
2024-11-16 16:29:58 +08:00
10009dc062 [fix](variant) fix index in variant (#43375) (#43971)
Problem Summary:

1. Fixing error checks,
`InvertedIndexColumnWriter::check_support_inverted_index`, It is not
appropriate to determine support for other indexes by checking the
inverted index.
2. Fix `TableSchema::update_index()`

pick from master #43375
2024-11-16 16:29:00 +08:00
42b190cfad branch-2.1: [fix](dynamic partition) data lost with very small dynamic_partition.start #43898 (#44033)
Cherry-picked from #43898

Co-authored-by: camby <cambyzhu@tencent.com>
2024-11-16 16:21:34 +08:00
d1cc68a26a branch-2.1: [Fix](auto-increment) Fix duplicate auto-increment column value problem #43774 (#43984)
Cherry-picked from #43774

Co-authored-by: bobhan1 <baohan@selectdb.com>
2024-11-16 16:17:24 +08:00
91dcc0e194 branch-2.1: [fix](mtmv) Fix generate hyper graph wrongly when has filter which can not push down #43539 (#43946)
Cherry-picked from #43539

Co-authored-by: seawinde <wusi@selectdb.com>
2024-11-16 16:08:36 +08:00
edd9015de3 [branch-2.1](function) fix error result in auto partition name (#41130) (#43977)
pick https://github.com/apache/doris/pull/41130
https://github.com/apache/doris/pull/41372

---------

Co-authored-by: zhaochangle <zhaochangle@selectdb.com>
2024-11-15 19:11:42 +08:00
1101fbaf04 [fix](column_complex) wrong type of Field returned by ColumnComplex (#43515) (#43860) 2024-11-13 19:07:00 +08:00
40d755a971 [Feat](nereids) add max/min filter push down rewrite rule (#39252) (#43671)
cherry-pick #39252 to branch-2.1
2024-11-13 11:55:39 +08:00
2e64491ee3 [branch-2.1](insert-overwrite) Support create partition for auto partition table when insert overwrite (#38628) (#42644)
pick https://github.com/apache/doris/pull/38628
2024-11-13 11:16:00 +08:00
3d667e95d2 [branch-2.1](function) support array_split and array_reverse_split functions (#35619) (#43761)
pick https://github.com/apache/doris/pull/35619
2024-11-12 21:27:55 +08:00
a1ff02288f branch-2.1: [fix](hive) support query hive view created by spark (#43553)
Cherry-picked from #43530

Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com>
Co-authored-by: morningman <yunyou@selectdb.com>
2024-11-11 23:28:53 +08:00
182f37f837 [fix](planner) NullLiteral should always having a correct Type and set to be analyzed (#43371) 2024-11-10 10:10:40 +08:00
f6ddd818cd [tests](inverted index)Add and improve add/drop index cases (#36811) (#43463)
bp #36811
2024-11-08 09:38:54 +08:00
7de7541ec6 branch-2.1: [fix](ES Catalog)Only like on keyword can be applied to wildcard query (#43400)
Cherry-picked from #41176

Co-authored-by: qiye <jianliang5669@gmail.com>
2024-11-07 22:43:42 +08:00
12bb38eab3 [fix](build index)Fix build index failed on renamed column (#42882)(#43246)(#43336) (#43266)
bp #42882 #43246 #43336
We pick these PRs together because they all fix one problem and if not
do so, the regression test won't be passed.

---------

Co-authored-by: Sun Chenyang <csun5285@gmail.com>
Co-authored-by: qidaye <luen@selectdb.com>
2024-11-07 21:32:02 +08:00
c3e6702d28 branch-2.1: [fix](array-funcs)fix array funcs which ret can be nullable (#43354)
Cherry-picked from #43243

Co-authored-by: amory <wangqiannan@selectdb.com>
2024-11-07 18:28:50 +08:00
876fae6f71 [fix](regression) test_primary_key_partial_update fail due to the U.S. change from DST to standard time (#43288) (#43300)
cherry-pick #43288
2024-11-06 14:10:29 +08:00
46afbfca01 branch-2.1: [fix](ip) fix datatype serde for ipv6 with rowstore (#43252)
Cherry-picked from #43065

Co-authored-by: amory <wangqiannan@selectdb.com>
2024-11-05 20:09:14 +08:00
09f2516c7c [fix](test) fix some test cases #43217 (#43216)
bp #43217
2024-11-04 22:15:30 +08:00
98d3db03b1 [fix](regression-test) fix test_hive_serde_prop #42886 (#43098)
cherry pick from #42886

Co-authored-by: Socrates <suxiaogang223@icloud.com>
2024-11-01 23:11:45 +08:00
c5374be1bc [cherry-pick](branch-2.1) Pick "[Feature](schema change) Support add column bitmap with default value bitmap_empty (#42331)" (#42702)
Pick #42331
2024-11-01 21:46:38 +08:00
355170a921 [cherry-pick](branch2.1) impl scalar functions trim_in、ltrim_in and rtrim_in (#42641)
pick https://github.com/apache/doris/pull/41681
2024-11-01 09:55:50 +08:00
e85e6c89ba [fix](auditlog) add missing audit log fields and duplicate audit log error #42262 (#43015)
bp #42262
2024-11-01 08:24:55 +08:00
c573351e4e [fix](tvf) fix FE cannot start when replay alter view from tvf (#42866)
bp: #40872
2024-10-31 14:15:48 +08:00
6c3d42e09a [cherry-pick](branch-21) cherry-pick pr about (#42488) (#42099) (#42055) (#42916)
## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
2024-10-31 14:14:19 +08:00
cc30a7e78e [fix](test) fix some unstable external p0 test cases (#42685) (#42943)
cherry-pick #42685

Co-authored-by: daidai <2017501503@qq.com>
2024-10-31 12:36:03 +08:00
cdd32d9582 [enhance](hive) support reading hive table with OpenCSVSerde #42257 (#42940)
cherry pick from #42257

Co-authored-by: Socrates <suxiaogang223@icloud.com>
2024-10-31 11:12:07 +08:00
0d008b5a43 [feat](nereids)disable join reorder if column stats is invalid #41790 (branch-2.1) (#42902)
## Proposed changes
pick #41790
Issue Number: close #xxx

<!--Describe your changes.-->
2024-10-30 23:47:03 +08:00
e43d255815 [fix](array) fix add_array_null_value for inverted index_builder (#42899)
## Proposed changes
Pick #42638 to doris branch 2.1
Issue Number: close #xxx

<!--Describe your changes.-->
2024-10-30 19:16:59 +08:00
2042726ceb [Fix](regression case) fix some unstable regression cases (#42601)
## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
2024-10-29 18:12:40 +08:00
0baca54200 [fix](Nereids) offset do more than once when have shuffle after limit (#42576) (#42577)
pick from master #42576

intro by #39316. it want to fix a problem intro by #36699. but forgot to
remove all wrong code in #36699.

after #39316, we should not set offset on exchange, when the exchange is
on the top of a limit with offset.
2024-10-28 19:48:13 +08:00
9eef393e2a [pick]support cgroup v2 (#42465)
## Proposed changes

pick #39991   #39374  #36663
2024-10-25 20:13:27 +08:00
4a62d9e44b Revert "[2.1][improvement](jdbc catalog) Add catalog property to enable jdbc connection pool" (#42481)
Reverts apache/doris#42255

We have found that after closing the connection pool, there will be
class loading problems and connection release problems for some data
sources. We will remove this function first and re-add it after solving
and testing it completely.
2024-10-25 19:37:36 +08:00
0700449e8b [fix](schema change) fix delete predicate incorrect comparisons result with empty strings during schema change (#41064) (#42427)
```
insert into t1 (k1,  k2,  v1) value(1, '', 2);
delete form t1 where k1 = 1 and k2 = '';
alter table modify column v1 string
select * from t1 //  expect 0 rows in return, but get 1 row.
```
2024-10-25 01:05:55 +08:00
cbdaaa62b2 [feature](function) hour/minute/second functions support time as an a… 41008 (#42232)
…rgument. (#41008)

## Proposed changes

```
mysql> select cast(4562632 as time),hour(cast(4562632 as time)), minute(cast(4562632 as time)),second(cast(4562632 as time));
+-----------------------+-----------------------------+-------------------------------+-------------------------------+
| cast(4562632 as TIME) | hour(cast(4562632 as TIME)) | minute(cast(4562632 as TIME)) | second(cast(4562632 as TIME)) |
+-----------------------+-----------------------------+-------------------------------+-------------------------------+
| 456:26:32             |                         456 |                            26 |                            32 |
+-----------------------+-----------------------------+-------------------------------+-------------------------------+
```

<!--Describe your changes.-->

---------

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->

Co-authored-by: Dongyang Li <hello_stephen@qq.com>
2024-10-24 11:09:36 +08:00
a3510d3b73 [cherry-pick](branch-21)fix the exchange not skip offset rows (#42190) (#42330)
cherry-pick from master (#42190)
2024-10-24 11:08:17 +08:00
73fc5c734e [fix](mtmv)fix in the scenario of recreating a table, the materialize… (#42339)
…d view may assume that the data has not changed (#41762)

pick: https://github.com/apache/doris/pull/41762
2024-10-24 11:07:29 +08:00
64d0c55e1d [fix](decimal256) support decimal256 for many functions (#42136) (#42353)
BP #42136
2024-10-24 10:52:28 +08:00
e3b059e339 [fix](nereids) Fix not check column name when create or alter view (#42206) (#42323)
pr: https://github.com/apache/doris/pull/42206
commitId: 2bcaa5b4
2024-10-24 10:11:32 +08:00
44e9368c78 Pick some fix from master to 21(#41472) (#40106)(#40173) (#42212)
## Proposed changes

pr: https://github.com/apache/doris/pull/41472
commitId: 2745e044


pr: https://github.com/apache/doris/pull/40106
commitId: 0fdb1ee0


pr: https://github.com/apache/doris/pull/40173
commitId: 0d07e3d1
2024-10-24 10:09:55 +08:00