Commit Graph

20718 Commits

Author SHA1 Message Date
75d4e2c5ad branch-2.1: [fix](case) fix replay_wal_restart_fe #43705 (#43897)
Cherry-picked from #43705

Co-authored-by: meiyi <meiyi@selectdb.com>
2024-11-16 16:00:20 +08:00
Pxl
21b3e4bbf9 [Bug](runtime-filter) fix core dump on rf between varchar and char #43758 (#43934)
#43758
2024-11-16 15:59:19 +08:00
7d43cc2274 [improve](load) show 99.99% instead of 100.00% in progess when load is not finished (#43224) (#44034)
backport #43224
2024-11-16 10:57:47 +08:00
72bfd1c7a4 [opt](binlog) Support modify comment binlog #39783 (#43821)
cherry pick from #39783

Co-authored-by: smallx <e9999e@163.com>
2024-11-15 19:46:15 +08:00
edd9015de3 [branch-2.1](function) fix error result in auto partition name (#41130) (#43977)
pick https://github.com/apache/doris/pull/41130
https://github.com/apache/doris/pull/41372

---------

Co-authored-by: zhaochangle <zhaochangle@selectdb.com>
2024-11-15 19:11:42 +08:00
02bb36c281 branch-2.1: [fix](regression)Fix unstable delta rows case. #43928 (#43988)
Cherry-picked from #43928

Co-authored-by: James <lijibing@selectdb.com>
2024-11-15 11:42:57 +08:00
5d5547803c branch-2.1: [fix](datacheck) let count skip opt via meta #43743 (#43981)
Cherry-picked from #43743

Co-authored-by: Yongqiang YANG <yangyongqiang@selectdb.com>
2024-11-15 10:57:27 +08:00
74d87c9d4e branch-2.1: [performance](load) fix broker load scan ranges for unsplittable files #43161 (#43976)
Cherry-picked from #43161

Co-authored-by: Kaijie Chen <chenkaijie@selectdb.com>
2024-11-15 00:57:38 +08:00
a519702fac branch-2.1: [Bug](bitmap-filter) fix wrong type cast on BitmapFilterColumnPredicate::evaluate #43877 (#43886)
Cherry-picked from #43877

Co-authored-by: Pxl <xl@selectdb.com>
2024-11-15 00:02:51 +08:00
7fc78e3f87 [opt](brpc) check and remove unavailable brpc stubs (#43212) (#43859) 2024-11-14 19:52:06 +08:00
8554c06337 [opt](fe) Use table.readLock in TabletStatMgr for updating statistics (#39612) (#43937) 2024-11-14 19:44:16 +08:00
26fef2a02a branch-2.1: [Fix](UT) Fix status UT error introduced by #43731 #43922 (#43927)
Cherry-picked from #43922

Co-authored-by: abmdocrt <lianyukang@selectdb.com>
2024-11-14 19:23:37 +08:00
4f2a67251a [opt](fe) Optimize fe show table statistics (#35457) (#43858) 2024-11-14 12:41:29 +08:00
4531cd86e3 branch-2.1: [fix](regression-test) add checks for existence and successful upload of data files in hive-metastore.sh #43853 (#43888)
Cherry-picked from #43853

Co-authored-by: Socrates <suyiteng@selectdb.com>
2024-11-14 11:23:23 +08:00
59c8663abe [fix](nereids) convert stringLikeLiteral to double should use byte length (#43776) branch-2.1 (#43911)
### What problem does this PR solve?
pick #43776

The optimizer maps different data types to Double, allowing for a
unified comparison of literals.
StringLikeLiteral is regarded as a long int, and map the long int to
double.
To extract the first N bytes from a string, you should use
String.getBytes().length instead of String.length().
、
2024-11-14 11:15:17 +08:00
39b9b81d42 branch-2.1:[fix](build) Fix Mac compilation error caused by namespace conflict in find_symbols.h (#43868) 2024-11-14 10:10:12 +08:00
b707156169 branch-2.1: [Fix](multi-catalog)Fixed incorrect parameter transmission when obtaining files by hms partition and incorrect parameter transmission concurrently. #43767 (#43871)
Cherry-picked from #43767

Co-authored-by: Qi Chen <chenqi@selectdb.com>
2024-11-13 21:42:18 +08:00
b4f0f6d825 branch-2.1: [fix](planner)show tablet command return wrong result when having limit and offset (#43845)
Cherry-picked from #43768

Co-authored-by: starocean999 <lichi@selectdb.com>
2024-11-13 21:11:31 +08:00
47f842b4d6 branch-2.1: [minor](rpc) Check client before RPC (#43818)
Cherry-picked from #43626

Co-authored-by: Gabriel <liwenqiang@selectdb.com>
2024-11-13 19:31:55 +08:00
d4712aed1a branch-2.1: [fix](string64) fix coredump caused by ColumnArray<ColumnStr<uint64_t>>::insert_indices_from (#43862)
Cherry-picked from #43624

Co-authored-by: TengJianPing <tengjianping@selectdb.com>
2024-11-13 19:31:11 +08:00
1101fbaf04 [fix](column_complex) wrong type of Field returned by ColumnComplex (#43515) (#43860) 2024-11-13 19:07:00 +08:00
d723aa3e78 branch-2.1: [feat](backup) GetSnapshot returns snapshot expiration time (#43830)
Cherry-picked from #43731

Co-authored-by: walter <maochuan@selectdb.com>
2024-11-13 17:47:47 +08:00
6ecd55fa9e [cherry-pick](branch-2.1) Pick "[Fix](table size) Fix MoW table merge data fault (#40880)" (#43610) 2024-11-13 14:43:18 +08:00
40d755a971 [Feat](nereids) add max/min filter push down rewrite rule (#39252) (#43671)
cherry-pick #39252 to branch-2.1
2024-11-13 11:55:39 +08:00
9d4405db6f branch-2.1: [Fix](Nereids) fix floor/round/ceil/truncate functions type compute precision problem (#43782)
Cherry-picked from #43422

Co-authored-by: LiBinfeng <libinfeng@selectdb.com>
2024-11-13 11:52:14 +08:00
2e64491ee3 [branch-2.1](insert-overwrite) Support create partition for auto partition table when insert overwrite (#38628) (#42644)
pick https://github.com/apache/doris/pull/38628
2024-11-13 11:16:00 +08:00
78d99c6fdf [Debug-2.1](meta) Debug strong _consistency_read (#43274) 2024-11-13 11:15:42 +08:00
a47ced8ac3 branch-2.1: [fix](Nereids) alias function should use unbound slot as place holder (#43765)
Cherry-picked from #43597

Co-authored-by: morrySnow <zhangwenxin@selectdb.com>
2024-11-13 10:58:45 +08:00
6e021dcef9 [improvement](statistics)External table getRowCount return -1 when row count is not available or row count is 0. (#43009) (#43771)
backport: https://github.com/apache/doris/pull/43009
2024-11-12 21:39:30 +08:00
3d667e95d2 [branch-2.1](function) support array_split and array_reverse_split functions (#35619) (#43761)
pick https://github.com/apache/doris/pull/35619
2024-11-12 21:27:55 +08:00
a509bb042c [cherry-pick][test](doc) add some remote-storage-example in doris's doc to regression test (#43213) (#43564) 2024-11-12 21:26:17 +08:00
86dab57c16 [fix](cancel) Fix query time out not set (#43521)
### What problem does this PR solve?

Related PR: https://github.com/apache/doris/pull/41798
Problem Summary:
https://github.com/apache/doris/pull/41798 does not set cancel reason if
query is timeout on fe.
2024-11-12 21:25:30 +08:00
7b3357477d branch-2.1: [fix](nereids)Solve the problem of pruning wrong partitions in multi-column partition pruning (#43658)
Cherry-picked from #43332

Co-authored-by: feiniaofeiafei <53502832+feiniaofeiafei@users.noreply.github.com>
2024-11-12 19:14:51 +08:00
797a31bbb8 [fix](statistics)Change column statistics table varchar length to 1024. (#43244) (#43760)
backport: https://github.com/apache/doris/pull/43244/
2024-11-12 19:13:23 +08:00
52c29fef7f [pick](arm) use patch to opt bitshuffle and fix pick pr 38378 ,38634 (#43656)
### What problem does this PR solve?
https://github.com/apache/doris/pull/38634
https://github.com/apache/doris/pull/38378
Issue Number: close #xxx
2024-11-12 18:52:41 +08:00
24b79fd240 [branch-2.1](log) Pick all BE execution log reduction (#43267)
pick https://github.com/apache/doris/pull/42383
pick https://github.com/apache/doris/pull/42900
2024-11-12 18:18:59 +08:00
3e098e14f1 [fix](ngram bloomfilter) fix narrow conversion for ngram bf_size #43480 (#43654)
cherry pick from #43480
2024-11-12 16:54:43 +08:00
6ae2106cd9 branch-2.1: [improvement](statistics)Remove useless stats validation check. (#43499)
Cherry-picked from #43279

Co-authored-by: Jibing-Li <64681310+Jibing-Li@users.noreply.github.com>
2024-11-12 16:00:35 +08:00
821c0d1380 branch-2.1: [improvement](paimon)Using table serialization on the jni side (#43475)
Cherry-picked from #43167

Co-authored-by: wuwenchi <wuwenchihdu@hotmail.com>
Co-authored-by: wuwenchi <wuwenchi@selectdb.com>
2024-11-12 14:43:32 +08:00
66dcb943c3 branch-2.1: [opt](log) change lzo decompress log to debug level (#43583)
Cherry-picked from #43540

Co-authored-by: morningman <yunyou@selectdb.com>
2024-11-12 14:35:31 +08:00
d92c2f1b5e [cherry-pick](branch-2.1)Change spin lock to mutex (#43551)
pick from master:https://github.com/apache/doris/pull/41384
2024-11-12 14:28:26 +08:00
95a3d237b8 branch-2.1: [fix](case) Fix test_backup_restore_atomic_with_alter with SYNC (#43640)
Cherry-picked from #43601

Co-authored-by: walter <w41ter.l@gmail.com>
2024-11-12 14:03:31 +08:00
f1a8ac7f81 [fix](group commit) fix NPE in group commit select backend (#43629) (#43651)
pick https://github.com/apache/doris/pull/43629

Co-authored-by: meiyi <meiyi@selectdb.com>
2024-11-12 14:01:50 +08:00
15f85e2cfb [fix] (bloom filter) Fix the bloom filter calculation for date and datetime (#43351) (#43622)
pick from master #43351

---------

Co-authored-by: csun5285 <sunchenyang@selectdb.com>
2024-11-12 10:56:55 +08:00
cfae726428 [cherry-pick][test](doc) add some data-admin example in doris's doc to regression test (#43240) (#43566)
(cherry picked from commit 72b4daa9b461b14f1ea179f62543d2336f6ea5b2)

### What problem does this PR solve?

Issue Number: close #xxx

Related PR: #43240

Problem Summary:
2024-11-12 10:55:54 +08:00
4c224bb1dd [improvement](build index)Optimize failed task check on same tablet (#42295) (#43589)
bp #42295

Co-authored-by: qidaye <luen@selectdb.com>
2024-11-12 09:56:55 +08:00
541284ec21 branch-2.1: [fix](test) fix clickhouse jdbc catalog func with cast push down case (#43431)
Cherry-picked from #43348

Co-authored-by: zy-kkk <zhongyk10@gmail.com>
2024-11-12 00:18:20 +08:00
14caaf33cb branch-2.1: [fix](Export) fix issue that Export can not specify the columns which have capital letters (#43572)
Cherry-picked from #42994

Co-authored-by: Tiewei Fang <43782773+BePPPower@users.noreply.github.com>
2024-11-12 00:17:21 +08:00
a1ff02288f branch-2.1: [fix](hive) support query hive view created by spark (#43553)
Cherry-picked from #43530

Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com>
Co-authored-by: morningman <yunyou@selectdb.com>
2024-11-11 23:28:53 +08:00
850afa1319 branch-2.1: [test](doc) add some remote-storage-example in doris's doc to regression test (#43507)
Cherry-picked from #43213

Co-authored-by: yagagagaga <zhangminkefromflydish@gmail.com>
2024-11-11 23:22:18 +08:00