database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
20,619 Commits 1 Branch 0 Tags
443e87e20327eaa5577cc10f08a63ec1694de358
Commit Graph

9414 Commits

Author SHA1 Message Date
Socrates
f6917acd6a [cherry-pick](branch2.1) Impl translate and url encode 2.1 (#41051) 
## Proposed changes

pick https://github.com/apache/doris/pull/40567

some code about const folding should wait the pr picked:
https://github.com/apache/doris/pull/40441
 2024-09-23 14:26:27 +08:00
walter
059f822a3a [fix](restore) Remove the sqlMode from the view signature #40615 (#41110) 
cherry pick from #40615
 2024-09-23 14:07:52 +08:00
zclllhhjj
d44ee1cddb [branch-2.1](session-variable) Add a debug variable of constant fold (#35584) (#41032) 
pick https://github.com/apache/doris/pull/35584
 2024-09-23 10:01:05 +08:00
bobhan1
7d64c8cbc6 [branch-2.1] Picks "[opt](autoinc) Remove some restrictions on schema change on table that has auto-increment column #40280" (#41096) 
picks https://github.com/apache/doris/pull/40280
 2024-09-23 09:30:15 +08:00
minghong
9dc55f90eb [opt](nereids) set lower bound for range-selectivity（2.1） (#41061) 
## Proposed changes
pick #40089
Issue Number: close #xxx

<!--Describe your changes.-->
 2024-09-22 07:32:22 +08:00
Mryange
9877a08834 [feature](function) support ngram_search function #38226 (#40893) 
https://github.com/apache/doris/pull/38226 
mysql [test]>select ngram_search('123456789' , '12345' , 3);
+---------------------------------------+
| ngram_search('123456789', '12345', 3) |
+---------------------------------------+
|                                   0.6 |
+---------------------------------------+
1 row in set (0.01 sec)

mysql [test]>select ngram_search("abababab","babababa",2);
+-----------------------------------------+
| ngram_search('abababab', 'babababa', 2) |
+-----------------------------------------+
|                                       1 |
+-----------------------------------------+
1 row in set (0.01 sec)
```

doc https://github.com/apache/doris-website/pull/899

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
 2024-09-21 20:34:44 +08:00
lihangyu
d5115a21b5 [pick](ShortCircuit) Conjuncts outof key columns's order should be handled (#41071) 
#37900
 2024-09-21 20:34:05 +08:00
wuwenchi
e568ba3b4c [bugfix](hive)Handle exceptions when submitting tasks fails to prevent dead loop for 2.1 (#40708) (#41052) 
bp: #40708
 2024-09-21 08:47:31 +08:00
zhiqiang
63a1e0dccb [fix](profile) Fix npe when updating profile for internal load task. #40990 (#41077) 
cherry pick from #40990
 2024-09-20 23:46:43 +08:00
Vallish Pai
ff22059d5d [cherry-pick](branch-2.1)[fix](sys_table) fix potential NPE when query table_properties and partitions sys table (#41081) 
## Proposed changes

Issue Number: close #xxx

bp #40972
 2024-09-20 23:43:33 +08:00
wuwenchi
f4b06e83eb [bugfix](hive)Fix cache inconsistency issue for 2.1 (#40729) (#41050) 
## Proposed changes
bp: #40729
 2024-09-20 20:28:55 +08:00
starocean999
f60a881425 [fix](nereids)adjust conjunct's nullable info in LogicalExternalRelation (#41031) 
## Proposed changes

pick from master https://github.com/apache/doris/pull/41014
<!--Describe your changes.-->
 2024-09-20 20:20:12 +08:00
wuwenchi
2bb83302e4 [bugfix](hive)Remove redundant split operations for 2.1 (#40683) (#41055) 
## Proposed changes
bp: #40683
 2024-09-20 20:09:11 +08:00
starocean999
dbd72deaa5 [opt](nereids)show user friendly error msg when window function contains order by expression (#40937) (#41036) 
pick from master #40937
 2024-09-20 18:50:55 +08:00
zhiqiang
1259fe2bd5 [fix](covar) Fix covar nullable on branch-2.1 (#40841) 
covar should not be always nullable.

This fix on branch-2.1 makes covar same with master on FE.
 2024-09-20 17:35:27 +08:00
Mingyu Chen
8e860a26a7 [fix](systable) fix unstable case for partitions table (#40553) (#41043) 
bp #40553
 2024-09-20 17:13:30 +08:00
Mingyu Chen
3484e7b2ff [fix](table_options) fix potential NPE when quering table_options systable (#40944) (#41040) 
bp #40944
 2024-09-20 16:57:02 +08:00
Vallish Pai
d7f60c5ef1 [Cherry-pick](branch 2.1)[Enhancement] support last_query_id function (#41025) 
## Proposed changes

Issue Number: close #xxx

backport #40739
 2024-09-20 14:07:39 +08:00
bobhan1
64880a10d6 [branch-2.1] Picks "[Fix](partial update) Fix partial update failed when merge_type=MERGE #40730" (#40951) 
picks https://github.com/apache/doris/pull/40730
 2024-09-20 00:02:17 +08:00
zy-kkk
8b1906be81 [branch-2.1][fix](jdbc catalog) Fixed FE memory leak by enabling weak references in HikariCP (#40923) 
pick  (#40773)

When FE collects statistics, its ThreadLocal will hold the ThreadLocal
of HikariCP in JdbcClient, making it difficult for HikariCP to be gc, so
this problem can be alleviated by enabling weak references of HikariCP.
 2024-09-19 23:59:14 +08:00
Kaijie Chen
549bc3e288 [fix](pipelinex) fix fragment instance progress reports (#40325) (#40987) 
backport #40325
 2024-09-19 23:58:38 +08:00
bobhan1
49dec9f39d [branch-2.1] Picks "[opt](merge-on-write) Reduce the version not continuous logs for merge-on-write table #40946" (#40996) 
picks https://github.com/apache/doris/pull/40946
 2024-09-19 23:58:05 +08:00
zhangdong
f81d087bab [enhance](mtmv)Improve the speed of obtaining table snapshots (#40717) (#40995) 
pick: https://github.com/apache/doris/pull/40717
 2024-09-19 22:47:50 +08:00
zhangdong
fd5423145d [enhance](mtmv)tasks tvf not getLock (#40816) (#40994) 
pick: https://github.com/apache/doris/pull/40816
 2024-09-19 22:40:17 +08:00
zhangdong
7ecf088a61 [enhance](mtmv)when drop temp partition, not trigger materialized vie… (#40993) 
…w refresh (#40875)

pick: https://github.com/apache/doris/pull/40875
 2024-09-19 22:35:31 +08:00
zhangdong
7a24719f48 [enhance](mtmv) Refuse to execute insert overwrite on the same table … (#40992) 
…(#40558)

pick: https://github.com/apache/doris/pull/40558
 2024-09-19 22:18:46 +08:00
feiniaofeiafei
8302261dd2 [Fix](nereids) set all nullable aggregate function to alwaysnullable in window expression (#40693) (#40809) 
cherry-pick from master #40693
 2024-09-19 15:19:06 +08:00
camby
84f0b1fbfe [feature](view) support create or replace view stmt (#40715) (#40915) 
pick #40715 to branch-2.1
 2024-09-19 01:10:43 +08:00
Siyang Tang
7847dad4b8 [enhancement](show) Move storage policy info from show create table to show partitions (#39923) (#40824) 
## Proposed changes

pick: #39923
 2024-09-18 23:35:19 +08:00
morrySnow
5c70fe35ea [fix](Nereids) sink distribute is wrong when table is unpartitioned (#40541) (#40901) 
pick from master #40541
 2024-09-18 15:18:41 +08:00
lihangyu
956b56c664 [pick](short circuit) avoid set cacheId when non prepared execute (#40909) 
#40525
 2024-09-18 14:50:50 +08:00
zy-kkk
f3a42faf40 [branch-2.1][improvement](jdbc catalog) support jdbc external catalog insert stmt in nereids (#40902) 
pick  (#39813)
 2024-09-18 14:02:20 +08:00
morrySnow
7d23a7c587 [fix](planner) throw NPE when insert overwrite partition(*) (#40656) (#40903) 
pick from master #40656
 2024-09-18 13:48:48 +08:00
morrySnow
3336e6acbb [fix](Nereids) avoid bad cast when compute scale for round (#40776) (#40904) 
pick from master #40776

for pass test case, also fix errors in computeResultInFe

computeResultInFe will generate wrong result set if output does not
match between final result and the node executing computeResultInFe
 2024-09-18 13:48:01 +08:00
Jibing-Li
8a575d0891 [improvement](statistics)User admin instead of root to run stats sql. (#40867) (#40898) 
backport: https://github.com/apache/doris/pull/40867
 2024-09-18 13:36:50 +08:00
Jibing-Li
c176c9feb0 [fix](statistics)Fix empty table keep auto analyze bug. (#40811) (#40896) 
backport: https://github.com/apache/doris/pull/40811
 2024-09-18 12:51:44 +08:00
yiguolei
a6e2364f56 [cherrypick](branch21) pick some exception handleing pr in page io (#40883) 
## Proposed changes

pick
https://github.com/apache/doris/pull/39536
https://github.com/apache/doris/pull/39913
https://github.com/apache/doris/pull/39964
https://github.com/apache/doris/pull/40020

---------

Co-authored-by: yiguolei <yiguolei@gmail.com>
 2024-09-16 08:56:43 +08:00
zhangdong
782973ee77 [fix](auth)Http api check auth (#40688) (#40865) 
pick: https://github.com/apache/doris/pull/40688
 2024-09-15 23:50:54 +08:00
seawinde
fe9f4fdd95 [pick](mtmv)Pick some pr to 21 #39998 #40332 #40485 (#40843) 
## Proposed changes
pr: https://github.com/apache/doris/pull/40485
commitId: 18a374f6

pr: https://github.com/apache/doris/pull/40332
commitId: cd2062ae

pr: https://github.com/apache/doris/pull/39998
commitId: 948fb2ab
 2024-09-15 23:48:33 +08:00
zclllhhjj
0d3b9c3f18 [branch-2.1](load) fix wrong replica number when loading to table with no partition (#40635) (#40881) 
pick https://github.com/apache/doris/pull/40635
 2024-09-15 19:58:53 +08:00
Jibing-Li
b7103bf00c [fix](statistics)Fix drop stats log editlog bug. Catch drop stats exception while truncate table. (#40738) (#40853) 
backport: https://github.com/apache/doris/pull/40738
 2024-09-14 23:08:24 +08:00
Jibing-Li
0b1d517caa [improvement](statistics)Return -1 to neredis if report olap table row count for new table is not done for all tablets. (#40457) (#40838) 
backport: https://github.com/apache/doris/pull/40457
 2024-09-14 13:19:35 +08:00
HappenLee
472a42a80e [update](exec) set ENABLE_NEREIDS_DML_WITH_PIPELINE = true, update from 2.0 to 2.1 (#40825) 
change the dafault value in update to 2.1
 2024-09-14 10:58:07 +08:00
Gabriel
168742deba [followup](branch-2.1) Fuzzy parallel_prepare_threshold (#40793) 
## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
 2024-09-13 22:46:31 +08:00
Calvin Kirs
f9b79c613a [Fix](Job)Replaying logs should not modify the original information of the job (#40474) (#40808) 
…

## Proposed changes
```
        JobExecutionConfiguration jobConfig = new JobExecutionConfiguration();
        jobConfig.setExecuteType(JobExecuteType.INSTANT);
        setJobConfig(jobConfig);
```
- Replaying logs should not modify the original information of the job
- Use the new optimizer to check whether the executed statement is legal

(cherry picked from commit de90051162de7004cf171bbf4d21bd95ff9f3540)

## Proposed changes

Issue Number: #40474
 2024-09-13 20:47:57 +08:00
Sun Chenyang
c2ad828b0c [fix] (Nereids) restrict the execution of match on the scan (#40532) (#40780) 
## Proposed changes

pick from master #40532

<!--Describe your changes.-->
 2024-09-13 20:03:11 +08:00
zy-kkk
9e8e1dac4e [branch-2.1][fix](default value) Avoid default precision value of 0 for default expressions during deserialization (#40806) 
pick  (#40671)

This PR fixes the issue where the precision of default value expressions
was incorrectly set to `0` during deserialization. The `gsonPostProcess`
method no longer assigns a default precision of `0` if the precision is
not provided. Additionally, logic has been added to ensure that
expressions without precision do not incorrectly apply a precision of
`0`.
 2024-09-13 19:59:12 +08:00
Gabriel
3395cd5ce9 [PipelineX](improvement) Prepare tasks in parallel (#40270) 
## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
 2024-09-13 13:34:29 +08:00
Calvin Kirs
76495b6d5c [chore](dependencies)upgrade spring to 5.3.39 (#39863) (#40709) 
## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->

(cherry picked from commit a692af226a8292d1b0a409c914d616157b64c82a)

## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->
 2024-09-13 10:39:36 +08:00
morrySnow
51c8b62d1c [opt](Nereids) fix several insert into related issues (#40467) (#40755) 
pick from master #40467

- http_stream TVF should always generate one fragment plan
- http_stream TVF plan should not check root as scan node
- distinguish group_commit TVF with normal insert statement
- index and generate slot should based on type cast base slot
- agg_state could cast from nullable to non-nullable
- colocated and bucket scan range compute should only on scan node
 2024-09-13 10:19:56 +08:00