Commit Graph

901 Commits

Author SHA1 Message Date
c2c81d58dc [Fix]SlotRef.tosql() is the same as the SQL returned by different sql
Fix: #3555

NOTICE(#3622):
This is a "revert of revert pull request".
This pr is mainly used to synthesize the PRs whose commits were
scattered and submitted due to the wrong merge method into a complete single commit.
2020-05-18 14:47:48 +08:00
7a83c5662d [Bug] fix OrCompoundPredicate predicate fold bug #3596
Fix: #3596

NOTICE(#3622):
This is a "revert of revert pull request".
This pr is mainly used to synthesize the PRs whose commits were
scattered and submitted due to the wrong merge method into a complete single commit.
2020-05-18 14:46:34 +08:00
d8a32af59c [Bug] Fix bug that descriptor table is not reset before planning next routine load task
Before planning for next routine load task, the analyzer and descriptor table
in it should be reset. Otherwise, a lot of historical objects will
accumulate inside, causing memory leaks.
Fix: #3603

NOTICE(#3622):
This is a "revert of revert pull request".
This pr is mainly used to synthesize the PRs whose commits were
scattered and submitted due to the wrong merge method into a complete single commit.
2020-05-18 14:44:27 +08:00
903592d82b Revert "Refactor some redunant code && Replace some UT by UtFrameUtils" (#3613)
This revert is used to correct the mess of the commit
timeline caused by the wrong merge method.
2020-05-18 13:11:39 +08:00
d028a728e4 Revert "[Bug] Fix bug that ConcurrentModificationException thrown " (#3612)
This revert is used to correct the mess of the commit
timeline caused by the wrong merge method.
2020-05-18 13:10:33 +08:00
a37f5cb657 Revert "[Bug] Fix bug that DbTxnMgr does not create for db in CatalogRecycleBin" (#3611)
This revert is used to correct the mess of the commit
timeline caused by the wrong merge method.
2020-05-18 13:08:36 +08:00
539efb3532 Revert "[Fix]SlotRef.tosql() is the same as the SQL returned by different sql" (#3610)
This revert is used to correct the mess of the commit
timeline caused by the wrong merge method.
2020-05-18 13:07:21 +08:00
20f20239f2 Revert "[Bug] fix OrCompoundPredicate predicate fold bug #3596" (#3609)
This revert is used to correct the mess of the commit
timeline caused by the wrong merge method.
2020-05-18 13:03:24 +08:00
ed6548e27f Revert "[Bug] Fix bug that descriptor table is not reset before planning next routine load task (#3605)" (#3608)
This reverts commit 271f25f0a4e98c3d9130c0772bc386e7786cbae4.

This revert is used to correct the mess of the commit
timeline caused by the wrong merge method.
2020-05-18 13:00:20 +08:00
2f3b7b5b8e [Refactor] Refactor some redundant code && Replace some UT by UtFrameUtils 2020-05-18 10:53:32 +08:00
bca9fb8551 [Bug] Fix bug that ConcurrentModificationException thrown
When truncate the table, a ConcurrentModificationException may thrown when there
are temp partitions in this table.
2020-05-18 10:48:19 +08:00
5276b5a4a3 [Bug] Fix bug that DbTxnMgr does not create for db in CatalogRecycleBin
Fix #3589
The reason is that:
When load meta from image, we will create `DatabaseTransactionMgr` for each database
loaded from `loadDb()` method. But we forget to create `DatabaseTransactionMgr` for 
database in the catalog recycle bin.
2020-05-18 10:42:17 +08:00
62f746fc87 [Fix] SlotRef.tosql() is the same as the SQL returned by different sql 2020-05-18 10:41:15 +08:00
e6588981b4 [Bug] fix OrCompoundPredicate predicate fold bug #3596 (#3597)
* [Bug] fix OrCompoundPredicate predicate fold bug

* fix code style
2020-05-18 10:36:13 +08:00
271f25f0a4 [Bug] Fix bug that descriptor table is not reset before planning next routine load task (#3605)
Before planning for next routine load task, the analyzer and descriptor table
in it should be reset. Otherwise, a lot of historical objects will
accumulate inside, causing memory leaks.
2020-05-18 10:34:21 +08:00
5138197d57 [Bug] generate exceptions to avoid mulitDistinctAggregation produces wrong results (#3561)
when a query (#3492) contain “2 DistinctAggregation with one column” and “1 
DistinctAggregation with two columns”,  it will produce wrong result.

This pull request is not to solve this problem really, but to generate exceptions to avoid 
getting wrong results. 

This problem needs a real repair in future.
2020-05-16 21:36:43 +08:00
8cb48161e3 change to current catalog 2020-05-16 21:12:46 +08:00
4217db00d3 Tosql method returns slot index and column name 2020-05-15 17:31:25 +08:00
c50b1a4d17 fix bug 2020-05-15 16:15:53 +08:00
a7e1c08624 Report error when subquery in case-when returns empty set (#3558)
The doris rewrite the subquery in case-when to inline view.
So it the result is different between subquery in case-when and inline view.
We could not support the empty set of subquery in case-when.
This commit forbidden this case.
2020-05-15 12:32:05 +08:00
8be10dca05 fix code style 2020-05-15 12:10:19 +08:00
805ecc9d4e fix 2020-05-15 11:23:01 +08:00
0919407092 [Bug] fix OrCompoundPredicate predicate fold bug 2020-05-15 10:20:13 +08:00
123e1394b1 [Delete] Allow delete duplicated non-key column using delete from (#3424) 2020-05-15 09:26:36 +08:00
f162596d32 fix bug 2020-05-14 16:13:39 +08:00
fc02ce8034 tmp_partition_qa1 2020-05-14 15:21:05 +08:00
9f224cdd8a [Bug] Fix bug of Partition prune of constant in predicate (#3476)
**1. phenomenon:**

The following two statements are the same, but a query has results and the other query has no results

mysql> select * from (select '积极' as kk1, sum(k2) from table_range where k1 = '2013-01-01' group by kk1)tt where kk1 = '积极';        
+--------+-----------+
| kk1    | sum(`k2`) |
+--------+-----------+
| 积极 |         1 |
+--------+-----------+
1 row in set (0.01 sec)

mysql> select * from (select '积极' as kk1, sum(k2) from table_range where k1 = '2013-01-01' group by kk1)tt where kk1 in ('积极');     
Empty set (0.01 sec)


**2. reason:**

In partition prune, constant in predicate(‘积极’ in ‘积极’) is mistakenly considered to meet partition prune conditions, and mistakenly regarded as partition prune column. Then in partition prune , no partition is considered to meet the requirements, so it is planned to be 0 partition in query planning
2020-05-14 11:46:13 +08:00
d9e455124a [FIX] fix some doris web page dispaly error (#3544) 2020-05-14 11:38:42 +08:00
b08e08b3ba first 2020-05-14 09:25:51 +08:00
54e38ecda2 [Bug] Fix bug of transaction manager (#3565)
Fix bug of using wrong `abortTransaction()` method
2020-05-13 15:45:15 +08:00
f9f3a84e9d fixed bug:SlotRef.tosql() is the same as the SQL returned by different SQL 2020-05-13 15:06:44 +08:00
ca7c0717cd Fix compile bug (#3557) 2020-05-12 10:24:37 +08:00
b648734441 [TxxMgr] Support txn management in db level and use ArrayDeque to improve txn task performance (#3369)
This PR is the first step to make Doris stream load more robust with higher concurrent 
performance(#3368),the main work is to support txn management in db level isolation
and use ArrayDeque to stored final status txns.
2020-05-11 23:32:43 +08:00
4294301c53 Throw DdlException when use admin set frontend config (#3539)
The set more than one config in a single set config stmt, an exception will be thrown
to forbid the operation.
2020-05-11 23:29:38 +08:00
edbeaf8e30 Throw a UserException when miss plugin's md5 file (#3542) 2020-05-11 15:33:35 +08:00
561765fc08 Identify old empty tablet when add tablet to meta in ReportHandler (#3547) 2020-05-11 09:50:43 +08:00
c86af45f4f fix 2020-05-10 19:16:15 +08:00
edb3ad696d [Deps] Remove redundant com.baidu:jprotobuf (#3322)
* exclude jprotobuf from jprotobuf-rpc-core
* add commons-io used in fe.
2020-05-10 17:10:46 +08:00
e69e199df1 fix concurrent_modify_bug 2020-05-09 11:46:04 +08:00
ad42a1d494 fix 2020-05-08 14:16:56 +08:00
2586f09548 [Bug] Fix bug that SHOW DELETE not return Delete job info (#3515)
The callback added to the CallbackFactory should not be removed until the
transaction is aborted or visible. Otherwise, some callback method may failed
to be called.
2020-05-08 13:04:20 +08:00
f90da72078 [Planner]Enhance AssertNumRowsNode (#3485)
Enhance AssertNumRowsNode to support equal, less than, greater than,... assert conditions
2020-05-08 12:49:48 +08:00
45814c85ac [BugFix] Fix the bug that FE web can't show each fragment execute time percent (#3497)
like this:
          (Active: 14.133ms, non-child: 93.20%)
2020-05-08 12:48:05 +08:00
595f14498d fix 2020-05-08 12:10:34 +08:00
1b14dd4426 Refactor some redunant code && Replace some UT by UtFrameUtils
This CL have no logic change, just do some code refacotr and UT Change.
2020-05-08 12:07:33 +08:00
084515317f [Bug] Fix constant In Predicate result error (#3511)
`select 1 not in (2, NULL, 1);` should return `0`
2020-05-08 11:30:11 +08:00
d68c1eb9b2 fix compile 2020-05-07 22:13:32 +08:00
d60bb81cb0 [SQL Function] Calculate 'case when expr' when possible (#3396)
Calculate 'case when expr' when possible
2020-05-07 22:04:09 +08:00
c74253c0dc for qa test6 2020-05-07 17:52:42 +08:00
ca36dc697f [Bug] Fix bug that push down logic error on semi join (#3481)
For SQL like:
```
select * from
join1 left semi join join2
on join1.id = join2.id and join2.id > 1;
```

the predicate `join2.id > 1` can not be pushed down to table join1.
2020-05-07 09:30:30 +08:00