database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
Files
614a76beeac73821c78903c46e7a703b7956796b
doris/be/src/exec
History
Yunfeng,Wu 614a76beea [Doris on ES] Support compound_and predicate push down to Elasticsearch (#3277) 
Relate Issue: https://github.com/apache/incubator-doris/issues/3248


SQL:

```
select * from test where (k2 = 6 and k3 = 1) or (k2 = 2 and k3 =3 and k4 = 'beijing');
```

Output filter:

```
((#k2:[6 TO 6] #k3:[1 TO 1]) (#(#k2:[2 TO 2] #k3:[3 TO 3]) #k4:beijing))~1
```

SQL:

```
select * from test where (k2 = 6 or k3 = 7) or (k2 = 2 and k3 =3 and (k4 = 'beijing' or k4 = 'zhaochun'));
```
Output filter:

```
(k2:[6 TO 6] k3:[7 TO 7] (#(#k2:[2 TO 2] #k3:[3 TO 3]) #((k4:beijing k4:zhaochun)~1)))~1
```

SQL:

```
select * from test where (k2 = 6 or k3 = 7) or (k2 = 2 and abs(k3) =3 and (k4 = 'beijing' or k4 = 'zhaochun'));
```

Output filter (`abs` can not be pushed down to es, so doris on es would not process this scenario ):

```
match_all
```
2020-04-08 21:09:39 +08:00
..
es
[Doris on ES] Support compound_and predicate push down to Elasticsearch (#3277)
2020-04-08 21:09:39 +08:00
schema_scanner
[Authorization] Modify the authorization checking logic (#2372)
2019-12-06 17:45:56 +08:00
aggregation_node_ir.cpp
Change variable and namespace name in BE (#268)
2018-11-02 10:22:32 +08:00
aggregation_node.cpp
Remove unused LLVM related codes of directory:be/src/runtime (#2910) (#2985)
2020-02-25 13:47:20 +08:00
aggregation_node.h
Remove llvm relative code from be/src/exec (#2955)
2020-02-20 20:43:26 +08:00
analytic_eval_node.cpp
Uniform Status (#1317)
2019-06-14 23:38:31 +08:00
analytic_eval_node.h
Remove unused code about showing current queries (#552)
2019-01-18 09:53:40 +08:00
assert_num_rows_node.cpp
Support subquery with non-scalar result in Binary predicate and Between-and predicate (#2360)
2019-12-05 21:27:33 +08:00
assert_num_rows_node.h
Support subquery with non-scalar result in Binary predicate and Between-and predicate (#2360)
2019-12-05 21:27:33 +08:00
base_scanner.cpp
Fix invalid to_bitmap input lead to BE core (#2510)
2019-12-19 21:28:00 +08:00
base_scanner.h
Fix Stream load double NumberTotalRows (#1664)
2019-08-19 12:23:43 +08:00
blocking_join_node.cpp
Remove llvm relative code from be/src/exec (#2955)
2020-02-20 20:43:26 +08:00
blocking_join_node.h
Remove llvm relative code from be/src/exec (#2955)
2020-02-20 20:43:26 +08:00
broker_reader.cpp
Use SleepFor() instead of usleep() (#3211)
2020-03-29 14:18:19 +08:00
broker_reader.h
Do not get file size in Broker openReader() method (#1560)
2019-07-29 23:05:01 +08:00
broker_scan_node.cpp
Fix broker scan node mem limit check (#3123)
2020-03-16 20:36:46 +08:00
broker_scan_node.h
Support reading Parquet file when loading data (#1173)
2019-07-01 18:39:27 +08:00
broker_scanner.cpp
Fix incompatibility with arm architecture in olap #2645 (#2682)
2020-01-07 19:16:10 +08:00
broker_scanner.h
Fix Stream load double NumberTotalRows (#1664)
2019-08-19 12:23:43 +08:00
broker_writer.cpp
Fix bug that backup may create an empty file on remote storage. (#1869)
2019-09-28 00:11:43 +08:00
broker_writer.h
Fix bug that backup may create an empty file on remote storage. (#1869)
2019-09-28 00:11:43 +08:00
CMakeLists.txt
Fix output results may incorrect when using intersect and except statements (#3228)
2020-04-01 20:58:43 +08:00
cross_join_node.cpp
Unify the msg of 'Memory exceed limit' (#1737)
2019-09-03 10:42:16 +08:00
cross_join_node.h
Change variable and namespace name in BE (#268)
2018-11-02 10:22:32 +08:00
csv_scan_node.cpp
Replace all remaining boost::split() with strings::split() (#2302)
2019-11-26 22:22:14 +08:00
csv_scan_node.h
Change label of broker load txn (#1134)
2019-05-10 16:53:46 +08:00
csv_scanner.cpp
Uniform Status (#1317)
2019-06-14 23:38:31 +08:00
csv_scanner.h
Change variable and namespace name in BE (#268)
2018-11-02 10:22:32 +08:00
data_sink.cpp
Expose data pruned-filter-scan ability (#1527)
2019-08-11 12:59:24 +08:00
data_sink.h
Uniform Status (#1317)
2019-06-14 23:38:31 +08:00
decompressor.cpp
Add a loaded rows in SHOW LOAD result (#1686)
2019-08-27 14:13:47 +08:00
decompressor.h
Make LZO support optional (#1263)
2019-06-07 22:26:54 +08:00
empty_set_node.cpp
Uniform Status (#1317)
2019-06-14 23:38:31 +08:00
empty_set_node.h
Change variable and namespace name in BE (#268)
2018-11-02 10:22:32 +08:00
es_http_scan_node.cpp
[Doris on ES] Support compound_and predicate push down to Elasticsearch (#3277)
2020-04-08 21:09:39 +08:00
es_http_scan_node.h
Optimize Doris On Elasticsearch performance (#2237)
2019-12-04 12:57:45 +08:00
es_http_scanner.cpp
Optimize Doris On Elasticsearch performance (#2237)
2019-12-04 12:57:45 +08:00
es_http_scanner.h
Optimize Doris On Elasticsearch performance (#2237)
2019-12-04 12:57:45 +08:00
es_scan_node.cpp
Enable auto convert when check in (#1926)
2019-10-09 22:31:27 +08:00
es_scan_node.h
[JDK] Support OpenJDK (#2804)
2020-02-20 23:47:02 +08:00
except_node.cpp
Fix output results may incorrect when using intersect and except statements (#3228)
2020-04-01 20:58:43 +08:00
except_node.h
Fix output results may incorrect when using intersect and except statements (#3228)
2020-04-01 20:58:43 +08:00
exchange_node.cpp
Unify the msg of 'Memory exceed limit' (#1737)
2019-09-03 10:42:16 +08:00
exchange_node.h
Fix the core of get_next in exchange node (#2505)
2019-12-19 16:40:33 +08:00
exec_node.cpp
[CodeStyle] Rename new_partition_aggregation_node and new_partitioned_hash_table (#3166)
2020-03-20 19:59:01 +08:00
exec_node.h
Remove llvm relative code from be/src/exec (#2955)
2020-02-20 20:43:26 +08:00
file_reader.h
Support reading Parquet file when loading data (#1173)
2019-07-01 18:39:27 +08:00
file_writer.h
Fix bug that backup may create an empty file on remote storage. (#1869)
2019-09-28 00:11:43 +08:00
hash_join_node_ir.cpp
[Performance] Improve performence of hash join in some case (#3148)
2020-03-20 10:31:14 +08:00
hash_join_node.cpp
[Bug] Fix bug that right semi/anti join is not right (#3167)
2020-03-20 20:58:55 +08:00
hash_join_node.h
[Performance] Improve performence of hash join in some case (#3148)
2020-03-20 10:31:14 +08:00
hash_table.cpp
Remove unused LLVM related codes of directory:be/src/runtime (#2910) (#2985)
2020-02-25 13:47:20 +08:00
hash_table.h
[ExceptNode] Implement except node (#3056)
2020-03-17 10:54:40 +08:00
hash_table.hpp
[ExceptNode] Implement except node (#3056)
2020-03-17 10:54:40 +08:00
intersect_node.cpp
Fix output results may incorrect when using intersect and except statements (#3228)
2020-04-01 20:58:43 +08:00
intersect_node.h
Fix output results may incorrect when using intersect and except statements (#3228)
2020-04-01 20:58:43 +08:00
line_reader.h
Change variable and namespace name in BE (#268)
2018-11-02 10:22:32 +08:00
local_file_reader.cpp
Support reading Parquet file when loading data (#1173)
2019-07-01 18:39:27 +08:00
local_file_reader.h
Support reading Parquet file when loading data (#1173)
2019-07-01 18:39:27 +08:00
local_file_writer.cpp
Fix bug that backup may create an empty file on remote storage. (#1869)
2019-09-28 00:11:43 +08:00
local_file_writer.h
Fix bug that backup may create an empty file on remote storage. (#1869)
2019-09-28 00:11:43 +08:00
lzo_decompressor.cpp
Uniform Status (#1317)
2019-06-14 23:38:31 +08:00
merge_join_node.cpp
Uniform Status (#1317)
2019-06-14 23:38:31 +08:00
merge_join_node.h
Remove llvm relative code from be/src/exec (#2955)
2020-02-20 20:43:26 +08:00
merge_node.cpp
Uniform Status (#1317)
2019-06-14 23:38:31 +08:00
merge_node.h
Change variable and namespace name in BE (#268)
2018-11-02 10:22:32 +08:00
mysql_scan_node.cpp
Uniform Status (#1317)
2019-06-14 23:38:31 +08:00
mysql_scan_node.h
Change variable and namespace name in BE (#268)
2018-11-02 10:22:32 +08:00
mysql_scanner.cpp
Uniform Status (#1317)
2019-06-14 23:38:31 +08:00
mysql_scanner.h
Make MySQL support optional (#1248)
2019-06-05 12:28:15 +08:00
olap_common.cpp
Reduce unnecessary memory allocat and copy in OlapScanNode (#1742)
2019-09-04 21:05:12 +08:00
olap_common.h
Support bitmap index for more type (#2630)
2020-01-31 21:09:29 +08:00
olap_rewrite_node.cpp
Support reading Parquet file when loading data (#1173)
2019-07-01 18:39:27 +08:00
olap_rewrite_node.h
Decimal optimize branch #695 (#727)
2019-03-22 17:22:16 +08:00
olap_scan_node.cpp
Remove llvm relative code from be/src/exec (#2955)
2020-02-20 20:43:26 +08:00
olap_scan_node.h
Add block split bloom filter (#2471)
2019-12-18 12:57:44 +08:00
olap_scanner.cpp
Add disable_storage_page_cache config (#2890)
2020-02-16 19:13:30 +08:00
olap_scanner.h
Fix incorrect scan bytes in metrics (#2034)
2019-10-23 18:13:40 +08:00
olap_utils.h
Decimal optimize branch #695 (#727)
2019-03-22 17:22:16 +08:00
orc_scanner.cpp
Fix orc load timestamp bug (#3047)
2020-03-06 18:03:27 +08:00
orc_scanner.h
Support load orc format in Apache Doris (#2554)
2020-01-07 14:22:43 +08:00
parquet_reader.cpp
Support 64 bit timestamp in from_unixtime (#3069)
2020-03-17 17:30:42 +08:00
parquet_reader.h
Support 64 bit timestamp in from_unixtime (#3069)
2020-03-17 17:30:42 +08:00
parquet_scanner.cpp
Support 64 bit timestamp in from_unixtime (#3069)
2020-03-17 17:30:42 +08:00
parquet_scanner.h
Fix importing non-parquet format file causing be crash (#1454)
2019-07-11 16:04:36 +08:00
partitioned_aggregation_node_ir.cc
Fix bug of memory limit when group by varchar columns. (#3242)
2020-04-01 18:48:18 +08:00
partitioned_aggregation_node.cc
[CodeStyle] Rename new_partition_aggregation_node and new_partitioned_hash_table (#3166)
2020-03-20 19:59:01 +08:00
partitioned_aggregation_node.h
[CodeStyle] Rename new_partition_aggregation_node and new_partitioned_hash_table (#3166)
2020-03-20 19:59:01 +08:00
partitioned_hash_table_ir.cc
[CodeStyle] Rename new_partition_aggregation_node and new_partitioned_hash_table (#3166)
2020-03-20 19:59:01 +08:00
partitioned_hash_table.cc
Revert "Remove deep copy when doing hash table EvalRow (#3171)" (#3173)
2020-03-23 15:29:46 +08:00
partitioned_hash_table.h
Fix bug of memory limit when group by varchar columns. (#3242)
2020-04-01 18:48:18 +08:00
partitioned_hash_table.inline.h
[CodeStyle] Rename new_partition_aggregation_node and new_partitioned_hash_table (#3166)
2020-03-20 19:59:01 +08:00
pl_task_root.cpp
Uniform Status (#1317)
2019-06-14 23:38:31 +08:00
pl_task_root.h
Change variable and namespace name in BE (#268)
2018-11-02 10:22:32 +08:00
plain_text_line_reader.cpp
Uniform Status (#1317)
2019-06-14 23:38:31 +08:00
plain_text_line_reader.h
Change variable and namespace name in BE (#268)
2018-11-02 10:22:32 +08:00
read_write_util.cpp
Change variable and namespace name in BE (#268)
2018-11-02 10:22:32 +08:00
read_write_util.h
Uniform Status (#1317)
2019-06-14 23:38:31 +08:00
repeat_node.cpp
[GroupingSet] fix a bug when using grouping set without all column in a grouping set item (#2877)
2020-02-12 21:50:12 +08:00
repeat_node.h
[GroupingSet] fix a bug when using grouping set without all column in a grouping set item (#2877)
2020-02-12 21:50:12 +08:00
row_batch_list.h
Reduce UT binary size (#314)
2018-11-15 16:17:23 +08:00
scan_node.cpp
Uniform Status (#1317)
2019-06-14 23:38:31 +08:00
scan_node.h
Change variable and namespace name in BE (#268)
2018-11-02 10:22:32 +08:00
scanner_ir.cpp
Change license to Apache License 2.0 (#262)
2018-11-01 09:06:01 +08:00
schema_scan_node.cpp
[Authorization] Modify the authorization checking logic (#2372)
2019-12-06 17:45:56 +08:00
schema_scan_node.h
Change variable and namespace name in BE (#268)
2018-11-02 10:22:32 +08:00
schema_scanner.cpp
Uniform Status (#1317)
2019-06-14 23:38:31 +08:00
schema_scanner.h
[Authorization] Modify the authorization checking logic (#2372)
2019-12-06 17:45:56 +08:00
select_node.cpp
Uniform Status (#1317)
2019-06-14 23:38:31 +08:00
select_node.h
Change variable and namespace name in BE (#268)
2018-11-02 10:22:32 +08:00
set_operation_node.cpp
Fix output results may incorrect when using intersect and except statements (#3228)
2020-04-01 20:58:43 +08:00
set_operation_node.h
Fix output results may incorrect when using intersect and except statements (#3228)
2020-04-01 20:58:43 +08:00
sort_exec_exprs.cpp
Uniform Status (#1317)
2019-06-14 23:38:31 +08:00
sort_exec_exprs.h
Change variable and namespace name in BE (#268)
2018-11-02 10:22:32 +08:00
sort_node.cpp
Unify the msg of 'Memory exceed limit' (#1737)
2019-09-03 10:42:16 +08:00
sort_node.h
Uniform Status (#1317)
2019-06-14 23:38:31 +08:00
spill_sort_node.cc
Unify the msg of 'Memory exceed limit' (#1737)
2019-09-03 10:42:16 +08:00
spill_sort_node.h
Change variable and namespace name in BE (#268)
2018-11-02 10:22:32 +08:00
tablet_info.cpp
Fix error DCHECK for partition_columns (#1606)
2019-08-08 16:29:08 +08:00
tablet_info.h
[Refactor] Some tiny refactor on streaming-load related code (#2891)
2020-02-13 10:42:52 +08:00
tablet_sink.cpp
Add config: tablet writer open rpc timeout (#3258)
2020-04-03 16:43:56 +08:00
tablet_sink.h
Set the load channel's timeout to be the same as the load job's timeout (#2405)
2019-12-06 21:51:00 +08:00
text_converter.cpp
Make StringValue's memory layout same with Slice (#1712)
2019-08-27 22:15:46 +08:00
text_converter.h
Make StringValue's memory layout same with Slice (#1712)
2019-08-27 22:15:46 +08:00
text_converter.hpp
Open datetime min value limit (#3158)
2020-03-24 10:52:57 +08:00
topn_node.cpp
Remove llvm relative code from be/src/exec (#2955)
2020-02-20 20:43:26 +08:00
topn_node.h
Change variable and namespace name in BE (#268)
2018-11-02 10:22:32 +08:00
union_node_ir.cpp
Change variable and namespace name in BE (#268)
2018-11-02 10:22:32 +08:00
union_node.cpp
Remove llvm relative code from be/src/exec (#2955)
2020-02-20 20:43:26 +08:00
union_node.h
Remove llvm relative code from be/src/exec (#2955)
2020-02-20 20:43:26 +08:00