Commit Graph

18429 Commits

Author SHA1 Message Date
f85b04c2c6 [fix](datatype) fixed decimal type implicit cast handling in BinaryPredicate (#30181) 2024-01-25 13:23:12 +08:00
79d178ca54 [test](ut) added UT cases for show create materialized view (#29563) 2024-01-25 13:23:12 +08:00
c7360fd014 [feature](function) support ip function named ipv4_cidr_to_range(addr, cidr) (#29819)
* support ip function ipv4_cidr_to_range

* fix ipv4_cidr_to_range function only support ipv4 type
2024-01-24 10:02:03 +08:00
dde5ed5231 [fix](fe-memory) Fix fe schema change high memory usage (#30231)
Signed-off-by: Jack Drogon <jack.xsuperman@gmail.com>
2024-01-24 10:02:03 +08:00
5213f941dd [improvement](cooldown) print the cooldown version when follow cooldown version (#30239) 2024-01-24 10:02:03 +08:00
040ace126c [fix](Nereids) group by key should be required (#30273) 2024-01-24 10:01:14 +08:00
2b3e7589b7 [fix](nereids)group by expr may be lost in EliminateGroupByConstant rule (#30274) 2024-01-24 10:01:14 +08:00
4af3fd2a2e [fix](Nereids) fix bug in case-when/if stats estimation (#30265) 2024-01-24 10:00:25 +08:00
1a51d04cb8 [fix](move-memtable) fix schema use-after-free in delta writer v2 (#30254) 2024-01-24 10:00:25 +08:00
5e66e2519d [improve](column) support append_data_by_selector function in const column (#29996)
support append_data_by_selector function in const column
2024-01-24 09:59:45 +08:00
Pxl
02a27a587a remove some unused member function of IFunctionBase (#30260) 2024-01-24 09:59:45 +08:00
72f4e7e2d1 [security] Don't print token (#30227) 2024-01-24 09:59:45 +08:00
b98acf2d90 [fix](mtmv)mtmv default open enableNereidsDML #30235 2024-01-24 09:59:45 +08:00
4cbacb5b39 [enhancement](recover) Support skipping bad tablet in select by session variable (#30241)
In some scenarios, user has a huge amount of data and only a single replica was specified when creating the table, if one of the tablet is damaged, the table will not be able to be select. If the user does not care about the integrity of the data, they can use this variable to temporarily skip the bad tablet for querying and load the remaining data into a new table.
2024-01-24 09:59:43 +08:00
1b9f1f6483 [feature](Planner): Push down TopNDistinct through Join (#30216)
Push down TopNDistinct through Outer/Cross Join
2024-01-24 09:59:13 +08:00
f4a10c3fbc [enhancement](Nereids): add builder for hyper graph (#30061) 2024-01-24 09:58:31 +08:00
8c6e5202d4 [chore](ci) remove some unused code (#30253)
Co-authored-by: stephen <hello-stephen@qq.com>
2024-01-24 09:58:31 +08:00
3d22543add [pipelineX](fix) Fix coredump if prepare failed (#30250) 2024-01-24 09:58:31 +08:00
92a9e8265b [Imporve](RF) Support remote broadcast join build bf exactly (#30247) 2024-01-23 14:11:54 +08:00
9a8bcf2b1b [fix](planner) row policy rewriter generate wrong plan on join table ref (#30233) 2024-01-23 14:11:54 +08:00
8a8c0ec992 Add 2.1 version workload group document (#30212) 2024-01-23 14:11:17 +08:00
ce5ba61640 [refactor](close)Full refactor async writer (#30082)
---------

Co-authored-by: yiguolei <yiguolei@gmail.com>
2024-01-23 13:22:15 +08:00
bc03354be8 [improvement](jdbc catalog) Optimize the Close logic of JDBC client (#30236)
Optimize the Close logic of the JDBC client so that the Jdbc Catalog can correctly cancel the running query when the query is cancelled.
2024-01-23 13:22:14 +08:00
d964f873d5 [doc](Variant) fix doc rendering and add version bar (#30249) 2024-01-23 13:22:14 +08:00
2499ca6d89 [Enhancement](plan) Optimize preagg for aggregate function (#28886) 2024-01-23 13:22:14 +08:00
d61974db14 [chore](docs) fix some docs wrong & add important comment & fe start config for old machine (#29742)
fix some docs wrong & add important comment & fe start config for old machine
2024-01-23 13:22:14 +08:00
8308bc96b9 [fix](paimon)set timestamp's scale for parquet which has no logical type (#30119) 2024-01-23 13:22:14 +08:00
Pxl
1e74ad3f3b [Feature](materialized-view) support predicate apprear both on key and value mv column (#30215)
support predicate apprear both on key and value mv column
2024-01-23 13:22:14 +08:00
0e5d56fc2e [pipelineX](fix) Fix use-after-free MultiCastSourceDependency (#30199) 2024-01-23 13:22:14 +08:00
7be9301360 [improvement](docs) add faq for flink-connector-doris (#30043) 2024-01-23 13:22:13 +08:00
fb2145fe96 [fix](fe) Upgrade mariadb client version from 3.0.4 to 3.0.9 (#30242)
mariadb-java-client 3.0.4 has two serious problems:
* https://jira.mariadb.org/browse/CONJ-972
* https://jira.mariadb.org/browse/CONJ-973
2024-01-23 10:12:37 +08:00
510d88f315 [fix](mtmv)return MTMV with at least one available partition #30156 2024-01-23 10:12:37 +08:00
bb6fff3455 [fix](move-memtable) make sure index descriptor is set when creating delta writer (#30157)
---------

Co-authored-by: Yongqiang YANG <98214048+dataroaring@users.noreply.github.com>
Co-authored-by: Xin Liao <liaoxinbit@126.com>
2024-01-23 10:12:37 +08:00
32c5153999 [fix](routine-load) pause job when json path is invalid #30197
If jsonpaths is set wrong, routine load job will report error but running all time.For example:

CREATE ROUTINE LOAD jobName ON tableName
PROPERTIES
(
    "format" = "json",
    "max_batch_interval" = "5",
    "max_batch_rows" = "300000",
    "max_batch_size" = "209715200",
    "jsonpaths" = "[\'t\',\'a\']"
)
FROM KAFKA
(
    "kafka_broker_list" = "$IP:PORT",
    "kafka_topic" = "XXX",
    "property.kafka_default_offsets" = "OFFSET_BEGINNING"
);
Jsonpaths ['t','a'] is invalid, but job will running all time.
2024-01-23 10:12:37 +08:00
9c742d46a2 [fix](group commit) abort txn should use label if replay wal failed (#30219) 2024-01-23 10:12:35 +08:00
9e0c518aaf [Feature](executor)Workload Group support Non-Pipeline Execution (#30164) 2024-01-23 10:11:25 +08:00
b3296a2a16 [fix](Nereids) user identify syntax is wrong (#30226) 2024-01-23 10:09:55 +08:00
24ed3e4103 [Fix](Expr&code-style) check prepare&open before every VExpr execute (#26673) 2024-01-23 10:09:54 +08:00
ce47354d59 [fix](Nereids) result nullable of sum distinct in scalar agg is wrong (#30221) 2024-01-23 10:09:54 +08:00
60ce22f15e [fix](auto-partition) Fix a concurrent bug (#30086)
when incremental opening, it may be a mistake to send new packet from sender to reciever cuz' re-constructed send closure.
now fixed it.
2024-01-23 10:09:54 +08:00
d5d0e5e611 [feature](function) support ip functions named to_ipv4[or_default, or_null](string) and to_ipv6[or_default, or_null](string) (#29838) 2024-01-23 10:09:54 +08:00
68e67470c0 [Improvement](doc) add table-buckets doc for flink connector (#29672) 2024-01-23 10:09:54 +08:00
xy
45f6cba837 [fix](Nereids) Fixed a bug where the execution plan was incorrect after ddl (#30107)
should only compare column name when generate data dist info of PhysicalOlapScan

Co-authored-by: xingying01 <xingying01@corp.netease.com>
2024-01-23 10:09:54 +08:00
9b100207d2 [docker](container)create data path after rm residual data avoiding docker start fail (#30141) 2024-01-23 10:09:54 +08:00
1b1e088e83 [fix](exec_node) crashing caused by cancelled query in ExecNode (#30192) 2024-01-23 10:09:54 +08:00
8061597f2a [fix](Nereids) nullable not adjust in output exprs in result sink node (#30206) 2024-01-23 10:09:54 +08:00
5c43708d92 [Fix](Job)Incorrect task query result of insert type (#30024)
- IdToTask has no persistence, so the queried task will be lost once it is restarted.

- The cancel task does not update metadata after being removed from the running task.

- tvf displays an error when some fields in the query task result are empty

- cycle scheduling job should not be STOP when task fail
2024-01-23 10:09:54 +08:00
24c0900b41 [fix](planner) should return outputTupleDesc's id instead of tupleIds if outputTupleDesc is set in Plan Node (#30150) 2024-01-23 10:09:54 +08:00
e5dea910bf [feature](bitwise function) bit_count/bit_shift_left/bit_shift_right implementation (#30046) 2024-01-23 10:09:54 +08:00
cd0ca2b3af [docs](ip function) add ipv4/v6 datatype and some ip functions' docs (#30194) 2024-01-23 10:09:54 +08:00