b0e0a0569a
[Fix](row store) Real default value should be used instead of default… ( #25230 )
...
Before this PR the default value is not correct, we should use default value in Frontend schema.
2023-10-18 10:13:44 +08:00
18c2a13e09
[fix](multi-catalog)fix maxcompute partition filter and session creation ( #24911 )
...
add maxcompute partition support
fix maxcompute partition filter
modify maxcompute session create method
2023-10-17 22:36:10 +08:00
f1a5e393c7
[feature](insert) Support group commit insert use new syntax like insert into table_id(xxx) ( #25484 )
2023-10-17 09:23:09 +08:00
59ebbb351e
[feature](merge-cloud) Enable write into cache when uploading file to s3 using s3 file writer ( #24364 )
2023-10-16 21:31:02 +08:00
7ea456ef91
[fix](insert) make group commit wal_manager exit elegantly ( #25250 )
2023-10-14 23:14:06 +08:00
e5ef0aa6d4
[refactor](mysql result format) use new serde framework to tuple convert ( #25006 )
2023-10-14 19:46:42 +08:00
2ec53ff60e
[fix](multi-table) fix single stream multi table load can not finish ( #25379 )
2023-10-13 15:47:16 +08:00
1073ef22f3
[fix](insert) improve group_commit related tests ( #25319 )
2023-10-12 21:19:29 +08:00
022762d5f0
[fix](memory) Fix work load group GC and add logs to locate slow GC #24975
...
Fix work load group GC, add cancel load and add logs.
Unify the format and change all to lowercase of GC logs, avoid unnecessary trouble when grep or less
Add logs to help locate the cause of slow GC.
2023-10-12 10:33:56 +08:00
73f632a4e3
[fix](move-memtable) handle error in LoadStreamWriter::close ( #24805 )
2023-10-11 16:54:42 +08:00
bb670118f5
[coverage](test) Delete unused function to improve test coverage ( #25233 )
2023-10-11 11:50:51 +08:00
880d0d7e70
[Bug](pipeline) Support the auto partition in pipeline load ( #25176 )
2023-10-10 11:51:12 +08:00
4de3df6a46
[refactor](column) remove unused method and column definitions ( #25152 )
...
remove unused method and column definitions
using primitive type in predicate column to check datev1 and datev2
2023-10-09 17:14:35 +08:00
9d8b993c51
[fix](fs) fix remove error log failed ( #25108 )
2023-10-08 22:15:37 +08:00
6fe060b79e
[fix](streamload) fix http_stream retry mechanism ( #24978 )
...
If a failure occurs, doris may retry. Due to ctx->is_read_schema is a global variable that has not been reset in a timely manner, which may cause exceptions.
---------
Co-authored-by: yiguolei <676222867@qq.com >
2023-10-08 11:16:21 +08:00
8953179c11
[fix](multi-table) fix multi table task cannot end ( #25056 )
...
When exec multi table task, it can not end when exec plan error, which causes other routine load task can not submit.
2023-10-07 19:45:42 +08:00
59261174d5
[chore](unused) Remove unused variable CPU_HARD_LIMIT in task_group.cc ( #25076 )
...
Signed-off-by: Jack Drogon <jack.xsuperman@gmail.com >
2023-10-07 03:36:13 -05:00
7b2ff38401
query cpu hard limit based on doris scheduler ( #24844 )
2023-10-07 12:03:07 +08:00
4ce5213b1c
[fix](insert) Fix test_group_commit_stream_load and add more regression in test_group_commit_http_stream ( #24954 )
2023-10-03 20:56:24 +08:00
642e5cdb69
[Fix](Status) Make Status [[nodiscard]] and handle returned Status correctly ( #23395 )
2023-09-29 22:38:52 +08:00
864a0f9bcb
[opt](pipeline) Make pipeline fragment context send_report asynchronized ( #23142 )
2023-09-28 17:55:53 +08:00
1b0e3246ea
[pipelineX](fix) Fix exception reporting and Nereids plan ( #24936 )
2023-09-27 13:15:40 +08:00
55d1090137
[feature](insert) Support group commit stream load ( #24304 )
2023-09-26 20:57:02 +08:00
082bcd820b
[feature](insert) Support wal for group commit insert ( #23053 )
2023-09-26 14:46:24 +08:00
8d4fd76a16
[Feature](StreamLoad2PC) Support commit and abort streamload2PC by label ( #24613 )
2023-09-25 22:21:27 +08:00
6502da8917
[bugfix](restore) add partition id into convert_rowset_ids() ( #24834 )
2023-09-25 20:07:24 +08:00
c346f4d638
[Improvement](Storage) Lazy init mini_download dir ( #24649 )
2023-09-22 16:23:26 +08:00
c9b2f4cb92
[workload](pipeline) Add cgroup cpu controller ( #24052 )
2023-09-21 21:49:33 +08:00
8eb14eec7c
[enhancement](baddisk) record bad disk in be_custom.conf to handle ( #24639 )
2023-09-21 18:31:58 +08:00
85fb46bb71
[refactor](cache) Refactor preloaded timezone global cache ( #24694 )
...
Refactor preloaded timezone global cache
2023-09-21 17:26:41 +08:00
b9997d69fa
[refactor](pipelineX) return error when local_state can not find id ( #24360 )
2023-09-21 16:04:08 +08:00
f2f591e280
[fix](memory) Optimize memory exceed limit logs ( #22655 )
...
After memory exceeds the limit, print the top 15 task trackers with the largest memory.
After memory exceeds the limit, more detailed GC logs in stages.
fix large memory check.
2023-09-21 10:38:17 +08:00
d62b59b620
[pipelineX](profile) Complete load profile ( #24690 )
2023-09-21 09:57:34 +08:00
3650d870d4
[fix](spill) avoid printing too much status stack trace if gc dir does not exist ( #24688 )
2023-09-21 08:24:59 +08:00
8c8c563c3c
[Chore](status) adjust some error status print log ( #24660 )
...
adjust some error status print log
2023-09-20 17:42:51 +08:00
dc9fa1a4f1
[Refactor](Sink) convert to tablet sink to tablet writer ( #24474 )
2023-09-20 14:47:18 +08:00
fc12362a6d
[feature-wip](arrow-flight)(step2) FE support Arrow Flight server ( #24314 )
...
This is a POC, the design documentation will be updated soon
2023-09-20 14:42:54 +08:00
8aea31e383
[fix](timezone) fix timezone parse when there is no tzfile ( #24578 )
2023-09-20 14:28:12 +08:00
e54c4ef258
[pipelineX](dependency) refactor write dependency ( #24555 )
2023-09-19 18:01:42 +08:00
b9ddcbf729
[feature](merge-cloud) Rewrite code related to IOContext ( #24269 )
2023-09-15 19:57:58 +08:00
d24f3efd4a
[pipelineX](profile) Phase 1: refactor pipelineX detailed profile ( #24322 )
2023-09-15 16:14:05 +08:00
9c681692bd
Revert "[fix] fix http_stream retry mechanism ( #23969 )" ( #24407 )
...
This reverts commit 05e365ea137eb8c92b8e7eedc7d1435e83f065ae.
2023-09-15 10:07:53 +08:00
05e365ea13
[fix] fix http_stream retry mechanism ( #23969 )
...
Co-authored-by: yiguolei <676222867@qq.com >
2023-09-14 21:41:11 +08:00
35c5d71549
[Improvement](join) some improvement of hash join ( #23972 )
...
some improvement of hash join
2023-09-14 17:55:35 +08:00
d8feca2530
[Enhancement]The page cache can be parameterized by the session variable of fe. ( #23981 )
2023-09-14 14:28:19 +08:00
1ef22d7f7c
[Feature](variant) add variant type ( #24170 )
...
Add variant type for metadata Add persistent information for variant, including the path of variant sub-columns, persisting them to the segment footer and tablet schema of the rowset.
2023-09-14 14:21:53 +08:00
ccfc912ec0
[Fix](merge-on-write) Check the returned filtered rows from different replicas ( #24191 )
2023-09-13 16:03:17 +08:00
563c3f75ff
[feature](move-memtable) share delta writer v2 among sinks ( #24066 )
2023-09-13 14:39:29 +08:00
c7ae2a7d22
[Refactor & Bugfix](static variables) move some static vairables to exec_env ( #24029 )
2023-09-13 09:27:03 +08:00
d3f1388717
[Feature](partitions) Support auto-partition ( #24153 )
...
Co-authored-by: zhangstar333 <2561612514@qq.com >
2023-09-12 15:23:15 +08:00
