Commit Graph

175 Commits

Author SHA1 Message Date
194f3432ab [Improvement](executor)Routine load support workload group #31671 2024-03-12 14:20:18 +08:00
1d094a46ec [regression-test](pipeline) remove sys_log_verbose_modules in pipeline #32015 2024-03-09 19:55:47 +08:00
794d9405de [ci](jdk17) adjust fe.conf (#31683) 2024-03-02 01:08:51 +08:00
07224686ef [feature](jdbc catalog) support db2 jdbc catalog (#31627) 2024-03-01 14:19:28 +08:00
1316ee4942 Add p1 debug log (#31560) 2024-02-29 12:38:03 +08:00
cffe79feba open workload group for broker load regression test (#30797) 2024-02-05 22:00:26 +08:00
d32292b292 [regression-test][conf] add master_sync_policy = WRITE_NO_SYNC replica_sync_policy = WRITE_NO_SYNC (#30494)
There is no power off scene in regression-test, so add these two configure has no side-effect.
2024-02-04 22:21:16 +08:00
2ca911fb5d [revert](move-memtable) Revert enable brpc debug log in regression pipelines (#30389) (#30611)
This reverts commit 4bf47e229f930714572d8f91d6f9e94b4608bd20.
2024-02-02 13:31:47 +08:00
f0eeb45355 [chore](ci) trigger a must success pipeline (#30711)
Co-authored-by: stephen <hello-stephen@qq.com>
2024-02-01 23:14:14 +08:00
ea427e8c51 [fix](JDK17) It will report an exception whenwe start BE with JDK17 and query AVRO table : InaccessibleObjectException (#30541)
* [fix](JDK17) It will report an exception whenwe start BE with JDK17 and query AVRO  table : InaccessibleObjectException (#30003)
2024-01-30 15:33:40 +08:00
904182685b [debug](move-memtable) enable brpc debug log in regression pipelines (#30389) 2024-01-27 09:10:41 +08:00
1aa006c80f [fix](ci) add single quote to the value of the session variables when setting it (#30295)
Co-authored-by: stephen <hello-stephen@qq.com>
2024-01-25 13:24:09 +08:00
8c6e5202d4 [chore](ci) remove some unused code (#30253)
Co-authored-by: stephen <hello-stephen@qq.com>
2024-01-24 09:58:31 +08:00
ec898f2677 Revert "[ci](perf) add required (#30155)" (#30165)
This reverts commit f9c274c338afbe14f97cc16d1327e9a548e524b3.
2024-01-23 10:07:51 +08:00
7cc85f893c [ci](perf) add required (#30155)
Co-authored-by: stephen <hello-stephen@qq.com>
2024-01-23 10:07:10 +08:00
990d5d8664 [cleanup](insert-into) clean up some insert into log (#30063) 2024-01-18 12:03:07 +08:00
44ba9e102c [feature](statistics)support statistics for iceberg/paimon/hudi table (#29868) 2024-01-18 12:03:07 +08:00
d3bf23d70d [chore](removelogs) remove debug query timeout logs (#30006)
---------

Co-authored-by: yiguolei <yiguolei@gmail.com>
2024-01-16 18:48:18 +08:00
2bf8c51baa [test](regression) Add debug level log of editlog for p0 p1 (#29992) 2024-01-16 18:42:09 +08:00
615d94bbc7 [log](insertadd log in parse insert into values data (#29903) 2024-01-16 18:35:32 +08:00
89995402dd [regression](conf) enable load_stream_fault_injection (#29829)
Co-authored-by: Yongqiang YANG <98214048+dataroaring@users.noreply.github.com>
2024-01-12 13:58:19 +08:00
42c21f7eda [regression](conf) enable test_stream_stub_fault_injection (#29830) 2024-01-12 13:58:19 +08:00
f94ff21eef [ci](perf) adjust threshold (#29856)
Co-authored-by: stephen <hello-stephen@qq.com>
2024-01-12 13:58:19 +08:00
542cfb37b0 [ci](perf) adjust performance pipeline (#29622)
remove old tpch trigger
branch-2.0 also run performance
2024-01-12 11:52:47 +08:00
d531111922 [test](regression-test) forbid test_index_failure_injection (#29741) 2024-01-12 11:46:29 +08:00
94ebf9d7f6 [test](regression-test) forbid test_load_stream_stub_failure_injection #29728 2024-01-12 11:46:29 +08:00
0ae449f732 [ci](perf) integration clickbench test into new performance pipeline (#29429) 2024-01-05 22:29:02 +08:00
6ae2a11d07 [ci](case) exclude case test_dump_image (#29539) 2024-01-04 17:58:33 +08:00
bd8113f424 [bugfix](scannerscheduler) should minus num_of_scanners before check should schedule #28926 (#29331)
---------

Co-authored-by: yiguolei <yiguolei@gmail.com>
2024-01-03 20:47:35 +08:00
b2a28fcfaa [fix](ci) exclude case load_stream_fault_injection (#29465) 2024-01-03 16:02:15 +08:00
5bc72bda78 [improve](move-memtable) add fault injection in writer v2 (#29177) 2023-12-30 01:32:26 +08:00
02b27c1673 [ci](trigger) support "run performance" (#29259)
* [ci](trigger) support "run performance"
Co-authored-by: stephen <hello-stephen@qq.com>
2023-12-29 14:21:23 +08:00
61677d1d4b [ci](perf) 1. add perf check of tpcds, 2. adjust clickbench and tpch check (#28431) 2023-12-29 09:26:15 +08:00
fc6a587352 [test](Nereids) add subquery pull up rule group ut (#26725)
add subquery pull up rule group ut:
single table part
(1) subquery_basic_pullup_basic: basic part
(2) subquery_basic_pullup_uk: using unique key
(3) subquery_basic_pullup_and: with and
(4) subquery_basic_pullup_or: with or
(5) subquery_basic_pullup_and_subquery: with and subquery
(6) subquery_basic_pullup_or_subquery: with or subquery

multi table part
(1) subquery_multitable_pullup_basic: basic part
(2) subquery_multitable_pullup_and: with and
(3) subquery_multitable_pullup_or: with or
(4) subquery_multitable_pullup_and_subquery: with and subquery
(5) subquery_multitable_pullup_or_subquery: with or subquery

top op related, such as group by/having, order by, win func, select list:
(1) subquery_topop_pullup_groupby: group by
(2) subquery_topop_pullup_having: having
(3) subquery_topop_pullup_orderby: order by
(4) subquery_topop_pullup_winfunc: window function
(5) subquery_topop_pullup_selectlist: select list

misc, such as group by correlated, view, dml, etc:
(1) subquery_misc_pullup_misc: group by correlated, view, etc
(2) subquery_misc_pullup_dml: insert/update/delete
2023-12-27 14:03:53 +08:00
37faf1bb80 [fix](ci) tpch pipeline should not re-load data (#28874)
* [fix](ci) tpch pipeline should not re-load data

* 2

---------

Co-authored-by: stephen <hello-stephen@qq.com>
2023-12-22 19:50:41 +08:00
74c0a3060f [feature](jdk) Using G1 as defaut garbage colletor in FE (#28263) 2023-12-16 22:40:11 +08:00
920c75c870 [fix](ci)tpch pipeline add check (#28370)
Co-authored-by: stephen <hello-stephen@qq.com>
2023-12-16 11:11:28 +08:00
c08ab9edc7 [feature](HiveCatalog) Support for getting hive meta data from relational databases under HMS (#28188) 2023-12-14 17:50:17 +08:00
9372959410 Revert "[regression-test](case) forbid group commit case first #28244" (#28250)
This reverts commit ad483efca50f2ecb3fc88bd7dab8b1bc46e7f2e7.
2023-12-13 01:12:11 +08:00
ad483efca5 [regression-test](case) forbid group commit case first #28244 2023-12-11 16:06:59 +08:00
59ec3da899 open workload group in PR pipeline (#27744) 2023-12-08 11:56:03 +08:00
3868926088 [fix](ci) pass PULL_REQUEST_NUM while trigger new build (#28065)
Co-authored-by: stephen <hello-stephen@qq.com>
2023-12-06 20:42:53 +08:00
e695cb18b1 [improvement](regression test) add fe debug point (#28047) 2023-12-06 18:18:05 +08:00
cbf1f8620a [Feature](job)support cancel task and fix log invalid (#27703)
- Running task can be show and fix cancel fail
- When the insert task scheduling cycle is reached, if there are still tasks running, the scheduling of this task will be canceled at this time.
- refactor job status changes SQL
- Fix timer job window error
- Support cancel task
2023-12-06 10:44:09 +08:00
4c9bf98dcd [config](p0) Pipeline p0 open arrow_flight_sql_port #27945 2023-12-04 19:24:15 +08:00
6fdaf2da6f [fix](ci) 1. if skip compile then skip p0 p1 external pipelinex_p0 also, (#27469)
1. if skip compile then skip p0 p1 external pipelinex_p0 also
2. if change files too many, export all_files may cause problem of 'Argument list too long', change to use file
Co-authored-by: stephen <hello-stephen@qq.com>
2023-11-23 18:11:29 +08:00
c332811721 [fix](ci) fix bug of new trigger (#27379)
* [fix](ci) fix bug of new trigger
Co-authored-by: stephen <hello-stephen@qq.com>
2023-11-22 10:35:39 +08:00
34f500ac2a [github](action) optimize trigger teamcity pipeline (#27257)
optimize triiger teamcity pipeline
2023-11-22 09:34:47 +08:00
718ba41cd1 [Enhance](regression) skip case test_information_schema_external (#27056) 2023-11-15 20:29:46 +08:00
8e32b5fb6f [regression](conf) Make checkpoint/clean thread trigger more frequent (#26883)
* When run p0, we want some checkpoint/clean thread in FE work more
  frequently
2023-11-13 21:56:10 +08:00