Commit Graph

68 Commits

Author SHA1 Message Date
b4e818c3e7 [CP] move compression format into csv format 2024-10-08 17:46:07 +00:00
fdd96032d6 [FEAT MERGE] Support tenant-level global control direct load data
Co-authored-by: fforkboat <fforkboat@gmail.com>
2024-09-29 06:16:11 +00:00
79e7eefa2e fix make_handle null 2024-09-27 18:15:52 +00:00
815b69bd02 ddl defult use compression algorithm from table schema in temp file store 2024-09-18 07:29:45 +00:00
a90a362952 remove lob_ddl_mysql case in ss mode 2024-08-31 12:52:27 +00:00
058c8edbae fix direct load coordinator write lock contention 2024-08-23 10:47:18 +00:00
c3a9346bd5 [FEAT MERGE]Support insert overwrite partition 2024-08-23 06:38:15 +00:00
32c124797e load data ignore first n lines of each file 2024-08-20 07:47:07 +00:00
0386a03a83 fix memory leak in load data 2024-08-16 07:48:12 +00:00
995d01af9b direct load support specifying any number of columns and column order 2024-08-14 09:18:38 +00:00
66938d14e8 fix load data file reader memory leak 2024-08-12 09:41:53 +00:00
440efc6889 [FEAT MERGE] load data support compress file
Co-authored-by: ant-ob-hengtang <zj458684356@gmail.com>
2024-08-01 15:03:24 +00:00
4eec8a8049 fix table level online_estimate_percent not work 2024-07-12 11:01:09 +00:00
9760ffd780 read ONLINE_ESTIMATE_PERCENT in direct load 2024-07-11 04:17:18 +00:00
d6ec2ffac9 fix config online_estimate_percent not work in remote plan 2024-07-09 14:37:46 +00:00
c15c9d4f79 [FEAT MERGE] patch feature 'direct load from backup data' to 432 2024-07-02 12:43:47 +00:00
1f2f6669a5 [FEAT MERGE] inc direct load phase2
Co-authored-by: suz-yang <suz.yang@foxmail.com>
Co-authored-by: fkuner <784819644@qq.com>
Co-authored-by: shadowao <aozeliu@qq.com>
2024-06-19 09:19:57 +00:00
ca53fe797d [FEAT MERGE] merge table insert overwrite 2024-06-18 02:35:50 +00:00
d04aec2793 Direct load open compress 2024-06-18 02:06:44 +00:00
b859aea8d6 [CP] fix concurrency of direct load and ddl 2024-06-17 14:14:59 +00:00
9de65fb1d7 [FEAT MERGE] incremental direct load phase I
Co-authored-by: Monk-Liu <1152761042@qq.com>
Co-authored-by: suz-yang <suz.yang@foxmail.com>
Co-authored-by: ZenoWang <wzybuaasoft@163.com>
2024-04-22 09:23:47 +00:00
bf604885f8 [FEAT MERGE]
Co-authored-by: leftgeek <1094669802@qq.com>
Co-authored-by: coolfishchen <coolfishchen@gmail.com>
Co-authored-by: hy-guo <fqboyg@gmail.com>
2024-04-19 06:46:37 +00:00
56d8a2b1ee [CP] Limit the number of files 2024-04-18 04:09:52 +00:00
3aff0d6be3 [FEAT MERGE] resource manage patch to direct_load_res_patch431
Co-authored-by: coolfishchen <coolfishchen@gmail.com>
2024-04-16 15:43:57 +00:00
8cf87984db Direct load memory split tenant. 2024-02-28 03:14:58 +00:00
a2113b1923 Fix direct load use dirty phy_plan 2024-02-10 03:33:26 +00:00
68d387893f Fix direct load query timeout 2024-02-09 13:59:10 +00:00
d9d136275c BUG: loading multi empty files failed 2024-02-08 18:31:05 +00:00
2597a75601 [CP] Fix direct load use non-thread-safe allocator to concurrent allocate memory 2024-02-07 23:48:13 +00:00
acd0ec6efd [FEAT MERGE] load local files 2024-02-07 20:25:14 +00:00
15307ef94e [FEAT MERGE][CP]optimizer stats enhancement 2024-02-07 16:56:28 +00:00
c8ef409bf3 Do not report ERROR when sample rate equals 100 2024-02-06 14:49:36 +00:00
e38f8445cc Fix direct load use dirty phy_plan 2024-01-29 14:11:44 +00:00
e8d0e454bf Fix direct load query timeout 2024-01-17 08:12:26 +00:00
02038a911a BUG: loading multi empty files failed 2024-01-02 07:13:21 +00:00
5b29a5c589 [CP] Fix direct load use non-thread-safe allocator to concurrent allocate memory 2023-12-18 19:52:29 +00:00
4d4732b7c7 [FEAT MERGE] load local files 2023-12-14 04:13:25 +00:00
618ab67eb0 [FEAT MERGE][CP]optimizer stats enhancement
Co-authored-by: 2149 <260391947@qq.com>
2023-12-12 10:17:50 +00:00
e78091d50f revert sql statistics
Co-authored-by: yongshige <598633031@qq.com>
2023-11-08 08:12:40 +00:00
f1d9377aad change sql_statistics collect mode 2023-11-01 10:09:08 +00:00
c9753f2968 license opt: Identify external and internal code and modify their open source licenses correctly. 2023-10-23 03:43:44 +00:00
c485d510b7 direct load replace sematics bug 2023-09-28 04:09:59 +00:00
36b219a97f Add log_user_error for direct_load 2023-09-18 07:44:15 +00:00
ef9887b33b fix compact bug 2023-08-14 07:12:41 +00:00
a1fa978f84 support strict replace 2023-08-08 05:12:15 +00:00
5e15f1b92a rename table load thread name
Co-authored-by: suz-yang <suz.yang@foxmail.com>
2023-07-13 14:48:12 +00:00
5ac2af6588 implement ob_table_load_shared_allocator with ob_table_load_handle 2023-07-13 10:24:18 +00:00
8bbe380820 Add direct load client service 2023-07-12 14:42:12 +00:00
e269245733 [CP] add error code when alloc memory failed 2023-07-11 18:48:08 +00:00
81cbd7e0fc Set the max num of direct load thread to 2 * cpu 2023-06-30 02:53:41 +00:00