1c025c0488
[docker](hive) add hive3 docker compose and modify scripts ( #33115 )
...
add hive3 docker compose from:
big-data-europe/docker-hive#56
2024-04-17 23:42:13 +08:00
87e6c94851
[docker](script)add --grace to be_prestop.sh ( #33599 )
2024-04-17 23:42:12 +08:00
cc103920d1
[k8s](improve)add docker resource script for k8s ( #33329 )
2024-04-17 23:42:00 +08:00
8c66915bb5
[fix](doris compose) Fix not show ms recycler .out log in cloud mode ( #33489 )
2024-04-12 15:09:25 +08:00
4963d60a07
[Fix](multi-catalog)Fix the issue of not initializing the writer caused by refactoring and add hive writing regression test. ( #32721 ) ( #33446 )
...
backport #32721 .
2024-04-10 11:42:22 +08:00
c35b2becdd
[fix][docker] fix kafka test scritps ( #33417 )
...
Co-authored-by: 胥剑旭 <xujianxu@xujianxudeMacBook-Pro.local >
2024-04-09 16:11:09 +08:00
2c87238504
[enhance](S3) Print the oss request id for each error s3 request ( #32491 )
2024-03-21 14:07:50 +08:00
73de61ed84
[opt](hive) skip hidden file and dir ( #32412 )
...
When query hive table, we should skip all hidden dirs and files, like:
```
/visible/.hidden/path
/visible/.hidden.txt
```
2024-03-21 14:07:24 +08:00
a937c54b2b
[fix](docker)Fix the registration logic of Doris On Docker ( #32026 )
...
* Refactor upgrade documentation
* fix docker be entry point shell
---------
Co-authored-by: Yijia Su <suyijia@selectdb.com >
2024-03-12 14:20:18 +08:00
2ee12b8678
[improvement](docker)Optimize Dockerfile content for FE and BE ( #32027 )
...
* Refactor upgrade documentation
* Optimize Dockerfile content for FE and BE.
* Optimize Dockerfile content for FE and BE.
---------
Co-authored-by: Yijia Su <suyijia@selectdb.com >
2024-03-12 14:20:18 +08:00
926908ece2
[fix](hive) fix spelling mistakes for "separatorChar" #32061
2024-03-12 14:20:18 +08:00
1509fbd538
[feature](docker)Doris On Docker All In One ( #31735 )
...
* Refactor upgrade documentation
* Doris On Docker All In One
---------
Co-authored-by: Yijia Su <suyijia@selectdb.com >
2024-03-12 14:19:14 +08:00
d276610694
[deps](docker) update docker build env to add jdk17 ( #31644 )
2024-03-07 16:16:05 +08:00
649f04e17c
Revert "[feature](doris compose) doris compose use jdk 17 image ( #31775 )"
...
This reverts commit 9d2e5f1c00bd04277b492df979b367e1184c09de.
2024-03-06 13:13:26 +08:00
2e9bd268cd
[improvement](jdbc catalog) support sqlserver timestamp type read ( #31805 )
2024-03-06 13:08:04 +08:00
9d2e5f1c00
[feature](doris compose) doris compose use jdk 17 image ( #31775 )
2024-03-06 13:07:49 +08:00
248ea20901
Revert "[test](regression) add regression test for schange change of complex …" ( #31660 )
...
This reverts commit dcd2afdb4e857791fed66a46f28ab3adc25494e1.
Reverts #31207
2024-03-01 19:06:59 +08:00
07224686ef
[feature](jdbc catalog) support db2 jdbc catalog ( #31627 )
2024-03-01 14:19:28 +08:00
5276cc4db6
[docker][fix] update routine load cases ( #31553 )
...
Co-authored-by: 胥剑旭 <xujianxu@xujianxudeMacBook-Pro.local >
2024-02-29 16:44:39 +08:00
3c37fb085c
[refactor](jdbc catalog) split jdbc executor for different data sources (step-1) ( #31406 )
2024-02-29 12:38:03 +08:00
22b6434054
[feature](doris compose) Add create cloud cluster ( #31315 )
2024-02-27 10:12:19 +08:00
e3b4b83bca
[test](regression) add regression test for schange change of complex type ( #31207 )
...
Add regression test for #31128
2024-02-22 19:50:07 +08:00
b3ac2128dd
[Refactor](catalog) Refactor Jdbc Catalog external name case mapping rules ( #28414 )
2024-02-19 17:22:03 +08:00
8db2824c44
[bugfix](es catalog) add constant_keyword wildcard data type ( #30947 )
2024-02-19 17:20:21 +08:00
92cad69fc4
[Fix](parquet-reader) Fix reading fixed length byte array decimal in parquet reader. ( #30535 )
2024-01-31 23:53:40 +08:00
658c869aac
[improvement](mtmv)mtmv support partition by hms table ( #29989 )
2024-01-29 19:02:46 +08:00
9b100207d2
[docker](container)create data path after rm residual data avoiding docker start fail ( #30141 )
2024-01-23 10:09:54 +08:00
fac0580eae
[opt](docker)optimize ES docker compose ( #30068 )
...
1. add volume for es logs
2. optimize health check, waiting for es status to be green
3. fix es6 valume path error
4. optimize disk watermark to avoid es disk watermark error
5. fix es6 create index error
6. add custom elasticsearch.yml for es6
7. add log4j2.properties for es6, es7, es8
2024-01-19 15:48:56 +08:00
44ba9e102c
[feature](statistics)support statistics for iceberg/paimon/hudi table ( #29868 )
2024-01-18 12:03:07 +08:00
5d0732fcf4
[typo](docker thirdparties) Modify script prompt information error ( #29770 )
2024-01-12 11:53:57 +08:00
67986a8a6f
[fix](case) external case, specify networks ( #29699 )
...
Co-authored-by: stephen <hello-stephen@qq.com >
2024-01-12 11:46:29 +08:00
3cd1c7745a
[fix](jdbc catalog) Fix the precision of decimal type mapping to 0 ( #29407 )
2024-01-12 11:39:57 +08:00
3f988e1b7f
[improvement](doris compose) regression test auto install doris compose requirements ( #29012 )
2024-01-06 20:20:38 +08:00
2c4e52e44e
[fix](es catalog) only es_query function can push down to ES ( #29320 )
...
Issue Number: close #29318
1. Only push down `es_query` function to ES
2. Add null check where ES query result not have `_source` or `fields` fields.
2023-12-30 09:33:26 +08:00
24cdc00b60
[improvement](doris compose) avoid docker network conflict ( #28957 )
2023-12-29 15:05:28 +08:00
7da86c37ec
[fix](hive) add support for quoteChar and seperatorChar for hive ( #28613 )
...
add support for quoteChar and seperatorChar .
2023-12-19 19:35:03 +08:00
27a3884060
[refactor](docker)Dockerfile shell refactor ( #27569 )
2023-12-16 23:45:06 +08:00
608baae001
[docker][regregression]update routine load cases #28450
...
Co-authored-by: 胥剑旭 <xujianxu@xujianxudeMacBook-Pro.local >
2023-12-16 17:57:39 +08:00
01c94a554d
[fix](autoinc) Fix broker load when target table has autoinc column ( #28402 )
2023-12-14 18:02:54 +08:00
a271fee3c5
[test](statistics)Add external empty table test case. ( #28267 )
2023-12-13 21:48:01 +08:00
bb4c192a57
[improvement](doris compose) show all cluster ( #28288 )
2023-12-13 01:35:41 +08:00
0282baaf56
[typo](docker) add logs console ( #27570 )
...
doris 2.0.2+ need use start_xx.sh --console
2023-12-06 20:50:09 +08:00
60bc3be8a2
[Opt](Compression) Opt zstd block decompression by ZSTD_decompressDCtx(). ( #27534 )
...
Opt zstd block decompression by `ZSTD_decompressDCtx()` to replace streaming decompression.
It will improve performance but consume more memory.
Test result:
- env: 1 node(16 cores, 64G).
- parquet column: 100 million rows of char(255) column.
- result: 5.2 -> 4.6.
2023-12-01 09:10:32 +08:00
e4149c6e4c
[Fix](parquet-reader) Fix null map issue in parquet reader. ( #27777 )
...
Fix null map issue in parquet reader which cause result incorrect such as `min()`, `max()`.
In order to share null map between parquet converted src column and dst column to avoid copying. It is very tricky that will call mutable function `doris_nullable_column->get_null_map_column_ptr()` which will set `_need_update_has_null = true`. Because some operations such as agg will call `has_null()` to set `_need_update_has_null = false`.
2023-11-30 13:55:37 +08:00
cc395f5428
[Fix](hive-transactional-table) Fix NPE when query empty hive transactional table. ( #27563 )
2023-11-25 10:29:39 +08:00
78203c8b7a
[chore](docker cases): support for specifying output from the command line ( #27340 )
2023-11-23 19:36:43 +08:00
1441387e5b
[improvement](doris compose) improve start be container speed ( #27368 )
2023-11-22 11:04:04 +08:00
b477839bce
[enhancement](jdbc catalog) Add lowercase column name mapping to Jdbc data source & optimize database and table mapping ( #27124 )
...
This PR adds the processing of lowercase Column names in Oracle Jdbc Catalog. In the previous behavior, we changed all Oracle columns to uppercase queries by default, but could not handle the lowercase case. This PR can solve this situation and improve All Jdbc Catalog works
2023-11-17 23:51:47 +08:00
df867a1531
[fix](catalog) Fix ClickHouse DataTime64 precision parsing ( #26977 )
2023-11-15 10:23:21 +08:00
1edeacd0a5
[enhance](regression) enhance docker network by add network subnet ( #26862 )
2023-11-14 20:06:20 +08:00
