c27692fb3b
[Enhancement](jdbc catalog) Add security check on driver when creating Jdbc Catalog ( #31153 )
2024-02-21 13:53:40 +08:00
cd7230885f
[fix](nereids)push more than one runtime filters into cte ( #30901 )
...
* push rf into cte, used by tpcds95
2024-02-21 13:53:32 +08:00
1e3968fe7e
[fix](group_commit) Need to wait wal to be deleted when creating MaterializedView ( #30956 )
2024-02-21 13:53:19 +08:00
1d6dc9a5f0
[fix](catalog recycle bin) Forbid recover partition if table schame is changed #31146
2024-02-21 13:53:18 +08:00
0ab8143565
[fix](catalog recycle bin) table partition meta is error if recover partition in some case ( #31125 )
2024-02-21 13:52:10 +08:00
97c9d75af3
[Feature](executor)Add scan_thread_num property for workload group ( #31106 )
2024-02-20 16:24:05 +08:00
9251816673
[fix](Nereids): log constraint editlog in lock scope ( #30630 )
2024-02-20 16:24:05 +08:00
4aaab6fb44
[fix](statistics)Refresh follower FE cache after alter column stats. Support alter index column stats ( #31108 )
...
1. Refresh follower FE cache after alter column stats. So that follower could update the cached stats too.
2. Support alter index column stats.
2024-02-20 16:23:53 +08:00
b69acbf98b
[Improvement](group commit) FE should throw NotFoundException if database or table not exist when loading data ( #31113 )
...
* [Improvement](group commit) FE should throw NotFoundException if database or table not exist when loading data
* edit
2024-02-20 16:23:53 +08:00
24fb24db3e
[refactor](catalog) catalog interface refactor #31047 ( #31135 )
2024-02-20 11:08:50 +08:00
76767f2867
[fix](fe) Fix UnsetVariableStmt write editlog in non master node ( #31080 )
...
* Problem introduced by https://github.com/apache/doris/pull/27552
2024-02-20 09:18:33 +08:00
689b2c7bc5
[fix](s3client) fix unable to access COS ( #31111 )
2024-02-20 09:16:28 +08:00
02bded2688
[Improve](common)Optimize logging performance with LOG.isDebugEnabled() ( #31091 )
...
* [Improve](common)Optimize logging performance with LOG.isDebugEnabled()
* fix error ut
2024-02-20 09:16:14 +08:00
8f70c00a26
[fix](routine-load) add lock to avoid editlog out of order when concurrent update job ( #31095 )
2024-02-20 09:12:38 +08:00
4a33d9820a
[fix](multi-catalog)fix getting ugi methods and unify them ( #30844 )
...
put all ugi login methods to HadoopUGI
2024-02-20 09:12:38 +08:00
d55d796c74
[branch-2.1](multi-table-load) reduce routine load job transaction info storage in memory #31127
2024-02-20 09:08:56 +08:00
3f9b597b6b
[fix](auto-partition) Fix concurrent load same value of auto partition #31107
2024-02-19 18:35:29 +08:00
180fc13f6b
[fix](nereids) disable PushDownJoinOtherCondition rule for mark join ( #31084 )
2024-02-19 17:48:29 +08:00
8a3e6644d4
[fix](udf) fix java-udf coredump as get env return nullptr ( #30986 )
2024-02-19 17:23:24 +08:00
277de979c3
[fix](mysql-channel) initialize mysql serializer by default ( #31083 )
2024-02-19 17:22:03 +08:00
5ac4b6a137
[opt](Nereids) refine group by elimination column prune ( #30953 )
2024-02-19 17:22:03 +08:00
b3ac2128dd
[Refactor](catalog) Refactor Jdbc Catalog external name case mapping rules ( #28414 )
2024-02-19 17:22:03 +08:00
8db2824c44
[bugfix](es catalog) add constant_keyword wildcard data type ( #30947 )
2024-02-19 17:20:21 +08:00
bda2042c78
[enhancement](paimon)add obs filesystem for paimon ( #31061 )
2024-02-19 17:20:21 +08:00
bb91c3a1cf
[enhancement](neredis)add PushDownFilterThroughGenerate rule ( #31057 )
2024-02-19 17:20:21 +08:00
6504f6de74
[pipelineX](bug) Fix ConcurrentModificationException for profile reporting ( #31040 )
2024-02-19 17:20:21 +08:00
3f126fdd63
[fix](repository) fix NullPointerException when execute create repository statement without properties ( #30972 )
...
Co-authored-by: caiconghui1 <caiconghui1@jd.com >
2024-02-19 17:20:21 +08:00
a7037df9a1
[fix](iceberg) iceberg hms support hive1 ( #30985 )
2024-02-19 17:20:21 +08:00
6e4f76de54
[improvement](jdbc catalog) Delete unnecessary schema and optimize insert logic ( #30880 )
...
In the previous design, we were compatible with MySQL's auto-increment column and default value to bypass the null value check when writing back Jdbc External Table. However, because MySQL's default value is not completely unified with Doris, this resulted in The unsuitable default value is wrong. In response to this situation, I made the following optimizations
1. For JDBC External Table, we always allow certain columns to be missing during insertion. Even if these columns are not allowed to be empty at the source end, the error should be generated by the source end, not Doris herself.
2. When the target column is non-nullable and the insertion is done via `INSERT INTO tbl VALUES()` or `INSERT INTO tbl SELECT constants`, Doris should verify any inconsistency between them and throw an exception. This check is not applied for `INSERT INTO tbl SELECT ... FROM tbl` operations.
2024-02-19 17:20:21 +08:00
d66559f693
[bugfix](sessionVariable) Fix sessionVariable has sessionOriginValue property, and execute cloneSessionVariable method will throw java.io.NotSerializableException: java.lang.reflect.Field ( #31029 )
2024-02-18 14:45:25 +08:00
6cf7468073
[enhancement](function) change some function nullable mode ( #30991 )
...
change some function nullable mode
2024-02-18 14:45:25 +08:00
68102fd531
[Fix](auto-partition) fix a concurrent bug of extremely long values ( #31005 )
2024-02-18 14:45:25 +08:00
753ff10840
[bugfix](export command) Export exceptions when use legacy optimizer ( #31020 )
2024-02-18 14:45:25 +08:00
33aaacf2fa
[Bug] (plsql) procedure call to a non existing procedure, returning success ( #31019 )
...
Issue Number: close. #31018
state was set OK even in failure case. changed it.
2024-02-18 11:50:17 +08:00
d70776af55
[feature](agg-func) support covar and covar_samp function ( #30983 )
2024-02-18 11:50:17 +08:00
1d596018c8
[enhance](iceberg)upgrade iceberg to 1.4.3 ( #30799 )
2024-02-18 11:50:17 +08:00
5417bb4db0
[Enhancement](auto-inc) Show create table support auto inc init value ( #31021 )
2024-02-18 11:50:16 +08:00
ea4ad111a8
[fix](dynamic partition) fix create too many dynamic partitions ( #30994 )
2024-02-18 11:50:16 +08:00
cc727cfc32
[refactor](catalog) move some package related to catalog ( #31022 )
...
Move some package and files related to multi-catalog.
No logic is changed.
2024-02-18 11:50:16 +08:00
45b4189bb6
[Refactor](opt) Opt rf and remove unless code ( #30900 )
...
Opt rf and remove unless code
2024-02-18 11:50:16 +08:00
37d64389b9
[Improve](Job)Return directly when the job status does not need to change ( #31028 )
2024-02-18 11:50:16 +08:00
e68019c10a
[Function](Exec) Support windows function cume_dist ( #30997 )
2024-02-16 10:16:40 +08:00
f65844fae4
[Enhencement](Outfile/Export) Export data to csv file format with BOM ( #30533 )
...
The UTF8 format of the Windows system has BOM.
We add a new user property to `Outfile/Export`。Therefore, when exporting Doris data, users can choose whether to bring BOM on the beginning of the CSV file.
**Usage:**
```sql
-- outfile:
select * from demo.student
into outfile "file:///xxx/export/exp_"
format as csv
properties(
"column_separator" = ",",
"with_bom" = "true"
);
-- Export:
EXPORT TABLE student TO "file:///xx/tmpdata/export/exp_"
PROPERTIES(
"format" = "csv",
"with_bom" = "true"
);
```
2024-02-16 10:16:40 +08:00
ce892d04e5
[feature](index) Replace BITMAP INDEX with INVERTED INDEX ( #30950 )
2024-02-16 10:16:40 +08:00
24e80b23a5
[Feature](executor)Support ShowProcessStmt Show all Fe connection ( #30907 )
2024-02-16 10:16:39 +08:00
40e1326bc9
[feature](window-func) support percent_rank window function ( #30926 )
2024-02-16 10:12:25 +08:00
448fb70f68
[fix](nereids) collect all correlated slots from subquery in correct way ( #30908 )
2024-02-16 10:12:25 +08:00
cef31f6709
[feat](fe) Show db total size and recycle bin size with ShowDataStmt ( #30663 )
2024-02-16 10:12:25 +08:00
3e07167897
[enhancement](mysql-channel) avoid potential buffer overflow when flushing send buffer occurs IOE ( #30868 )
2024-02-16 10:12:25 +08:00
08c196f3dc
[enhancement](stmt-forward) record query result for proxy query to avoid EOF ( #30536 )
2024-02-16 10:12:25 +08:00
