334260dff7
[feature](function) support ip function ipv4stringtonum(ordefault, ornull), inet_aton ( #25510 )
2023-11-17 10:27:07 +08:00
6183b298e1
[refactor](data_type) remove some unused functions ( #26966 )
2023-11-15 09:23:53 +08:00
de6ecd2035
[fix](tls) Manually track memory in Allocator instead of mem hook and ThreadContext life cycle to manual control ( #26904 )
...
Manually track query/load/compaction/etc. memory in Allocator instead of mem hook.
Can still use Mem Hook when cannot manually track memory code segments and find memory locations during debugging.
This will cause memory tracking loss for Query, loss less than 10% compared to the past, but this is expected to be more controllable.
Similarly, Mem Hook will no longer track unowned memory to the orphan mem tracker by default, so the total memory of all MemTrackers will be less than before.
Not need to get memory size from jemalloc in Mem Hook each memory alloc and free, which would lose performance in the past.
Not require caching bthread local in pthread local for memory hook, in the past this has caused core dumps inside bthread, seems to be a bug in bthread.
ThreadContext life cycle to manual control
In the past, ThreadContext was automatically created when it was used for the first time (this was usually in the Jemalloc Hook when the first malloc memory), and was automatically destroyed when the thread exited.
Now instead of manually controlling the create and destroy of ThreadContext, it is mainly created manually when the task thread start and destroyed before the task thread end.
Run 43 clickbench query tests.
Use MemHook in the past:
2023-11-14 10:30:42 +08:00
7332b1b371
[fix](decimal) fix undefined behaviour of divide by zero when cast string to decimal ( #26822 )
...
* [fix](decimal) fix undefined behaviour of divide by zero when cast string to decimal
* fix format
2023-11-13 10:09:06 +08:00
a5565f68b2
[Refactor](opentelemetry) Remove opentelemetry ( #26605 )
2023-11-09 18:05:34 +08:00
a3666aa87e
[feature](decimal) support decimal256 when creating table ( #26308 )
2023-11-08 15:21:01 +08:00
44b51bf0b9
[Feature](Variant) support variant load ( #26572 )
2023-11-08 00:37:57 -06:00
a4e415ab09
[feature](hive)Support hive tables after alter type. ( #25138 )
...
1.Reconstruct the logic of decode to read parquet. The parquet reader first reads the data according to the parquet physical type, and then performs a type conversion.
2.Support hive alter table.
2023-11-02 00:24:21 +08:00
d7ea4d31fb
[Chore](hash-table) remove unused code about HashTableTraits ( #26202 )
...
remove unused code about HashTableTraits
2023-11-01 21:36:50 +08:00
973657d163
[fix](compile) be cannot compile on MacOS ( #26155 )
...
build on MacOS meet error: reference to 'detail' is ambiguous.
Because there is a detail namespace under std
2023-10-31 17:36:00 +08:00
6761dc4113
[coverage](test) improve test coverage ( #26096 )
...
improve test coverage
2023-10-30 18:01:55 +08:00
c1d64a7128
[Feature](datatype) Add IPv4/v6 data type for doris ( #24965 )
2023-10-26 17:33:28 +08:00
6dd60c6ebb
[Enhance](BE) Add -Wshadow-field compile option to avoid unexpected shadowing behavior ( #25698 )
...
* Fix `Tablet::_meta_lock` shadows member inherited from `BaseTablet`
* Add -Wshadow-field compile option to avoid unexpected shadowing behavior
2023-10-26 10:00:28 +08:00
693982fd1a
[feature](decimal) support decimal256 ( #25386 )
2023-10-25 15:47:51 +08:00
87b414cdae
[Fix](query execution) Fix result sink fragment can't be cancelled in non-pipeline ( #25524 )
2023-10-24 11:30:29 +08:00
6714966df2
[Chore](function) remove bit_cast/bit_helper ( #25700 )
...
remove bit_cast/bit_helper
2023-10-23 11:54:14 +08:00
b964ab76b3
[refactor](shuffle) Simplify hash partitioning strategy ( #25596 )
2023-10-19 19:28:22 +08:00
31a5e072e7
[refactor](pipelineX) Simplify set operation ( #25502 )
2023-10-17 15:11:46 +08:00
d00d029ffb
Separate fixed key hash map context creator ( #25438 )
...
Separate fixed key hash map context creator
2023-10-16 11:20:30 +08:00
26f50f4f0f
fix heap-use-after-free on map_agg ( #25380 )
...
fix heap-use-after-free on map_agg
2023-10-13 00:19:25 +08:00
1a0344df16
[Improvement](hash) refactor of hash map context ( #24966 )
...
refactor of hash map context
2023-10-12 18:10:21 +08:00
2664d1cffb
[chore](vec) Make this copy constructor of StringRef explicit ( #25337 )
2023-10-12 14:12:46 +08:00
f14e4311c4
[Chore](check) add length check for BufferWritable ( #25322 )
...
add length check for BufferWritable
2023-10-12 10:51:50 +08:00
022762d5f0
[fix](memory) Fix work load group GC and add logs to locate slow GC #24975
...
Fix work load group GC, add cancel load and add logs.
Unify the format and change all to lowercase of GC logs, avoid unnecessary trouble when grep or less
Add logs to help locate the cause of slow GC.
2023-10-12 10:33:56 +08:00
3db33207d4
[pipelineX](fix) Fix nullable types for set operator ( #25294 )
2023-10-11 16:50:54 +08:00
bb670118f5
[coverage](test) Delete unused function to improve test coverage ( #25233 )
2023-10-11 11:50:51 +08:00
7b22ae0c80
[pipelineX](feature) Support set operation operator ( #25251 )
...
---------
Co-authored-by: zhaochangle <zhaochangle@selectdb.com >
2023-10-11 10:22:45 +08:00
642e5cdb69
[Fix](Status) Make Status [[nodiscard]] and handle returned Status correctly ( #23395 )
2023-09-29 22:38:52 +08:00
5fc04b6aeb
[Improvement](hash) some refactor of process hash table probe impl ( #24461 )
...
some refactor of process hash table probe impl
2023-09-27 16:14:49 +08:00
7630fe7b7b
[bug](node)fix dense_rank function in partition sort node return wrong rows ( #24727 )
2023-09-21 19:13:30 +08:00
e34ec094cf
[fix](memory) Fix Allocator check mem tracker limit #24711
2023-09-21 14:19:24 +08:00
f2f591e280
[fix](memory) Optimize memory exceed limit logs ( #22655 )
...
After memory exceeds the limit, print the top 15 task trackers with the largest memory.
After memory exceeds the limit, more detailed GC logs in stages.
fix large memory check.
2023-09-21 10:38:17 +08:00
f04bc05a7e
[fix](agg) The offset value was added twice in 'pack_fixed' ( #24506 )
2023-09-18 10:24:32 +08:00
35c5d71549
[Improvement](join) some improvement of hash join ( #23972 )
...
some improvement of hash join
2023-09-14 17:55:35 +08:00
f9a75b5c4f
[feature](csv_serde)1.append csv serde for serialize to csv and deserialize from csv. 2.let csvReader use csv serde not text_converter. ( #23352 )
...
1. append csv serde for serialize to csv and deserialize from csv.
2. let csvReader use csv serde not text_converter.
2023-09-10 00:16:21 +08:00
0143ae8266
[fix]Add logging before _builtin_unreachable() ( #24101 )
...
Co-authored-by: 宋光璠 <songguangfan@sf.com >
2023-09-09 00:30:11 +08:00
b96b8f4370
[Bug](jdbc) support get_default on complex type ( #23325 )
...
support get_default on complex type
2023-08-25 14:08:24 +08:00
ba882dea21
[pipelineX](dependency) Build DAG between pipelines ( #23355 )
2023-08-23 13:21:32 +08:00
8ed4045df9
[Chore](primitive-type) remove VecPrimitiveTypeTraits ( #22842 )
2023-08-23 08:37:40 +08:00
dcd6c3c022
[pipelineX](refactor) propose a new pipeline execution model ( #22562 )
2023-08-21 15:38:45 +08:00
477961dc21
[Chore](agg) refactor of hash map ( #22958 )
...
refactor of hash map
2023-08-18 17:59:30 +08:00
d371101bfd
[Improvement](aggregation) make fixed hashmap's bitmap_size flexable ( #22573 )
...
make fixed hashmap's bitmap_size flexable
2023-08-14 10:47:06 +08:00
4e880288c6
[refactor]use clear concept to replace std::enable_if_t ( #22801 )
...
---------
Signed-off-by: flynn <fenglv15@mails.ucas.ac.cn >
2023-08-12 15:10:30 +08:00
30ceb7aea7
[fix](chore] need to remove reference in assert_cast ( #22706 )
2023-08-08 20:36:05 +08:00
f5e3cd2737
[Improvement](aggregation) optimization for aggregation hash_table_lazy_emplace ( #22327 )
...
optimization for aggregation hash_table_lazy_emplace
2023-08-02 11:50:21 +08:00
f2919567df
[feature](datetime) Support timezone when insert datetime value ( #21898 )
2023-07-31 13:08:28 +08:00
302de27985
[Refactor] Refactor some code with three-way comparison ( #22170 )
...
Refactor some code with three-way comparison
2023-07-29 11:30:15 +08:00
9451382428
[Improvement](aggregate) optimization for AggregationMethodKeysFixed::insert_keys_into_columns ( #22216 )
...
optimization for AggregationMethodKeysFixed::insert_keys_into_columns
2023-07-26 16:19:15 +08:00
1f3de0eae3
[fix](memory) fix invalid large memory check && fix memory info thread safety ( #22027 )
...
fix invalid large memory check
fix memory info thread safety
2023-07-26 12:18:31 +08:00
6875ef4b8b
[refactor](mem_reuse) refactor mem_reuse in MutableBlock ( #21564 )
2023-07-20 22:53:19 +08:00
