c22d097b59
[improvement](compress) Support compress/decompress block with lz4 ( #11955 )
2022-08-22 17:35:43 +08:00
6d925054de
[feature-wip](parquet-reader) decode parquet time & datetime & decimal ( #11845 )
...
1. Spark can set the timestamp precision by the following configuration:
spark.sql.parquet.outputTimestampType = INT96(NANOS), TIMESTAMP_MICROS, TIMESTAMP_MILLIS
DATETIME V1 only keeps the second precision, DATETIME V2 keeps the microsecond precision.
2. If using DECIMAL V2, the BE saves the value as decimal128, and keeps the precision of decimal as (precision=27, scale=9). DECIMAL V3 can maintain the right precision of decimal
2022-08-22 10:15:35 +08:00
1f9eec5462
[Regression](datev2) Add test cases for datev2/datetimev2 ( #11831 )
2022-08-19 10:57:55 +08:00
fadc78c6cf
[fix](str_to_date) str_to_date support format without leading zero ( #11817 )
...
Co-authored-by: cambyzju <zhuxiaoli01@baidu.com >
2022-08-16 18:23:16 +08:00
ab9529f6b5
[enhancement](array-type) support export files in 'select into outfile' ( #11703 )
...
this pr is used to support export array type in 'select into outfile'.
Co-authored-by: hucheng01 <hucheng01@baidu.com >
2022-08-15 12:34:31 +08:00
abd2eb4fa1
[Bug](date function) Fix bug for date format %T ( #11729 )
...
* [Bug](date function) Fix bug for date format %T
2022-08-12 19:29:58 +08:00
e353be7dcb
[Bug](date function) Return null if date format is invalid ( #11720 )
2022-08-12 14:07:55 +08:00
75fc830573
[Bug](date function) fix wrong year for format '%x' ( #11520 )
2022-08-05 06:22:22 +08:00
ce68d24e95
[Bug](function) fix current_date not equal to curdate ( #11463 )
...
* fix current_date not equal to curdate
2022-08-04 09:25:50 +08:00
e1b878fe10
[Improvement](datev2) apply time LUT to datev2/datetimev2 ( #11401 )
...
* [Improvement](datev2) apply time LUT to datev2/datetimev2
2022-08-03 17:15:09 +08:00
3f43d7262b
[Bug] (datetimev2) fix bugs for datev2/datetimev2 ( #11358 )
2022-08-01 10:29:56 +08:00
73d8f5901d
fix mem tracker limiter ( #11376 )
2022-08-01 09:44:04 +08:00
18864ab7fe
weak relationship between MemTracker and MemTrackerLimiter ( #11347 )
2022-07-30 18:33:54 +08:00
19b34c09b1
[fix] (mem tracker) Fix runtime instance tracker null pointer ( #11272 )
2022-07-28 14:58:13 +08:00
328a225050
[feature-wip] (datetimev2) support window funnel and modify valid dat… ( #11277 )
...
* [feature-wip] (datetimev2) support window funnel and modify valid date range
2022-07-28 14:06:26 +08:00
72d2feae99
[feature-wip] Support all date functions for datev2/datetimev2 ( #11265 )
...
* [feature-wip] (datetimev2) support convert_tz function
* [feature-wip] Support all date functions for datev2/datetimev2
2022-07-28 08:18:59 +08:00
461a31b1f6
[enhancement][Storage] refactor create predicate ( #11017 )
2022-07-27 16:12:23 +08:00
d67029c830
[feature-wip] (datetimev2) support cast between datetimev2 with different scales ( #11198 )
...
* [feature-wip] (datetimev2) support `cast` between datetimev2 with different scale
2022-07-26 22:36:13 +08:00
823088a9eb
[FOLLOW-UP] (datetimev2) complete date function ut and built-in function declaration ( #11154 )
2022-07-26 17:48:57 +08:00
829d534e12
[Improvement] Replace switch with constexpr to boost date functions ( #11134 )
2022-07-23 22:58:59 +08:00
babab5d535
[feature-wip] support datetimev2 ( #11085 )
2022-07-23 16:07:59 +08:00
4960043f5e
[enhancement] Refactor to improve the usability of MemTracker (step2) ( #10823 )
2022-07-21 17:11:28 +08:00
842ff2b1e2
[refactor] Refactor time LUT ( #10982 )
2022-07-19 08:23:29 +08:00
dc6fbcce14
[feature-wip] (datev2) modify datev2 format in memory ( #10873 )
...
* [feature-wip] (datev2) modify datev2 format in memory
* update
2022-07-15 19:57:38 +08:00
ad4751972c
[feature-wip] Support in predicate for datev2 type ( #10810 )
2022-07-15 14:32:40 +08:00
3b46242483
[feature-wip] Optimize Decimal type ( #10794 )
...
* [feature-wip](decimalv3) support decimalv3
* [feature-wip] Optimize Decimal type
Co-authored-by: liaoxin <liaoxinbit@126.com >
2022-07-14 10:50:50 +08:00
853f85aea4
[enhancement] improve performance of week() and yearweek() ( #10633 )
2022-07-08 08:26:58 +08:00
a7df6e3dee
rename some files inside vec/sink dir ( #10636 )
...
Co-authored-by: cambyzju <zhuxiaoli01@baidu.com >
2022-07-06 17:52:47 +08:00
575bf18d55
[enhancement] speed up week_of_year by pre_calc table ( #10586 )
2022-07-05 15:37:02 +08:00
570139e332
[fix][be] Delete uncivilized comments. ( #10578 )
2022-07-04 22:35:15 +08:00
c9f86bc7e2
[refactor] Refactoring Status static methods to format message using fmt( #9533 )
2022-07-02 18:58:23 +08:00
659e863bd7
[bugfix] fix tcmalooc hook cancel deadlock ( #10514 )
2022-07-01 10:41:59 +08:00
2c35abe940
[bugfix]fix core dump on outfile with expr ( #10491 )
...
remove log
2022-06-29 20:38:49 +08:00
ca94867b4e
[Feature-wip] add date v2 type ( #9916 )
2022-06-26 16:07:56 +08:00
d73f170eeb
[optimize](storage)optimize date in storage layer ( #8967 )
...
* opt date in storage
* code style
Co-authored-by: Wang Bo <wangbo36@meituan.com >
2022-06-23 12:29:10 +08:00
8af9339b00
[BUGFIX] Fix wrong column types in result file sink ( #10079 )
2022-06-13 09:05:11 +08:00
1220cc147d
[feature](vectorized) Support outfile on vectorized engine ( #10013 )
...
This PR supports output csv format file on vectorized engine.
** Parquet is still not supported. **
2022-06-10 09:15:53 +08:00
7b55d4cb88
[BUG] return NULL for invalid date value ( #9862 )
2022-05-30 21:35:41 +08:00
0f9ef26576
[Bug] Fix timestamp_diff issue when timeunit is year and month ( #9574 )
2022-05-19 21:24:43 +08:00
73c4ec7167
Fix some typos in be/. ( #9681 )
2022-05-19 20:55:39 +08:00
718a51a388
[refactor][style] Use clang-format to sort includes ( #9483 )
2022-05-10 21:25:35 +08:00
c9961c9bb9
[style] clang-format all c++ code ( #9305 )
...
- sh build-support/clang-format.sh to clang-format all c++ code
2022-04-29 16:14:22 +08:00
681f960257
[fix](storage)(vectorized) query get wrong result when read datetime type column ( #8872 )
2022-04-18 19:34:06 +08:00
66d2f4e1fd
[fix][mem tracker] Fix MemTracker null pointer in vectorized ( #8925 )
...
Fix ThreadMemTrackerMgr::update_tracker null pointer and some details.
Issue Number: close #8920
2022-04-12 10:17:10 +08:00
6ed59bb98b
[refactor](code_style) remove useless inline #8933
...
1.Member functions defined in a class are inline by default (implicitly), and do not need to be added
2.inline is a keyword used for implementation, which has no effect when placed before the function declaration
2022-04-10 18:29:55 +08:00
519305cb22
[feature-wip] (memory tracker) (step4) Switch TLS mem tracker to separate more detailed memory usage ( #8669 )
...
Based on #8605 , Separate out the memory usage of each operator from the Query/Load/StorageEngine mem tracker.
2022-04-08 09:02:26 +08:00
46e1b05490
[refactor] Fix some code comments typo and cleanup unused include ( #8684 )
2022-03-30 09:51:48 +08:00
db5299d63e
[fix] fix compile error ( #8688 )
...
Introduced from PR #8643
The condition_variable can only wait unique_lock
2022-03-28 11:53:42 +08:00
ea45940ef0
[fix] fix memory leak in VDataStreamRecvr::SenderQueue ( #8643 )
...
After `VDataStreamRecvr::SenderQueue::close` clears `_block_queue`, calling
`VDataStreamRecvr::SenderQueue::add_block` again will cause a memory leak.
So, change the lock position, like the other add_block and add_batch.
2022-03-28 10:19:22 +08:00
eeae516e37
[Feature](Memory) Hook TCMalloc new/delete automatically counts to MemTracker ( #8476 )
...
Early Design Documentation: https://shimo.im/docs/DT6JXDRkdTvdyV3G
Implement a new way of memory statistics based on TCMalloc New/Delete Hook,
MemTracker and TLS, and it is expected that all memory new/delete/malloc/free
of the BE process can be counted.
2022-03-20 23:06:54 +08:00
