a8b5125a25
branch-2.1: [fix](third party) fix hang when destroy of rdkafka instances #44913 ( #44951 )
...
Cherry-picked from #44913
Co-authored-by: hui lai <laihui@selectdb.com >
Co-authored-by: Dongyang Li <lidongyang@selectdb.com >
2024-12-09 19:20:52 +08:00
52c29fef7f
[pick](arm) use patch to opt bitshuffle and fix pick pr 38378 ,38634 ( #43656 )
...
### What problem does this PR solve?
https://github.com/apache/doris/pull/38634
https://github.com/apache/doris/pull/38378
Issue Number: close #xxx
2024-11-12 18:52:41 +08:00
1eea8dcb2c
[enhance](thirdparty) add boritli headers in thirdparty ( #42017 ) ( #42110 ) ( #42124 )
...
bp (#42017 ) (#42110 )
---------
Co-authored-by: Socrates <suxiaogang223@icloud.com >
2024-10-21 09:51:11 +08:00
95d429b7de
[pick](branch-2.1) pick #41891 ( #41929 )
...
pick #41891
2024-10-16 13:59:46 +08:00
171258cc31
[deps](hadoop) update hadoop to 3.3.6.3 #39376 ( #41748 )
...
bp #39376
2024-10-12 16:34:59 +08:00
40500f2b10
[branch-2.1](thirdparty) upgrade arrow to 17.0.0 ( #39773 )
...
pick #38572
2024-08-22 18:35:32 +08:00
cf2120a44a
[Chore](brpc) add gc for abafreelist to avoid eagain and set brpc tim… ( #38177 )
...
pick from #37888
2024-07-23 21:24:36 +08:00
27283b2915
[branch-2.1](memory) Disable Arrow Jemalloc ( #37529 )
...
pick ##37528
2024-07-09 23:48:27 +08:00
969f7532d6
[fix](deps) fix NoSuchMethodError: newInstanceFromKeytab when use kerberos ( #37322 )
2024-07-08 10:19:02 +08:00
fce09ae2f6
[fix](third-party) enable keepalive on socket created by libevent ( #36088 )
...
pick #35805 #36026
2024-06-11 14:18:22 +08:00
ba0161c8b9
Revert "[feature-wip](Cloud) Introduce azure core C++ sdk ( #35208 )" ( #35826 )
...
## Proposed changes
Issue Number: close #xxx
<!--Describe your changes.-->
This reverts commit #35641 because of the compilation of such is not
successful on arm plateform.
2024-06-03 23:22:56 +08:00
2e4c2a6e6e
[feature-wip](Cloud) Introduce azure core C++ sdk ( #35208 ) ( #35641 )
...
bp #35208
2024-05-30 13:54:53 +08:00
0ae1b9c70a
[chore](remove code) Remove dragonbox related ( #34528 )
...
* Revert "[refactor](mysql result format) use new serde framework to tuple convert (#25006 )"
This reverts commit e5ef0aa6d439c3f9b1f1fe5bc89c9ea6a71d4019.
* run buildall
* MORE
* FIX
2024-05-13 22:16:57 +08:00
f76bf66903
[chore](third-party) Fix compilation errors on arm platform ( #34261 )
2024-04-29 21:26:56 +08:00
946c1924b1
[fix](routine-load) fix consumer hang when kafka exception causing can not query ( #33492 )
2024-04-17 23:42:00 +08:00
be9fe12b26
Fix compatibility issues with GLIBC(>= 2.34) for prebuilt thirdparty packages ( #33314 )
...
Some symbols changed after GLIBC 2.34 according to the release notes(https://lists.gnu.org/archive/html/info-gnu/2021-08/msg00001.html ).
This may cause linkage errors if we use GLIBC(>= 2.34).
2024-04-10 16:02:34 +08:00
39b768b9ea
[branch-2.1](thirdparty) upgrade arrow to 15.0.2 #32827
2024-03-27 08:35:40 +08:00
3c74d4a4ef
[fix](brpc) check failed socket before SetConnected ( #32790 )
2024-03-25 22:34:19 +08:00
31827e88e3
[fix](merge-cloud) Fix ali open sdk gcc compile issue ( #30308 )
2024-03-14 10:59:25 +08:00
8ae493e54f
[thirdparty](lib) Add Patch for base64 lib ( #32059 )
2024-03-14 09:20:45 +08:00
f9ee3ff359
[thirdparty](lib) Add base64 thirdparty lib ( #31850 )
2024-03-14 09:18:52 +08:00
a4f9eec810
[chore](third-party) Link protobuf with zlib statically ( #31173 )
...
We should link protobuf with libz.a explicitly, otherwise protoc may not be executable due to the missing libz.1.dylib.
2024-02-21 13:53:39 +08:00
99cdbc7e12
[fix](memory) Fix jemalloc lib name for thirdparty arrow ( #28843 )
...
after #28429
2024-02-21 13:52:10 +08:00
5e60ca0652
[chore](3rd) update CRoaring bitmap version to 2.1.2 ( #30697 )
2024-02-01 23:14:14 +08:00
b7c86d66fa
[improvement](thirdparty) introduce brpc stream patch to make stream write to socket in background bthread ( #30458 )
2024-01-30 15:33:40 +08:00
a4ccf92fec
[fix](thirdparty) patch brpc 1.4.0 to fix stream rpc ( #30476 )
2024-01-29 19:02:46 +08:00
91e546cfe3
[deps](hadoop) upgrade hadoop deps to 3.3.4.6 ( #29908 )
2024-01-16 18:31:55 +08:00
7a6475eeee
[deps](hadoop) update hadoop on BE side to 3.3.6 ( #29939 )
...
Same as on FE side
2024-01-14 15:52:04 +08:00
75631c89fa
[Fix](thirdparty) fix that BE can not start when use JDK17 ( #29570 )
...
An error occurred when starting BE with JDK17
```java
Exception: java.lang.StackOverflowError thrown from the UncaughtExceptionHandler in thread "process reaper"
```
This error occurs when BE's java code calls Runtime.exec() to fork the child process.
It turned out that Doris was calling the `glog` library in the C++ layer to cause this problem.
The solution comes from: https://github.com/google/glog/issues/975
2024-01-12 11:44:21 +08:00
e1ff439e63
[chore](thirdparty) update vectorscan to 5.7.11 ( #29623 )
2024-01-07 11:41:26 +08:00
dbf61005df
change boost thirdparty url to offical archives.boost.io ( #29401 )
2024-01-03 12:12:43 +08:00
7c5fda1169
[thirdparty](lib) Add streamvbyte thirdparty lib ( #29308 )
2023-12-29 19:22:07 +08:00
ca6cb04d16
[fix](routine_load) change librdkafka version from 2.0.2 to 1.9.2 to avoid memory leak ( #28528 )
2023-12-18 18:35:04 +08:00
4bcde57775
[enhancement](memory) Support jemalloc 64K page size - thirdparty ( #28429 )
2023-12-18 12:38:09 +08:00
8a7b0e5485
[upgrade](thirdparty) upgrade librdkafka from 1.8.2 to 2.0.2 ( #28210 )
...
Some error happen when using routine load
```
[INTERNAL_ERROR]Message at offset XXX might be too large to fetch, try increasing receive.message.max.bytes
```
Refer to https://github.com/confluentinc/librdkafka/issues/2993 , we should upgrade librdkafka version to avoid this bug.
2023-12-12 11:12:10 +08:00
aaa44fa3dc
[deps](odbc) undefined the BOOL in include/sqltypes.h ( #28014 )
...
When `ENABLE_PCH = false`, this define will be conflict with BOOL in `include/arrow/type_fwd.h`.
The ODBC table will be deprecated in 2.1, so I just simply undefined the BOOL in include/sqltypes.h
to make compile OK
2023-12-06 00:16:23 +08:00
65126459bd
[deps](compression) Opt gzip decompress by libdeflate on X86 and X86_64 platforms: 1. Add libdeflate lib. ( #27542 )
...
Test result:
- env: 1 node(16 cores, 64G).
- parquet column: 100 million rows of char(255) column.
- result: 9.09 s -> 6.04 s.
2023-11-28 10:14:48 +08:00
23ab3333a0
[chore](thirdparty) Fix link errors of librdkafka ( #27247 )
...
Exclude coverage symbol from librdkafka's version script generator to
avoid compatibility issues with recent linkers such as lld-17.
2023-11-19 21:22:26 +08:00
c1c8376eb2
[fix](thirdparty) brpc stream crash on error stream ( #27016 )
...
* [fix](thirdparty) brpc stream crash on error stream
* rename
2023-11-15 18:24:01 +08:00
a5565f68b2
[Refactor](opentelemetry) Remove opentelemetry ( #26605 )
2023-11-09 18:05:34 +08:00
4889841ff7
[thirdparty](import) import avx2neon library ( #25383 )
...
import avx2neon library
2023-10-23 11:51:54 +08:00
f6f1e3b646
[chore](build) Bump the version of hyperscan ( #25464 )
...
The latest version fixed the previous issue (https://github.com/intel/hyperscan/issues/292 ).
2023-10-17 08:45:25 -05:00
e1b9854f90
[bugfix](thirdparty) Upgrade aws s3 sdk to prevent mem leak ( #25106 )
...
During the use of the AWS S3 SDK, we found that there is a memory leak. According to the official issue, upgrading the SDK should resolve the issue.
2023-10-09 16:08:50 +08:00
11d03a3ab0
[thirdyparty] new thirdy party dragonbox ( #24979 )
2023-09-28 13:42:44 +08:00
94907ca0f2
[improvement](brpc) change parking slot to 32 ( #24567 )
2023-09-21 21:35:46 +08:00
57ca7d66d3
[Fix](multi-catalog) Fix zlib init error by using doris's zlib shared library and jni.log does not output. ( #23260 )
2023-09-02 21:44:14 +08:00
ba351af452
[enhancement](thirdparty) upgrade thirdparty libs - again ( #23414 )
...
submit again #23290 (not upgrade brpc, because bthread local has error)
protobuf 3.15.0 -> 21.11
glog 0.4.0 -> 0.6.0
lz4 1.9.3 -> 1.9.4
curl 7.79.0 -> 8.2.1
zstd 1.5.2 -> 1.5.5
arrow 7.0.0 -> 13.0.0
abseil 20220623.1 -> 20230125.3
orc 1.7.2 -> 1.9.0
jemalloc for arrow 5.2.1 -> 5.3.0
xsimd 7.0.0 -> 13.0.0
opentelemetry-proto 0.19.0 -> 1.0.0
opentelemetry 1.8.3 -> 1.10.0
new:
c-ares -> 1.19.1
grpc -> 1.54.3
2023-08-26 22:59:10 +08:00
303d5ac3f7
Revert "[enhancement](thirdparty) upgrade thirdparty libs ( #23290 )" ( #23420 )
...
This reverts commit 2185268bab2f5890a2c3c9a3c315375a971c4416.
Co-authored-by: stephen <hello-stephen@qq.com >
2023-08-24 14:40:51 +08:00
2185268bab
[enhancement](thirdparty) upgrade thirdparty libs ( #23290 )
...
protobuf 3.15.0 -> 21.11
glog 0.4.0 -> 0.6.0
lz4 1.9.3 -> 1.9.4
curl 7.79.0 -> 8.2.1
brpc 1.4.0 -> 1.6.0
zstd 1.5.2 -> 1.5.5
arrow 7.0.0 -> 13.0.0
abseil 20220623.1 -> 20230125.3
orc 1.7.2 -> 1.9.0
jemalloc for arrow 5.2.1 -> 5.3.0
xsimd 7.0.0 -> 13.0.0
opentelemetry-proto 0.19.0 -> 1.0.0
opentelemetry 1.8.3 -> 1.10.0
new:
c-ares -> 1.19.1
grpc -> 1.54.3
2023-08-23 20:25:49 +08:00
a5382043d7
[chore](third-party) Fix errors while building brpc ( #23339 )
...
close #23340
2023-08-23 09:13:06 +08:00
