database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
21,892 Commits 1 Branch 0 Tags
91abfe38cdc1730f61330076cfcc616f042bee21
Commit Graph

331 Commits

Author SHA1 Message Date
Xinyi Zou
7d2134dade branch-2.1: [fix](arrow) Rollback Arrow version 19.0.1 -> 17.0.0, Fix MacOS compile error and decimal type error when convert to Parquet (#51291) 
pick #51217

### What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

### Release note

None

### Check List (For Author)

- Test <!-- At least one of them must be included. -->
    - [ ] Regression test
    - [ ] Unit Test
    - [ ] Manual test (add detailed scripts or steps below)
    - [ ] No need to test or manual test. Explain why:
- [ ] This is a refactor/code format and no logic has been changed.
        - [ ] Previous test can cover this change.
        - [ ] No code files have been changed.
        - [ ] Other reason <!-- Add your reason?  -->

- Behavior changed:
    - [ ] No.
    - [ ] Yes. <!-- Explain the behavior change -->

- Does this need documentation?
    - [ ] No.
- [ ] Yes. <!-- Add document PR link here. eg:
https://github.com/apache/doris-website/pull/1214 -->

### Check List (For Reviewer who merge this PR)

- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label <!-- Add branch pick label that this PR
should merge into -->
 2025-05-27 21:26:11 +08:00
Xinyi Zou
fc9beac468 branch-2.1: [fix](arrow-flight-sql) Separate arrow-flight-sql connection and mysql connection (#51110) 2025-05-22 20:39:48 +08:00
Mryange
d87409c5ca [fix](inverted index) Downgrade ICU version to support lower OS versions #47664 (#50005) 2025-04-16 12:43:20 +08:00
Mingyu Chen (Rayner)
826cbfdb63 [deps](jindofs) add jindofs for 2.1 (#49259)(#49371)(#49374)(#49502)(#49503)(#49886)(#49903) (#49908) 
bp (#49259)(#49371)(#49374)(#49502)(#49503)(#49886)(#49903)
 2025-04-10 21:58:36 +08:00
Mryange
aad189cf40 [feature](function) upper lower support utf8 input (#49756) 
### What problem does this PR solve?
https://github.com/apache/doris/pull/49231
 2025-04-07 12:00:31 +08:00
github-actions[bot]
08fc9eea0d branch-2.1: [feat](thirdparty) Add aws dentity-management and sts library for be and ry #49565 (#49684) 
Cherry-picked from #49565

Co-authored-by: Lei Zhang <zhanglei@selectdb.com>
 2025-04-06 21:22:52 +08:00
github-actions[bot]
ed1db08a17 branch-2.1: [fix](thrift) Pick THRIFT-5492: Add readEnd to TBufferedTransport #49649 (#49656) 
Cherry-picked from #49649

Co-authored-by: walter <maochuan@selectdb.com>
 2025-03-29 20:22:09 +08:00
Mingyu Chen (Rayner)
6da61683d4 [fix](deps) upgrade hadoop to 3.3.6.5 (#48280) (#48393) 
bp #48280
 2025-02-26 22:57:50 +08:00
github-actions[bot]
a8b5125a25 branch-2.1: [fix](third party) fix hang when destroy of rdkafka instances #44913 (#44951) 
Cherry-picked from #44913

Co-authored-by: hui lai <laihui@selectdb.com>
Co-authored-by: Dongyang Li <lidongyang@selectdb.com>
 2024-12-09 19:20:52 +08:00
Mryange
52c29fef7f [pick](arm) use patch to opt bitshuffle and fix pick pr 38378 ,38634 (#43656) 
### What problem does this PR solve?
https://github.com/apache/doris/pull/38634
https://github.com/apache/doris/pull/38378
Issue Number: close #xxx
 2024-11-12 18:52:41 +08:00
Rayner Chen
1eea8dcb2c [enhance](thirdparty) add boritli headers in thirdparty (#42017) (#42110) (#42124) 
bp  (#42017) (#42110)

---------

Co-authored-by: Socrates <suxiaogang223@icloud.com>
 2024-10-21 09:51:11 +08:00
Xinyi Zou
95d429b7de [pick](branch-2.1) pick #41891 (#41929) 
pick #41891
 2024-10-16 13:59:46 +08:00
Mingyu Chen
171258cc31 [deps](hadoop) update hadoop to 3.3.6.3 #39376 (#41748) 
bp #39376
 2024-10-12 16:34:59 +08:00
Xinyi Zou
40500f2b10 [branch-2.1](thirdparty) upgrade arrow to 17.0.0 (#39773) 
pick #38572
 2024-08-22 18:35:32 +08:00
Pxl
cf2120a44a [Chore](brpc) add gc for abafreelist to avoid eagain and set brpc tim… (#38177) 
pick from #37888
 2024-07-23 21:24:36 +08:00
Xinyi Zou
27283b2915 [branch-2.1](memory) Disable Arrow Jemalloc (#37529) 
pick ##37528
 2024-07-09 23:48:27 +08:00
Yulei-Yang
969f7532d6 [fix](deps) fix NoSuchMethodError: newInstanceFromKeytab when use kerberos (#37322) 2024-07-08 10:19:02 +08:00
Yongqiang YANG
fce09ae2f6 [fix](third-party) enable keepalive on socket created by libevent (#36088) 
pick #35805 #36026
 2024-06-11 14:18:22 +08:00
AlexYue
ba0161c8b9 Revert "[feature-wip](Cloud) Introduce azure core C++ sdk (#35208)" (#35826) 
## Proposed changes

Issue Number: close #xxx

<!--Describe your changes.-->

This reverts commit #35641 because of the compilation of such is not
successful on arm plateform.
 2024-06-03 23:22:56 +08:00
AlexYue
2e4c2a6e6e [feature-wip](Cloud) Introduce azure core C++ sdk (#35208) (#35641) 
bp #35208
 2024-05-30 13:54:53 +08:00
zhiqiang
0ae1b9c70a [chore](remove code) Remove dragonbox related (#34528) 
* Revert "[refactor](mysql result format) use new serde framework to tuple convert (#25006)"

This reverts commit e5ef0aa6d439c3f9b1f1fe5bc89c9ea6a71d4019.

* run buildall

* MORE

* FIX
 2024-05-13 22:16:57 +08:00
shuke
f76bf66903 [chore](third-party) Fix compilation errors on arm platform (#34261) 2024-04-29 21:26:56 +08:00
HHoflittlefish777
946c1924b1 [fix](routine-load) fix consumer hang when kafka exception causing can not query (#33492) 2024-04-17 23:42:00 +08:00
Adonis Ling
be9fe12b26 Fix compatibility issues with GLIBC(>= 2.34) for prebuilt thirdparty packages (#33314) 
Some symbols changed after GLIBC 2.34 according to the release notes(https://lists.gnu.org/archive/html/info-gnu/2021-08/msg00001.html).

This may cause linkage errors if we use GLIBC(>= 2.34).
 2024-04-10 16:02:34 +08:00
Xinyi Zou
39b768b9ea [branch-2.1](thirdparty) upgrade arrow to 15.0.2 #32827 2024-03-27 08:35:40 +08:00
Kaijie Chen
3c74d4a4ef [fix](brpc) check failed socket before SetConnected (#32790) 2024-03-25 22:34:19 +08:00
walter
31827e88e3 [fix](merge-cloud) Fix ali open sdk gcc compile issue (#30308) 2024-03-14 10:59:25 +08:00
HappenLee
8ae493e54f [thirdparty](lib) Add Patch for base64 lib (#32059) 2024-03-14 09:20:45 +08:00
HappenLee
f9ee3ff359 [thirdparty](lib) Add base64 thirdparty lib (#31850) 2024-03-14 09:18:52 +08:00
Adonis Ling
a4f9eec810 [chore](third-party) Link protobuf with zlib statically (#31173) 
We should link protobuf with libz.a explicitly, otherwise protoc may not be executable due to the missing libz.1.dylib.
 2024-02-21 13:53:39 +08:00
Xinyi Zou
99cdbc7e12 [fix](memory) Fix jemalloc lib name for thirdparty arrow (#28843) 
after #28429
 2024-02-21 13:52:10 +08:00
Jerry Hu
5e60ca0652 [chore](3rd) update CRoaring bitmap version to 2.1.2 (#30697) 2024-02-01 23:14:14 +08:00
HHoflittlefish777
b7c86d66fa [improvement](thirdparty) introduce brpc stream patch to make stream write to socket in background bthread (#30458) 2024-01-30 15:33:40 +08:00
Kaijie Chen
a4ccf92fec [fix](thirdparty) patch brpc 1.4.0 to fix stream rpc (#30476) 2024-01-29 19:02:46 +08:00
Mingyu Chen
91e546cfe3 [deps](hadoop) upgrade hadoop deps to 3.3.4.6 (#29908) 2024-01-16 18:31:55 +08:00
Mingyu Chen
7a6475eeee [deps](hadoop) update hadoop on BE side to 3.3.6 (#29939) 
Same as on FE side
 2024-01-14 15:52:04 +08:00
Tiewei Fang
75631c89fa [Fix](thirdparty) fix that BE can not start when use JDK17 (#29570) 
An error occurred when starting BE with JDK17

```java
Exception: java.lang.StackOverflowError thrown from the UncaughtExceptionHandler in thread "process reaper"
```

This error occurs when BE's java code calls Runtime.exec() to fork the child process.
It turned out that Doris was calling the `glog` library in the C++ layer to cause this problem.


The solution comes from: https://github.com/google/glog/issues/975
 2024-01-12 11:44:21 +08:00
Jerry Hu
e1ff439e63 [chore](thirdparty) update vectorscan to 5.7.11 (#29623) 2024-01-07 11:41:26 +08:00
Kang
dbf61005df change boost thirdparty url to offical archives.boost.io (#29401) 2024-01-03 12:12:43 +08:00
HappenLee
7c5fda1169 [thirdparty](lib) Add streamvbyte thirdparty lib (#29308) 2023-12-29 19:22:07 +08:00
HHoflittlefish777
ca6cb04d16 [fix](routine_load) change librdkafka version from 2.0.2 to 1.9.2 to avoid memory leak (#28528) 2023-12-18 18:35:04 +08:00
Xinyi Zou
4bcde57775 [enhancement](memory) Support jemalloc 64K page size - thirdparty (#28429) 2023-12-18 12:38:09 +08:00
HHoflittlefish777
8a7b0e5485 [upgrade](thirdparty) upgrade librdkafka from 1.8.2 to 2.0.2 (#28210) 
Some error happen when using routine load
```
[INTERNAL_ERROR]Message at offset XXX might be too large to fetch, try increasing receive.message.max.bytes
```
Refer to https://github.com/confluentinc/librdkafka/issues/2993, we should upgrade librdkafka version to avoid this bug.
 2023-12-12 11:12:10 +08:00
Mingyu Chen
aaa44fa3dc [deps](odbc) undefined the BOOL in include/sqltypes.h (#28014) 
When `ENABLE_PCH = false`, this define will be conflict with BOOL in `include/arrow/type_fwd.h`.
The ODBC table will be deprecated in 2.1, so I just simply undefined the BOOL in include/sqltypes.h
to make compile OK
 2023-12-06 00:16:23 +08:00
Qi Chen
65126459bd [deps](compression) Opt gzip decompress by libdeflate on X86 and X86_64 platforms: 1. Add libdeflate lib. (#27542) 
Test result:

- env: 1 node(16 cores, 64G).
- parquet column: 100 million rows of char(255) column.
- result: 9.09 s -> 6.04 s.
 2023-11-28 10:14:48 +08:00
Amos Bird
23ab3333a0 [chore](thirdparty) Fix link errors of librdkafka (#27247) 
Exclude coverage symbol from librdkafka's version script generator to
avoid compatibility issues with recent linkers such as lld-17.
 2023-11-19 21:22:26 +08:00
Yongqiang YANG
c1c8376eb2 [fix](thirdparty) brpc stream crash on error stream (#27016) 
* [fix](thirdparty) brpc stream crash on error stream

* rename
 2023-11-15 18:24:01 +08:00
zhiqiang
a5565f68b2 [Refactor](opentelemetry) Remove opentelemetry (#26605) 2023-11-09 18:05:34 +08:00
zclllyybb
4889841ff7 [thirdparty](import) import avx2neon library (#25383) 
import avx2neon library
 2023-10-23 11:51:54 +08:00
Adonis Ling
f6f1e3b646 [chore](build) Bump the version of hyperscan (#25464) 
The latest version fixed the previous issue (https://github.com/intel/hyperscan/issues/292).
 2023-10-17 08:45:25 -05:00