Go to file

Lightman 486cf0ebd4 [Feature] Lightweight schema change of add/drop column (#10136 )

* [Schema Change] support fast add/drop column  (#49)

* [feature](schema-change) support fast schema change. coauthor: yixiutt

* [schema change] Using columns desc from fe to read data. coauthor: Lchangliang

* [feature](schema change) schema change optimize for add/drop columns.

1.add uniqueId field for class column.
2.schema change for add/drop columns directly update schema meta

Co-authored-by: yixiutt <yixiu@selectdb.com>
Co-authored-by: SWJTU-ZhangLei <1091517373@qq.com>

[Feature](schema change) fix write and add regression test (#69)

Co-authored-by: yixiutt <yixiu@selectdb.com>

[schema change] be ssupport that delete use newest schema

add delete regression test

fix regression case (#107)

tmp

[feature](schema change) light schema change exclude rollup and agg/uniq/dup key type.

[feature](schema change) fe olapTable maxUniqueId write in disk.

[feature](schema change) add rpc iface for sc add column.

[feature](schema change) add columnsDesc to TPushReq for ligtht sc.

resolve the deadlock when schema change (#124)

fix columns from fe don't has bitmap_index flag (#134)

add update/delete case

construct MATERIALIZED schema from origin schema when insert

fix not vectorized compaction coredump

use segment cache

choose newest schema by schema version when compaction (#182)

[bugfix](schema change) fix ligth schema change problem.

[feature](schema change) light schema change add alter job. (#1)

fix be ut

[bug] (schema change) unique drop key column should not light schema
change

[feature](schema change) add schema change regression-test.

fix regression test

[bugfix](schema change) fix multi alter clauses for light schema change. (#2)

[bugfix](schema change) fix multi clauses calculate column unique id (#3)

modify PushTask process (#217)

[Bugfix](schema change) fix jobId replay cause bdbje exception.

[bug](schema change) fix max col unique id repeatitive. (#232)

[optimize](schema change) modify pendingMaxColUniqueId generate rule.

fix compaction error
* fix be ut

* fix snapshot load core

fix unique_id error (#278)

[refact](fe) remove redundant code for light schema change. (#4)

[refact](fe) remove redundant code for light schema change. (#4)

format fe core

format be core

fix be ut

modify fe meta version

fix rebase error

flush schema into rowset_meta in old table

[refactor](schema change) refact fe light schema change. (#5)

delete the change of schemahash and support get max version schema

* modify for review

* fix be ut

* fix schema change test

2022-07-12 19:41:06 +08:00

.github

[action](Nereids): add label auto for nereids UT. (#10665 )

2022-07-07 18:21:04 +08:00

[Feature] Lightweight schema change of add/drop column (#10136 )

2022-07-12 19:41:06 +08:00

bin

[refactor] update stop_be.sh to avoid error message (#10691 )

2022-07-08 20:49:00 +08:00

build-support

support different python version in build-support scripts (#10378 )

2022-07-11 23:23:45 +08:00

conf

[improvement] set default jvm memory to 8G for FE (#9683 )

2022-06-06 08:59:20 +08:00

contrib/udf

[UDF] support RPC udaf part 1: support create RPC udaf in fe (#8510 )

2022-04-21 17:38:58 +08:00

dist

[TLP](step-1) Remove incubator prefix (#10230 )

2022-06-19 19:34:52 +08:00

docker

[TLP](step-1) Remove incubator prefix (#10230 )

2022-06-19 19:34:52 +08:00

docs

[feature-wip] (array-type) add the array_distinct function (#10388 )

2022-07-12 17:02:42 +08:00

extension

[compile]Update init-env.sh (#10451 )

2022-06-30 11:28:06 +08:00

[Feature] Lightweight schema change of add/drop column (#10136 )

2022-07-12 19:41:06 +08:00

fe_plugins

[TLP](step-1) Remove incubator prefix (#10230 )

2022-06-19 19:34:52 +08:00

fs_brokers/apache_hdfs_broker

[TLP](step-1) Remove incubator prefix (#10230 )

2022-06-19 19:34:52 +08:00

gensrc

[Feature] Lightweight schema change of add/drop column (#10136 )

2022-07-12 19:41:06 +08:00

regression-test

[Feature] Lightweight schema change of add/drop column (#10136 )

2022-07-12 19:41:06 +08:00

samples

[refactor](load) Remove mini load (#10520 )

2022-06-30 23:21:41 +08:00

thirdparty

[chore](dependency) fix opentelemetry-cpp enable o3 optimization will core. (#10675 )

2022-07-08 10:08:07 +08:00

tools

[enhancement](nereids) make SSB works (#10659 )

2022-07-11 11:33:17 +08:00

[fix](fe-ui) fix home page spin bug #7170 (#7912 )

2022-01-30 16:47:58 +08:00

webroot

[License] Organize and modify the license of the code (#4371 )

2020-08-24 21:51:55 +08:00

.asf.yaml

[TLP](step-2) update .asf.yaml (#10273 )

2022-06-21 09:43:56 +08:00

.clang-format

[refactor][style] Use clang-format to sort includes (#9483 )

2022-05-10 21:25:35 +08:00

.clang-format-ignore

[chore](clang-format)(license-eye) Add Clang Format/Skywalking eyes github action (#7132 )

2021-11-24 10:41:02 +08:00

.clang-tidy

[refactor] add some clang-tidy checks && some code style fix (#8752 )

2022-03-31 13:53:41 +08:00

.clangd

[enhancement][diagnostics] Add a diagnostic: detect unused includes (#9117 )

2022-06-08 11:52:48 +08:00

.editorconfig

[community](*) polish config about project (#8987 )

2022-04-20 14:48:32 +08:00

.gitattributes

Enable auto convert when check in (#1926 )

2019-10-09 22:31:27 +08:00

.gitignore

[chore] Update .gitignore to ignore generated files by be ut (#10713 )

2022-07-09 10:45:00 +08:00

.gitmodules

[chore]replace checkstyle action with mvn checkstyle:check (#10474 )

2022-06-30 11:20:50 +08:00

.licenserc.yaml

[website](doc)add package-lock.json to resolve docs build failure (#10558 )

2022-07-02 17:20:11 +08:00

.rat-excludes

[improvement] Improve sig handler (#8545 )

2022-03-22 10:40:31 +08:00

build_plugin.sh

[Fix Bug] Fix ehco command not found (#9021 )

2022-04-15 13:43:47 +08:00

build.sh

[Enhancement] support compile with jemalloc (#10542 )

2022-07-11 12:15:35 +08:00

CODE_OF_CONDUCT.md

[Doc] Create CODE_OF_CONDUCT.md (#4070 )

2020-07-14 22:28:38 +08:00

CONTRIBUTING_CN.md

[TLP](step-1) Remove incubator prefix (#10230 )

2022-06-19 19:34:52 +08:00

CONTRIBUTING.md

[TLP](step-1) Remove incubator prefix (#10230 )

2022-06-19 19:34:52 +08:00

env.sh

[refactor] fix warings when compile with clang (#8069 )

2022-02-19 11:29:02 +08:00

LICENSE.txt

[website] add website external resource (#10416 )

2022-06-26 01:22:14 +08:00

NOTICE.txt

[TLP](step-1) Remove incubator prefix (#10230 )

2022-06-19 19:34:52 +08:00

README.md

[Bug][docs] Fix wrong links in README.md (#10394 )

2022-07-04 14:44:23 +08:00

run-be-ut.sh

[Enhancement] support compile with jemalloc (#10542 )

2022-07-11 12:15:35 +08:00

run-fe-ut.sh

[Fix Bug] Fix ehco command not found (#9021 )

2022-04-15 13:43:47 +08:00

run-regression-test.sh

[fix](regression-test) fix run-regression-test Xmx2048m param (#10234 )

2022-06-17 23:30:44 +08:00

tsan_suppressions

[TSAN] Fix tsan bugs (part 1) (#5162 )

2021-01-15 09:45:11 +08:00

README.md

Apache Doris

Doris is an MPP-based interactive SQL data warehousing for reporting and analysis. Its original name was Palo, developed in Baidu. After donated to Apache Software Foundation, it was renamed Doris.

Doris provides high concurrent low latency point query performance, as well as high throughput queries of ad-hoc analysis.
Doris provides batch data loading and real-time mini-batch data loading.
Doris provides high availability, reliability, fault tolerance, and scalability.

The main advantages of Doris are the simplicity (of developing, deploying and using) and meeting many data serving requirements in a single system. For details, refer to Overview.

Official website: https://doris.apache.org/

License

Apache License, Version 2.0

Note

Some licenses of the third-party dependencies are not compatible with Apache 2.0 License. So you need to disable some Doris features to be complied with Apache 2.0 License. For details, refer to the thirdparty/LICENSE.txt

Technology

Doris mainly integrates the technology of Google Mesa and Apache Impala, and it is based on a column-oriented storage engine and can communicate by MySQL client.