Commit Graph

42 Commits

Author SHA1 Message Date
faeb472909 Tidy up the docs and gensrc directory (#263)
1. Remove all design docs. They will be pushed again after modification.
2. Add streaming load and privilege help docs.
3. Rename palo*.py to doris*.py in gensrc/script/.
2018-11-01 10:37:30 +08:00
65fe7f65c1 Fixed: privilege logic error:
1. No one can set root password expect for root user itself
    2. NODE_PRIV cannot be granted.
    3. ADMIN_PRIV and GRANT_PRIV can only be granted or revoked on *.*
    4. No one can modifly privs of default role 'operator' and 'admin'.
    5. No user can be granted to role 'operator'.
Fixed: the running load limit should not be applied to replay logic. It will cause replay or loading image fail.
Changed: optimize the problem of too many directories under mini load directory.
Fixed: missing password and auth check when handling mini load request in Frontend.
Fixed: DomainResolver should start after Frontends transfer to a certain ROLE, not in Catalog construction methods.
Fixed: a stupid bug that no one can set password for root user... fix it: only root user can set password for root.
Fixed: read null data twice
    When reading data with a null value, in some cases, the same data will be read twice by the storage engine,
    resulting in a wrong result.The reason for this problem is that when splitting,
    and the start key is the minimum value, the data with null is read.
Fixed: add a flag to prevent DomainResovler thread start twice.
Fixed: fixed a mem leak of using ByteBuf when parsing auth info of http request.
Fixed: add a new config 'disable_hadoop_load', default is false, set to true to disable hadoop load.
Changed: add detail error msg of submitting hadoop load job in show load result.
Fixed: Backend process should be crashed if failed to saving header.
Added: exposure backend info to user when encounter error on Backend. for debugging it more convenient.
Fixed: Should remove fd from map when inputstream or outputstream is closed in Broker process.
Fixed: Change all files' LF to unix format.

Internal commit id: merge from dfcd0aca18eed9ff99d188eb3d01c60d419be1b8
2018-10-01 19:58:41 +08:00
bea10e4f06 1. hide password and other sensitive information in log and audit log
2. add 2 new proc '/current_queries' and '/current_backend_instances' to monitor the current running queries.
3. add a manual compaction api on Backend to trigger cumulative or base compaction manually.
4. add Frontend config 'max_bytes_per_broker_scanner' to limit to bytes per one broker scanner. This is to limit the memory cost of a single broker load job
5. add Frontend config 'max_unfinished_load_job' to limit load job number: if number of running load jobs exceed the limit, no more load job is allowed to be submmitted.
6. a log of bug fixed
2018-09-19 20:04:01 +08:00
cc74efb3c5 merge to ddb65b69f9c788e359e191889cb31f15279c41ec (#224)
1. Apache HDFS broker support HDFS HA and Hadoop kerberos authentication.
2. New Backup and Restore function. Use Fs Broker to backup your data to HDFS or restore them from HDFS.
3. Table-Level Privileges. Grant fine-grained privileges on table-level to specified user.
4. A lot of bugs fixed.
5. Performance improvement.
2018-08-24 17:12:26 +08:00
a7ffd0bf81 merge to 9625ef157dd44c58802d63cb7547f037b75fd710
add monitor_arch.png
2018-07-17 09:36:30 +08:00
b07b3dc34d merge to 9625ef157dd44c58802d63cb7547f037b75fd710
add png files in monitor and alert document
2018-07-17 09:28:24 +08:00
19997510a6 merge to 9625ef157dd44c58802d63cb7547f037b75fd710 (#208)
1. Implement Backend http server using libevent instead of mongoose.
2. Remove Old Hypertable rpc framework, use brpc instead.
3. Change rpc from FE to BE to brpc.
4. Fs broker support HDFS HA.
5. add more metrics to monitor.
6. Lots of bug fixed.
2018-07-17 09:20:30 +08:00
2419384e8a push 3.3.19 to github (#193)
* push 3.3.19 to github

* merge to 20ed420122a8283200aa37b0a6179b6a571d2837
2018-05-15 20:38:22 +08:00
5de798fdd6 Merge code to github (#187)
* merge to 95787f8be1fd0ff215708fb0f49997b632876586
* Bugs fixed
2018-03-23 14:04:55 +08:00
765f7f53d4 Update manipulation_stmt.md
add mini load timeout help
2017-12-15 17:56:17 +08:00
56138b9d35 move docs to wiki (#150)
move these 4 docs to wiki
docs/admin_guide/install.md
docs/user_guide/FAQ.md
docs/user_guide/sql_reference.md
docs/user_guide/tutorial.md
2017-12-06 13:58:22 +08:00
51beba6796 Add images for deploy doc 2017-12-03 16:19:29 +08:00
45571becdd Update install.md
add how to install lsb_release cmd if missing.
2017-12-03 16:03:56 +08:00
6d438cb257 Update install.md
update pre-compilation binaries (11-30)
2017-11-30 17:36:53 +08:00
34379105f8 Update tutorial.md
fix mismatch example
2017-11-28 09:05:45 +08:00
a033451367 modify: (#137)
1. remove libunwind deps
2. modify install in build.sh
3. add SHOW USER stmt to show user privilege
2017-11-13 19:49:40 -06:00
05b86e82b2 fix bugs: (#136)
1. rename database does not modify the coresponding names in cluster.
2. Result of SHOW BROKERS does not match that of in SHOW PROC '/brokers'.
3. Bugs when set property for other user using admin user.
2017-11-11 20:26:29 -06:00
e619631201 add des cluster when perform 'allter system add backend' (#134)
add des cluster when perform 'allter system add backend'
2017-11-03 04:37:16 -05:00
cc64875e6b Fix database quota check bug. Modify load help doc (#130) 2017-10-25 20:40:11 -05:00
fe38773c3e update sql_reference.md (#129)
* fix escape character in like predicate

* multi tenant doc

* modify error prompt when insert

* update sql_reference.md
2017-10-20 01:47:53 -05:00
57c9da619b fix error in tutorial.md (#121) 2017-09-29 15:51:34 +08:00
d77d8a4748 update doc about cluster (#119) 2017-09-28 12:11:09 +08:00
1c0462568c Update install.md
update pre-compile binaries of centos and ubuntu to 20170926
2017-09-27 11:28:48 +08:00
b2188a9c33 Update install.md
update pre-compile binary of centos and ubuntu to 0922.
2017-09-22 09:45:35 +08:00
3227d371e2 add metadata design doc (#103)
* add metadata design doc

* change required cmake version to 2.8.10
2017-09-18 18:29:41 +08:00
cfb8fc991a Added the fix to mysql build error. (#101) 2017-09-18 09:55:08 +08:00
cba91bac3f sort out the fs_brokers dir (#98)
* sort out the fs_broker dir
* modify install.md
2017-09-15 11:22:02 +08:00
b48dbecd2e Update install.md
update pre-compile binaries of ubuntu and centos
2017-09-14 17:20:11 +08:00
e82a06ba2b multi tenant doc (#83)
multi tenant doc
2017-09-08 18:21:41 +08:00
0475394879 add new stmt ALTER SYSTEM ADD FREE BACKEND to add a backend not belongs to any cluster 2017-09-04 15:43:19 +08:00
2a31e01ff1 add thirdparty.tar.gz suffix (#56) 2017-08-30 09:10:39 +08:00
7c278c9f92 fix #49 add .tar.gz suffix (#53) 2017-08-29 11:25:13 +08:00
fb45b606e3 Update install.md
fix some misspellings
2017-08-28 09:48:50 +08:00
5342c6dbc8 add start_broker to install.md (#46) 2017-08-25 16:51:03 +08:00
6a87b0e464 Update install.md
Fix link of pre-compilation binaries
2017-08-23 11:06:13 +08:00
7b5d05f5d1 Update install.md
fix format problem
2017-08-22 19:57:34 +08:00
eeaf4b2ad6 update install.md
update pre-compilation binaries.
add docker image and it's usage.
2017-08-22 19:54:07 +08:00
57a11efd3d make exec_mem_limit valid for broker load (#37) 2017-08-20 15:20:20 +08:00
7d1c2b87ca modify thirdparty/build-thirdparty.sh to fix compilation bug of thrift. (#10) (#12)
update pre-compile binaries.
2017-08-16 09:33:24 +08:00
65c0d95036 change sql image to markdown (#7)
change picture to markdown.
add create partition sql.

* change picture to word
2017-08-15 09:44:27 +08:00
fb64a1a8e8 add download link 2017-08-11 22:09:07 +08:00
e2311f656e baidu palo 2017-08-11 17:51:21 +08:00