Commit Graph

232 Commits

Author SHA1 Message Date
1f092bb9fb Add EsTableDescriptor in be (#775) 2019-03-19 19:33:54 +08:00
2a152e0943 Remove colocate table meta when drop db (#761) 2019-03-17 15:23:38 +08:00
4a3d9dd1ac Fix bug that balance slot may not be released when balance task is done (#757) 2019-03-14 21:06:19 +08:00
c11e78c6e6 Fix bug of invalid replica last failed version (#746)
1. Some previous doris version may cause some invalid replica last failed version.
2. Also modify the CREATE TABLE help doc, remove row storage type and random distribution.
2019-03-14 12:35:29 +08:00
7feb27e047 Fix not matched error code (#740) 2019-03-13 11:09:39 +08:00
5f9e82b0fa Support calculate unix_timestamp() on Frontend (#732)
#731
2019-03-13 09:58:29 +08:00
b3fd53aa92 Fix bug that compareTo in PartitionKey throws cast error (#720) 2019-03-11 17:53:32 +08:00
584b4371e3 Fix balance with diff storage medium (#705) 2019-03-11 09:22:30 +08:00
7965a7129a Add esquery function (#652) 2019-03-08 09:27:41 +08:00
4dbbd32a72 Remove sensitive info (#692) 2019-03-06 17:29:11 +08:00
49dddb458d Fix some tablet scheduler bug (#686)
1. The balance task does not taking storage medium into account.
2. When repairing tablet with version incomplete, tablet with replica (2-xx), (2-xx), (2-0) can't be handled.
3. Show proc stmt may throw null pointer exception when all replicas are missing.
2019-03-05 09:26:36 +08:00
f2bd98f76a Clear etl job files when job finished (#680) 2019-03-01 17:01:13 +08:00
acf839ca9c Remove the running partition mark when delete operation encounter errors (#678) 2019-03-01 12:52:38 +08:00
b2d8fcdbd7 Limit the number of balance task (#674)
1. Limit the number of balance tablet selection. The number of
   tablet selection should be less than the low load path number.
2. Limit the max number of balance task to 500.
2019-02-28 10:11:44 +08:00
ac818c2b7b Optimize the some schedule policy of routine load in FE (#665)
* Change routine load task sheduler interval to 0
1. change routine load task scheduler interval to 0
2. init progress when routine load scheduler
3. add unit test and function test of routine load scheduler and task commit

* Add checker of custom kafka partition
1. need scheduler to need schedule
2. add checker of custom kafka partition when create routine load job
3. fix unit test error
2019-02-27 15:38:51 +08:00
e7013ce6a2 Remove restrict of "Analytic function must have partition by" (#659) 2019-02-27 14:12:39 +08:00
9252beca99 Simplify the delete stmt (#668)
Remove the restrict that delete stmt must specify partition even for unpartitioned table
2019-02-27 12:46:36 +08:00
f8865dce79 Fix bug that expanding star fails in create view (#667) 2019-02-27 11:30:35 +08:00
48450ac98f Add function's param checks in aggregation function (#666) 2019-02-27 09:41:21 +08:00
e51be0ae22 DORIS-645: Fix allocating error of constant predicate (#657)
1. The method assignConjuncts in SingleNodePlanner could not allocate constant predicate correctly.
2. It use e.isBoundByTupleIds() which always return ture whatever tupleIds when e is a constant predicate.
3. I use PlanNode assignConjuncts instead of SingleNodePlanner's.
2019-02-26 10:55:49 +08:00
397747af2c Fix bug that push down the predicates past AggregateNode (#658) 2019-02-26 10:55:14 +08:00
820894ca70 Fix wrong type length when show full columns (#648) 2019-02-21 09:41:45 +08:00
19d37afe74 Fix some tablet scheduler bug (#644)
1. Replica in CLONE state should be deleted when schedule finished
2. Set replica as bad if the only remained replica is missing
2019-02-20 16:54:24 +08:00
d872f79496 Handle unused disks and tablets report (#633)
When Backend report unused replica, which means this replica
is bad, Frontend should set this replica as bad and repair it.
Also, when a disk is reported unused, Frontend should mark this
disk as OFFLINE. And no more replica will be assigned to this
disk.

We also add 3 new metrics: disk_state, tablet_num and scheduled_tablet_num
on Frontend to monitor the disk state and number of tablet on each Backend.
2019-02-18 10:20:56 +08:00
d3cd31fb81 Fix colocate table not delete tablet in backend bug (#626) 2019-02-15 09:13:29 +08:00
192c1237de Update year in Notice file (#618)
* Update year in Notice file
* Change use_new_tablet_scheduler default value
2019-02-01 16:01:07 +08:00
0c864c47f8 Unify version information (#617) 2019-02-01 15:36:22 +08:00
381bef88ca Fix bug that CreateReplicaTask use wrong parameter (#616)
The dbId in CreateReplicaTask does not set correctly,
which may cause incorrect report result.
2019-02-01 13:38:23 +08:00
d5b9947d3e Optimize edit log write operation (#615)
1. No need to write edit log for init replica version sync.
2. Add a metric to monitor edit log size in bytes
2019-02-01 11:17:29 +08:00
171eaa642f Fix BackendsProcDirTest ut (#612) 2019-01-31 20:09:15 +08:00
100eeb18cd Add test for colocate table (#587) 2019-01-31 19:23:12 +08:00
af445b6cc2 Optimize something (#607)
1. Unify the thrift rpc timeout from BE to FE.
    Add a BE config 'thrift_rpc_timeout_ms', default is 5000
2. Add hostname in "show proc '/frontends';" stmt result.
3. Fix a lock order bug in Load.java
2019-01-31 13:30:45 +08:00
ca2ab5da59 Add more thrift log (#605) 2019-01-30 21:28:42 +08:00
08376b0557 Catch throwable in mysql listener thread (#603)
Also add thrift log to fe.log
2019-01-30 15:09:58 +08:00
3b23b01d12 Recovery tablet only when tablet version is missing (#601) 2019-01-29 21:17:41 +08:00
daa9d975ca Fix bugs of Tablet Scheduler (#600) 2019-01-29 15:35:07 +08:00
67cdc723ac Fix bug that only REPLICA_MISSING repair need to create a new replica (#590) 2019-01-25 17:56:42 +08:00
9d71a930a2 Fix bug that repair slot may not be released when clone finished (#589) 2019-01-25 16:49:15 +08:00
9a272f0592 Optimize something (#585)
1. Optimize the error msg of Tablet scheduler.
2. Missing helper nodes info when modify Frontends.
3. Fix bug that olap tablet's header lock is not released.
2019-01-25 14:27:33 +08:00
bc7e7409ca Allow repair VERSION_IMCOMPLETE tablet when ALTERing table (#583)
Previously we do not allow repair tablet if the table it belongs
to is under ALTER process. But it will possibly let the alter job
failed due to some replica's failure of load.
2019-01-24 15:39:05 +08:00
cd7a2c3fd5 Refactor CreateTableTest (#579) 2019-01-24 13:56:41 +08:00
aeb89ab4d3 Add ColocateMetaService (#562) 2019-01-24 11:20:12 +08:00
c82879cb2e Fix bug that heartbeat error msg may be null (#574) 2019-01-23 17:24:29 +08:00
079141e14a Add disk usage percent in SHOW BACKEND stmt (#571) 2019-01-23 14:08:33 +08:00
9e240d432a Fix replica version report bug (#569)
Replica with version hash equals to 0 should be handled correctly.
2019-01-22 16:48:24 +08:00
e11bdf2db5 Remove unit of measurement about query statistics in audit log (#568) 2019-01-22 14:38:39 +08:00
09df294898 Fix some bugs (#566)
1. Backup obj should set state to NORMAL.
2. Replica with version 1-0 should be handled correctly.
2019-01-22 12:21:55 +08:00
e80f6ed86a Fix uncorrect hll type length when creating table (#565) 2019-01-22 11:22:49 +08:00
f7155217bf Remove build rows counter in PartitionHashJoinNode (#557)
* Remove build rows counter in PartitionHashJoinNode
* Fix unit test fail in RuntimeProfileTest
* Add check for result type length in cast_to_string_val
2019-01-21 14:08:59 +08:00
54e98f6964 Auto fix missing version replica (#560) 2019-01-21 08:56:43 +08:00