Commit Graph

18263 Commits

Author SHA1 Message Date
8fbc043f93 Change ByteBuffer to StorageByteBuffer in olap/byte_buffer.h (#341)
Class definition of ByteBuffer duplicates between olap/byte_buffer.h and util/byte_buffer.h.
All of the two classes has a function names as remaining().
Some place which want to call remaining() of util/byte_buffer.h is linked to the other remaining() function of olap/byte_buffer.h
2018-11-22 23:18:33 +08:00
cec1b971f6 Add special add_column_statistics method for linked_schema_change (#337) 2018-11-22 15:39:00 +08:00
f9494cbdf2 Fix a compile issue of DORIS_GCC_HOME (#339) 2018-11-22 12:32:14 +08:00
f2df5d523d Fix compile issue of thirdparty library (#338) 2018-11-22 11:15:42 +08:00
485db34f1e Modify partition's version name to what it means (#334)
* Modify partition's version name to what it means.

1. committedVersion(Hash) -> visibleVersion(Hash)
2. currentVersion(Hash) -> committedVersion(Hash)
3. add some comment to make the code more readable

* Check if editlog is null in CatalogIdGenerator
    To avoid unit test failure
2018-11-21 19:21:16 +08:00
fbde6a8636 Support for custom build toolchains (#330)
* Support for custom build toolchains

ISSUE #297

Locate the header file path of DORIS_GCC_HOME, add them to the CPLUS_INCLUDE_PATH environment variable.
So clang can find it.

* Compatible with custom toolchain for clang

ISSUE #297

1. Find default header file paths of DORIS_GCC_HOME and set as enviroment variable CLANG_COMPATIBLE_FLAGS.
2. Explicitly add these paths to CLANG_INCLUDE_FLAGS.
2018-11-21 15:58:12 +08:00
b57dfd4dd3 Fix a compile issue (#331)
* Fix a compile issue

* Fix a compile issue
2018-11-20 20:06:36 +08:00
791e89568e Change PaloMetrics' name and Catalog's Id generator (#329)
* Change PaloMetrics' name and Catalog's Id generator
1. Remove 'Palo' prefix of class Metric.
2. Add a new CatalogIdGenerator to replace the old AtomicLong, to avoid too many edit logs.
3. Add a new histogram to monitor write letency of edit log write.

* modify next id logic

* fix a bug that Metric is not init before using HISTO_EDIT_LOG_WRITE_LATENCY

* fix a problem
2018-11-20 18:59:18 +08:00
9a2ad18428 Add path info of replica in catalog (#327)
Add path info of replica in catalog

Also fix a bug that when calling check_none_row_oriented_table,
store is null, it cannot be used to create table.
Instead, OLAPHeader can be used to get storage type information.
2018-11-19 17:42:46 +08:00
dddaacc2d7 Fix fe.conf audit_log_moudles,sys_log_roll_mode,audit_log_roll_mode settings (#326) 2018-11-17 22:18:19 +08:00
fec3c58655 Change log verbose level to vlog(3) (#325)
* Transform row-oriented table to columnar-oriented table

* Transform row-oriented table to columnar-oriented table

* change log verbose level
2018-11-16 17:17:39 +08:00
b946f20e37 Add docker dev environment (#301)
Add a docker based dev environment.
User can build Doris from source in docker container.
2018-11-16 16:35:08 +08:00
1ba8a4ee4e Transform row-oriented table to columnar-oriented table (#311) 2018-11-16 16:03:56 +08:00
0aea149c0b Fix core local value UT failed (#324)
Issue: #323
2018-11-16 15:27:16 +08:00
e9bf332994 Fix fe.conf audit_log_moudles default value error (#321) 2018-11-16 08:54:57 +08:00
44029937e4 Add scheduler routine load job for stream load (#313)
1. fetch need_scheduler routine load job
2. caculate current concurrent task number of job
3. divide kafka partition into tasks
2018-11-15 21:04:22 +08:00
8ac9492b11 Fix SHOW BACKENDS return ERROR (#320)
In some case, errMsg in Backend maybe null. we change it when check it
nut null

Issue: #317
2018-11-15 20:14:39 +08:00
f1b673503e Fix lose of be's meta data bug (#318)
Modify rocksdb's WriteOptions.sync to true
to force sync WAL to disk every write operation
2018-11-15 19:23:42 +08:00
a2b299e3b9 Reduce UT binary size (#314)
* Reduce UT binary size

Almost every module depend on ExecEnv, and ExecEnv contains all
singleton, which make UT binary contains all object files.

This patch seperate ExecEnv's initial and destory to anthor file to
avoid other file's dependence. And status.cc include debug_util.h which
depend tuple.h tuple_row.h, and I move get_stack_trace() to
stack_util.cpp to reduce status.cc's dependence.

I add USE_RTTI=1 to build rocksdb to avoid linking librocksdb.a

Issue: #292

* Update
2018-11-15 16:17:23 +08:00
d7ee57e881 Optimize quota unit (#309)
Originally, we can only set quota in bytes unit. This commit add quota unit:K/KB/M/MB/G/GB/T/TB/P/PB
for convenience.
2018-11-15 14:03:52 +08:00
3a878fcf09 Improve build script (#305) 2018-11-14 14:10:46 +08:00
c6df9b1e2d Make BE UT success (#304) 2018-11-13 19:17:51 +08:00
063f7d7a9a Fix code LICENSE for file modified from LevelDB. (#300) 2018-11-12 16:09:40 +08:00
ae8d16c81e Fix failed cases in regression test (#299) 2018-11-12 11:15:39 +08:00
e8b4ebd4c5 Correct TxnKey comment (#295) 2018-11-10 15:49:10 +08:00
2081b7fea5 Be compatible with old RPC (#296)
Add palo.PInternalService which can server old version palo's client.

Issue: #293
2018-11-10 15:46:45 +08:00
6f206ae9c6 Fix some license (#290) 2018-11-09 14:30:09 +08:00
a1a795442a Fix be build error (#289)
#288
2018-11-09 10:39:03 +08:00
1d8fc4bb69 Improve cardinality, avgRowSize, numNodes stat info in OlapScanNode (#256)
Currently, the cardinality, avgRowSize, numNodes stat info in OlapScanNode is none, So the broadcastCost and partitionCost are both wrong and Doris couldn't auto choose a best join strategy.

So we should make the statistical information in OlapScanNode more precise.
2018-11-07 13:59:05 +08:00
fc8f78d81c Fix unit test failure (#286) 2018-11-07 12:53:11 +08:00
0c4edc2b3c Fix BE can't be grayscale upgraded (#285) 2018-11-07 09:34:39 +08:00
370e73ce5d Fix truncation error in CastExpr (#283) 2018-11-06 18:57:13 +08:00
8d7bd01a71 Simplify constant Expr (#255)
Simplify constant Expr could improve Partition Pruning. The examples for constant Expr Simplifing:

1 + 1 + 1 --> 3
date_add('2018-08-08', 1) --> 2018-08-09
year('2018-07-24')*12 + month('2018-07-24') -> 24223
2018-11-06 17:24:54 +08:00
acb332833a Fix view missed parenthesis bug (#253) 2018-11-06 15:25:40 +08:00
cb36e411e9 Support AnalyticExpr in View (#248) 2018-11-05 20:39:21 +08:00
8b665a41c8 Support NULLS LAST and NULLS FIRST syntax (#252)
Allow User specify the null ordering

NULLS FIRST: specifies that NULL values should be returned before
non-NULL values.
NULLS LAST: specifies that NULL values should be returned after
non-NULL values.
2018-11-05 20:35:10 +08:00
9ae631adb6 Fix InsertStmt reAnalyze bug (#251) 2018-11-05 15:36:40 +08:00
38e493df0b Fix typo in READEME.md (#278) 2018-11-05 14:12:11 +08:00
9c3620047a Fix BE can't be started by start_be.sh (#281) 2018-11-05 11:21:51 +08:00
c877b43013 Remove my aes and fix palo ns to doris (#277) 2018-11-02 17:05:48 +08:00
69f3b02485 Fix a bug that user can not kill it own connection (#276) 2018-11-02 16:36:59 +08:00
312dfd10bb Change SQL built-in function's symbol (#274) 2018-11-02 16:24:21 +08:00
847d29e394 Delete useless debug log (#250) 2018-11-02 16:06:01 +08:00
d57e91db6e Rewrite aes encryption (#264)
Resolve #257
2018-11-02 15:26:31 +08:00
b87de7e78e Update README.md and build.sh (#273)
change some 'palo' to 'doris'
2018-11-02 15:23:44 +08:00
c92892bbb9 Fix UnionStmt toSql bug (#249) 2018-11-02 14:50:09 +08:00
305762e96a Fix unit test failed in BE (#269) 2018-11-02 13:03:15 +08:00
37b4cafe87 Change variable and namespace name in BE (#268)
Change 'palo' to 'doris'
2018-11-02 10:22:32 +08:00
ad12d907da Failed to register equal conjuncts which refer more than three tuples (#266)
Change-Id: I7eaf28ee6db35671971108f3edefe908d46ae87f
2018-11-01 20:34:48 +08:00
cccd1292fe Make class name compatible with the old name (#267)
We wrote the old name 'com.baidu.palo.xxx' in bdbje as meta journal.
So we need to make it compatible with 'org.apache.doris.xxx'.
2018-11-01 19:23:10 +08:00