0dc0dadad1
Reduce unnecessary memory allocat and copy in OlapScanNode ( #1742 )
2019-09-04 21:05:12 +08:00
a84c64785f
Shuffle partitioned instance to avoid skew ( #1744 )
2019-09-04 18:31:18 +08:00
726509e9b9
Add MIN/MAX aggregate function compatible with char/varchar ( #1739 )
2019-09-04 17:28:27 +08:00
a63989cc61
Use RowsetFactory to create and init RowsetWriter ( #1740 )
2019-09-04 17:02:43 +08:00
fddfffe4c0
Fix bug that failed to create a new partition when no partition in a table ( #1688 )
2019-09-04 13:36:17 +08:00
03b399150e
Not add alter task to tablet in alter tablet request v2 ( #1741 )
2019-09-03 21:34:52 +08:00
f76dad289e
Basic implementation for BetaRowsetReader ( #1718 )
2019-09-03 13:52:16 +08:00
9f5e5717d4
Unify the msg of 'Memory exceed limit' ( #1737 )
...
The new msg of limit exceed: "Memory exceed limit. %msg, Backend:%ip, fragment:%id Used:% , Limit:%. xxx".
This commit unifies the msg of 'Memory exceed limit' such as check_query_state, RETURN_IF_LIMIT_EXCEEDED and LIMIT_EXCEEDED.
2019-09-03 10:42:16 +08:00
a80e9996a6
Move version to high 8 bit ( #1736 )
2019-09-02 19:43:04 +08:00
b4f6f755f1
Add exchange in MemPool to reduce alloc/free operation ( #1732 )
...
Reuse allocated chunks when storage read operation.
2019-09-02 19:29:30 +08:00
8034d83e20
Add scroll keepalive and http timeout configuration ( #1731 )
2019-09-02 19:04:30 +08:00
6f4feca3dc
Add rowset id generator to FE and BE ( #1678 )
2019-09-02 18:51:31 +08:00
81ca3e3abf
Free olap scanner out of lock ( #1733 )
...
Close scanner out of OlapScanner's batch lock,
which will lead all scanners wait for one scanner to finish.
2019-09-02 16:49:28 +08:00
ba170aa9e6
Fix NPE of DataDescription ( #1735 )
...
When user does not specify column mapping in BrokerLoadStmt, NPE may be thrown.
2019-09-02 16:03:26 +08:00
f87abd93c8
Modify the website ( #1730 )
...
1. Add Apache incubator disclaimer.
2. Add "Edit on Github" button on every page.
3. Add Committer Ling Miao.
4. Modify some English documents.
2019-08-31 19:49:44 +08:00
1164264e9d
Add English version Doris website ( #1729 )
2019-08-30 22:07:24 +08:00
76987275b9
Fix result of unix_timestamp() ( #1727 )
2019-08-30 21:39:16 +08:00
06b87d998a
Error check about column which has no default value ( #1728 )
...
This commit check the all of parsed column include hadoop function and other function.
Otherwise, the load will thrown the "Column has no default value" exception while the column also has been defined by a non-hadoop function.
2019-08-30 20:23:32 +08:00
206f5394ee
Limit V2 segment file row count ( #1647 ) ( #1705 )
2019-08-30 18:54:37 +08:00
3a33f3d350
Make bitmap_union agg column support insert into and broker load ( #1721 )
2019-08-30 14:44:51 +08:00
378ce8ca04
Use double when converting TIME type value ( #1722 )
...
TIME type value is saved in DOUBLE, so using int64 can extend the time range.
2019-08-29 21:19:19 +08:00
ecbdfc2cee
Avoid consistency problem when has no more data ( #1716 )
2019-08-29 18:57:49 +08:00
7a0c7f45b2
Add English documents for Doris ( #1719 )
...
The english documents is translated by machine. So It may has some mistake.
We will fix them later
2019-08-29 13:47:15 +08:00
056a9fada3
fix delete bug ( #1720 )
2019-08-29 10:42:04 +08:00
c541c3fd59
Fix bug that failed to get enough normal replica because path hash is not set. ( #1714 )
...
Path Hash of a replica in metadata should be set immediately after replica is created.
And we should not depend on path hash to find replicas. Because path hash may be set
delayed.
2019-08-28 19:37:38 +08:00
2159293d23
Fix code's license ( #1715 )
2019-08-28 18:08:26 +08:00
6865f4238b
Add limit to show tablet stmt ( #1547 )
...
Also add some where predicates for filtering results
ISSUE #1687
2019-08-28 16:25:12 +08:00
0c2e344f45
Refactor DateLiteral class in FE ( #1644 )
...
1. Add FE time zone function support
2. Refactor DateLiteral class in FE
ISSUE #1583
2019-08-27 22:20:06 +08:00
7e981b2b14
Limit the disk usage to avoid running out of disk capacity ( #1702 )
...
Set high watermark and flood stage of disk used capacity.
And forbid some operations if disk usage is too high.
2019-08-27 22:18:17 +08:00
b6b860c808
Make the max recursion depth of distribution pruner configurable ( #1709 )
...
Add a new FE config 'max_distribution_pruner_recursion_depth'.
2019-08-27 22:17:07 +08:00
c6dfe83b6d
Add particular log info for doris on es ( #1711 )
2019-08-27 22:16:28 +08:00
dc2d49fe07
Make StringValue's memory layout same with Slice ( #1712 )
...
In our storage engine's code, we cast StringValue to Slice. Because
their memory layout is different, it may cause BE process crash.
We make their memory layout same in this patch to resolve this problem
temporary. We should improve it some day.
2019-08-27 22:15:46 +08:00
34a6e06cb1
fix from string bug( #1710 ) ( #1713 )
2019-08-27 18:43:49 +08:00
ae22d5e682
Support multiple key ranges in RowwiseIterator and StorageReadOptions ( #1704 )
...
support multiple key ranges in RowwiseIterator and StorageReadOptions
remove unused fields and member functions in RowBlock and ColumnData
read num_rows_per_block from short key index footer
2019-08-27 17:57:42 +08:00
c403343c0a
Add donating to ASF in README ( #1708 )
2019-08-27 15:22:46 +08:00
a1b92768dd
Add a loaded rows in SHOW LOAD result ( #1686 )
...
Loaded rows will be updated periodically by query report. So that
user can see that a load job is still running or being blocked.
2019-08-27 14:13:47 +08:00
58801c6ab0
Support converting RowBatch and RowBlockV2 to/from Arrow ( #1699 )
2019-08-27 11:30:00 +08:00
24afed7da8
Optimize V2 BinaryPlainPage format ( #1648 ) ( #1694 )
2019-08-26 21:43:28 +08:00
1e4dd77d2a
Add bitmap agg type and udaf ( #1610 )
2019-08-26 14:24:42 +08:00
da8b9aad9a
Remove preaggregation and index stream cache stuff out of RowsetReaderContext ( #1698 )
2019-08-26 14:19:03 +08:00
6d040a33af
Add zone map page( #1390 ) ( #1633 )
2019-08-24 00:57:30 +08:00
b28f4242c3
Add config max_concurrent_task_num_per_be ( #1693 )
...
This config is used to control the max concurrent task num per be.
The cluster max concurrent task num = max_concurrent_task_num_per_be * number of be.
2019-08-24 00:56:40 +08:00
4449316d85
Add error msg when memory limit exceeded ( #1685 )
2019-08-23 11:13:01 +08:00
c73b3f15a4
Update tablet-repair-and-balance doc ( #1692 )
2019-08-22 21:31:56 +08:00
00f8040bf3
Fix bug that 2 same stream load jobs may both be able to executed successfully ( #1690 )
...
This will cause 2 jobs trying to write same file, and cause file damaged.
2019-08-22 19:38:16 +08:00
2b2bc82ae2
Add timeout on snapshot of data ( #1672 )
...
Release snapshot when finishing or cancelling backup/restore job.
Snapshot may takes a lot disk space if not releasing them in time.
2019-08-21 21:18:53 +08:00
0792e06eed
Fix NPE of insert load job persist operation ( #1683 )
...
tracking url may be null
2019-08-21 20:30:55 +08:00
9f50f84b68
Fix bug: "SHOW DATA" or "SHOW PARTITIONS", the DATA-SIZE less than 0 ( #1680 )
2019-08-21 15:33:26 +08:00
978b1ee1af
Add strict mode in Routine load, Stream load and Mini load ( #1677 )
2019-08-20 21:56:45 +08:00
0a27ef030b
Reduce the number of partition info in BrokerScanNode param ( #1675 )
...
And we should reduce the number of partition info in BrokerScanNode param if user already
set target partitions to load, instead of adding all partitions' info.
It will cause the size of RPC packet too large.
2019-08-20 19:30:57 +08:00
