ea71472d64
[fix](build index) fix core when build index for a new column which without data ( #32550 ) ( #32669 )
...
Co-authored-by: Luennng <luennng@gmail.com >
Co-authored-by: Tanya-W <tanya1218w@163,com>
2024-03-22 15:05:19 +08:00
ecadb60bcd
[Pick 2.1](inverted index) support inverted index format v2 ( #30145 ) ( #32418 )
2024-03-19 08:11:33 +08:00
779ca464a5
[Fix](Status) Handle returned overall Status correctly ( #31692 )
...
Handle returned overall Status correctly
2024-03-09 19:44:39 +08:00
61bab1f1c0
[Fix](inverted index) fix data size when drop inverted index ( #30327 )
2024-01-25 13:24:52 +08:00
a314491535
[Fix](inverted index) fix array inverted index builder error ( #29869 )
2024-01-12 13:58:19 +08:00
fa4721125e
[Fix](show data) Inverted index size not added to data size after index build ( #29568 )
2024-01-05 16:21:45 +08:00
7398c3daf1
[Feature-Variant](Variant Type) support variant type query and index ( #27676 )
2023-11-29 10:37:28 +08:00
d767804815
[feature](merge-cloud) Decouple rowset id generator and local rowsets gc implementation ( #25921 )
2023-11-10 10:07:02 +08:00
9c9fc84f39
[feature](merge-cloud) Abstract BaseTablet for CloudTablet ( #24929 )
2023-10-18 20:29:04 +08:00
239df5860b
[enhancement](tablet_meta_lock) add more trace for write lock of tablet's _meta_lock ( #25095 )
2023-10-08 10:28:10 +08:00
642e5cdb69
[Fix](Status) Make Status [[nodiscard]] and handle returned Status correctly ( #23395 )
2023-09-29 22:38:52 +08:00
9c6734e68e
[bugfix](index) Fix build index limitations ( #24358 )
...
1. skip existed index on column with different id on build index
2. allow build index for CANCELED or FINISHED state
2023-09-14 17:53:22 +08:00
f7a3d2778a
[FIX](array)update array olapconvertor and support array nested other complex type ( #23489 )
...
* update array olapconvertor and support array nested other complex type
* update for inverted index
2023-08-29 16:18:11 +08:00
d4694167a8
[Enhancement](chore) Some Status relevant enhancement ( #23072 )
2023-08-21 14:14:38 +08:00
f0ad3ef244
[fix](merge-on-write) should use write lock of tablet's header lock in #23047 ( #23161 )
2023-08-18 17:50:44 +08:00
e6fe8c05d1
[fix](inverted index change) fix update delete bitmap incompletely when build inverted index on mow table ( #23047 )
2023-08-18 11:15:39 +08:00
de98324ea7
[fix](inverted index change) make mutex for ALTER_INVERTED_INDEX task and STORAGE_MEDIUM_MIGRATE task ( #22995 )
2023-08-18 08:35:30 +08:00
00c48f7d46
[opt](regression case) add more index change case ( #21734 )
2023-07-12 21:52:48 +08:00
ca71048f7f
[Chore](status) avoid empty error msg on status ( #21454 )
...
avoid empty error msg on status
2023-07-11 13:48:16 +08:00
cf1efce824
[fix](inverted index) use index id instead of column uid to determine whether a hard link is required when build index ( #21574 )
...
Fix problem:
For the same column, there are concurrent drop index request and build index request, if build index obtain lock before drop index, build a new index file, but when drop index request execute, link file not contains all index files for the column, that lead to new index file is missed.
Based on the above questions, use index id instead of column unique id to determine whether a hard link is required when do build index
2023-07-09 16:45:27 +08:00
a2e679f767
[fix](status) Return the correct error code when clucene error occured ( #21511 )
2023-07-06 09:08:11 +08:00
92882ebd91
[fix](inverted index) update output rowset index meta with input rowset when drop inverted index ( #21248 )
2023-06-27 23:54:35 +08:00
d545e00bc7
[improve](error) include detailed messages in rowset reader init error ( #21229 )
2023-06-27 20:45:14 +08:00
960e04b0ed
[fix](inverted index) fix build inverted index failed but not return immediately ( #21165 )
2023-06-26 14:05:12 +08:00
ab8125d56f
[Improve](performance) introduce SchemaCache to cache TabletSchame & Schema ( #20037 )
...
* [Improve](performance) introduce SchemaCache to cache TabletSchame & Schema
1. When the system is under high-concurrency load with wide table point queries, the frequent memory allocation and deallocation of Schema become evident system bottlenecks. Additionally, the initialization of TabletSchema and Schema also becomes a CPU hotspot.Therefore, the introduction of a SchemaCache is implemented to cache these resources for reuse.
2. Make some variables wrapped with std::unique<unique_ptr>
Performance:
| 状态 | QPS | 平均响应时间 (avg) | P99 响应时间 |
|------------------|-----|------------------|-------------|
| 开启 SchemaCache | 501 | 20ms | 34ms |
| 关闭 SchemaCache | 321 | 31ms | 61ms |
* handle schema change with schema version
* remove useless header
* rebase
2023-05-29 17:34:53 +08:00
ae352997b4
[Enhancement](alter inverted index) Improve alter inverted index performance with light weight add or drop inverted index ( #19063 )
2023-05-28 11:23:07 +08:00
