daiduo/TurboPFor-Integer-Compression
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

New functions + Integer Lists Intersection

Browse Source
This commit is contained in:
powturbo
2015-01-06 20:13:36 +01:00
parent da98a9d927
commit 6050de1439
1 changed files with 1 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
README.md
View File

@ -24,7 +24,7 @@ TurboPFor: Fastest Integer Compression [![Build Status](https://travis-ci.org/po
- Instant access to compressed *frequency* and *position* data in inverted index with zero decompression - Instant access to compressed *frequency* and *position* data in inverted index with zero decompression
- **New:** Inverted Index Demo + Benchmarks: Intersection of lists of sorted integers. - **New:** Inverted Index Demo + Benchmarks: Intersection of lists of sorted integers.
- more than **1000 queries per second** on gov2 (25 millions documents) on a **SINGLE** core. - more than **1000 queries per second** on gov2 (25 millions documents) on a **SINGLE** core.
- Decompress only the minimum necessary blocks (Ex. 10-15% for 1MQT/AOL on GOV2). - Decompress only the minimum necessary blocks (Ex. 10-15%).
# Benchmark: # Benchmark:
CPU: Sandy bridge i7-2600k at 4.2GHz, gcc 4.9, ubuntu 14.10, Single thread. CPU: Sandy bridge i7-2600k at 4.2GHz, gcc 4.9, ubuntu 14.10, Single thread.
@ -125,7 +125,6 @@ CPU: Sandy bridge i7-2600k at 4.2GHz, gcc 4.9, ubuntu 14.10, Single thread.
run queries in file "1mq.txt" over the index of gov2 file run queries in file "1mq.txt" over the index of gov2 file
8GB RAM required (16GB recommended for benchmarking "clueweb09" files). 8GB RAM required (16GB recommended for benchmarking "clueweb09" files).
Results on a single core Sandy-bridge CPU
## Function usage: ## Function usage:
In general compression/decompression functions are of the form: In general compression/decompression functions are of the form: