daiduo/TurboPFor-Integer-Compression
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

.

Browse Source
This commit is contained in:
powturbo
2015-05-31 21:42:47 +02:00
parent 274b11f9d0
commit fd0681262f
1 changed files with 14 additions and 13 deletions
Download Patch File Download Diff File Expand all files Collapse all files

27
README.md
View File

@ -46,18 +46,18 @@ CPU: Sandy bridge i7-2600k at 4.2GHz, gcc 5.1, ubuntu 15.04, single thread.
|Size| Ratio % |Bits/Integer |C Time MI/s |D Time MI/s |Function |
|--------:|-----:|----:|-------:|-------:|---------|
| 63.392.801| 15.85| 5.07|**382.22**|**1368.25**|**TurboPFor**|
| 63.392.801| 15.85| 5.07| 362.50| 242.36|**TurboPForDA**|
| 63.392.801| 15.85| 5.07|**388.36**|**1368.25**|**TurboPFor**|
| 63.392.801| 15.85| 5.07| 365.26| 243.15|**TurboPForDA**|
| 65.359.916| 16.34| 5.23| 7.09| 638.96|OptPFD|
| 72.364.024| 18.09| 5.79| 85.31| 762.00|Simple16|
| 78.514.276| 19.63| 6.28| 249.17|809.74|**SimpleV**|
| 78.514.276| 19.63| 6.28| 249.17| 813.41|**SimpleV**|
| 95.915.096| 23.98| 7.67| 221.46|1049.70|Simple-8b|
| 99.910.930| 24.98| 7.99|**2603.47**|**1948.65**|**TurboPackV**|
| 99.910.930| 24.98| 7.99| 2524.50|1943.41|SIMDPackFPF|
| 99.910.930| 24.98| 7.99| 1298.28|1898.11|**TurboPack**|
| 99.910.930| 24.98| 7.99| 1297.83| 924.86|**TurboPackDA**|
|102.074.663| 25.52| 8.17| 1545.38|1694.64|**TurboVbyte**|
|102.074.663| 25.52| 8.17| 1210.12|1679.52|MaskedVByte|
| 99.910.930| 24.98| 7.99| 1883.21|1898.11|**TurboPack**|
| 99.910.930| 24.98| 7.99| 1877.25| 935.83|**TurboPackDA**|
|102.074.663| 25.52| 8.17| 1621.64|1694.64|**TurboVbyte**|
|102.074.663| 25.52|8.17|1214.12|1688.95|MaskedVByte|
|102.074.663| 25.52| 8.17| 1178.72| 949.59|VbyteFPF|
|112.500.000| 28.12| 9.00| 305.85|1899.15|VarintG8IU|
|400.000.000|100.00|32.00| 1451.11|1493.46|Copy|
@ -74,13 +74,13 @@ MI/s: 1.000.000 integers/second ( = 4.000.000 bytes/sec )<br>
|----------:|-----:|----:|------:|------:|---------------------|
| 3.214.763.689| 13.44| 4.30| 339.90| 837.69|**SimpleV 64k**|
| 3.337.758.854| 13.95| 4.47| 5.06| 513.00|OptPFD|
| 3.357.673.495| 14.04| 4.49|**357.77**|**1185.73**|**TurboPFor**|
| 3.501.671.314| 14.64| 4.68| 321.45| 808.42|**SimpleV**|
| 3.766.174.764| 15.75| 5.04|**615.19**| 696.89|**EliasFano**|
| 3.357.673.495| 14.04| 4.49|**357.77**|**1192.14**|**TurboPFor**|
| 3.501.671.314| 14.64| 4.68| 321.45| 813.90|**SimpleV**|
| 3.766.174.764| 15.75| 5.04|**617.88**| 712.31|**EliasFano**|
| 3.820.190.182| 15.97| 5.11| 118.81| 650.21|Simple16|
| 3.958.888.197| 16.55| 5.30| 279.19| 618.60|Lz4 64K|
| 4.521.326.518| 18.90| 6.05| 209.17| 824.26|Simple-8b|
| 4.683.323.301| 19.58| 6.27| 826.50| 987.80|**TurboVbyte**|
| 4.683.323.301| 19.58| 6.27| 828.25| 991.34|**TurboVbyte**|
| 4.953.768.342| 20.71| 6.63|**1766.05**|**1943.87**|**TurboPackV**|
| 4.953.768.342| 20.71| 6.63|1419.35|1512.86|**TurboPack**|
| 5.203.353.057| 21.75| 6.96|1560.34|1806.60|SIMDPackFPFD1|
@ -89,7 +89,7 @@ MI/s: 1.000.000 integers/second ( = 4.000.000 bytes/sec )<br>
| 7.622.896.878| 31.87|10.20| 208.73|1197.74|VarintG8IU|
|23.918.861.764|100.00|32.00|1456.17|1480.78|Copy|
lz4 w/ delta+transpose similar to [blosc](https://github.com/Blosc/c-blosc)
lz4 w/ delta+transpose similar to delta+[blosc](https://github.com/Blosc/c-blosc)
##### - Compressed Inverted Index Intersections with GOV2<br />
GOV2: 426GB, 25 Millions documents, average doc. size=18k.
@ -212,7 +212,8 @@ header files to use with documentation :<br />
### Environment:
###### OS/Compiler (64 bits):
- Linux: GNU GCC (>=4.6)
- Linux: GNU GCC (>=4.6)
- clang (>=3.2)
- Windows: MinGW-w64 (no parallel query processing)
###### Multithreading: