hcq/TurboPFor-Integer-Compression
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Readme

Browse Source
This commit is contained in:
x
2017-01-03 23:31:47 +01:00
parent 4a57cd36d7
commit 8ef2554d6b
1 changed files with 41 additions and 43 deletions
Download Patch File Download Diff File Expand all files Collapse all files

84
README.md
View File

@ -66,27 +66,27 @@ CPU: Skylake i7-6700 w/ only 3.7GHz gcc 6.2 single thread
|C Size|ratio%|Bits/Integer|C MI/s|D MI/s|Name|
|--------:|-----:|--------:|----------:|----------:|--------------|
|62939886| 15.7| 5.04|**392.67**|**2311.32**|**TurboPFor256**|
|63392759| 15.8| 5.07|329.70|1608.42|**TurboPFor**|
|63392801| 15.8| 5.07|326.18|230.97|**TurboPForDA**|
|65060504| 16.3| 5.20|15.77|687.13|[FP.SIMDOptPFor](#FastPFor)|
|65359916|16.3| 5.23| 7.58| 609.12|PC.OptPFD|
|73477088|18.4| 5.88|101.68| 621.37|PC.Simple16|
|73481096| 18.4| 5.88|155.16|2187.15|[FP.SimdFastPFor](#FastPFor)|
|76345136| 19.1| 6.11|245.21|652.78|**VSimple**|
|95915096|24.0| 7.67| 211.79|957.62|Simple-8b|
|99910930| 25.0| 7.99|**3289.58**|**2968.35**|**TurboPackV**|
|99910930| 25.0| 7.99|2122.43|2345.68|**TurboPack**|
|99910930| 25.0| 7.99|2105.47|2218.79|**TurboFor**|
|100332929| 25.1| 8.03|**3580.42**|**2998.17**|**TurboPack256V**|
|101015650| 25.3| 8.08|2380.40|2371.07|**TurboVByte**|
|101879302| 25.5| 8.15|65.16|2140.87|[QMX](#QMX)|
|102074663| 25.5| 8.17|1427.73|1979.27|[MaskedVByte](#MaskedVByte)|
|102074663| 25.5| 8.17|564.60|1052.28|[PC.Vbyte](#PolyCom)|
|102083036| 25.5| 8.17|1300.35|1067.45|[FP.VByte](#FastPFor)|
|112500000| 28.1| 9.00|381.85|**3034.90**|[VarintG8IU](#VarintG8IU)|
|125000000| 31.2|10.00|1110.68|2948.33|[StreamVbyte](#StreamVByte)|
|400000000| 100.00| 32.00| 2240.24|2237.05|Copy|
|62939886| 15.7| 5.04|**397**|**2311**|**TurboPFor256**|
|63392759| 15.8| 5.07|330|1608|**TurboPFor**|
|63392801| 15.8| 5.07|326|231|**TurboPForDA**|
|65060504| 16.3| 5.20|15|687|[FP.SIMDOptPFor](#FastPFor)|
|65359916|16.3| 5.23| 8| 609|PC.OptPFD|
|73477088|18.4| 5.88|102| 621|PC.Simple16|
|73481096| 18.4| 5.88|156|2187|[FP.SimdFastPFor](#FastPFor)|
|76345136| 19.1| 6.11|245|653|**VSimple**|
|95915096|24.0| 7.67| 212|958|Simple-8b|
|99910930| 25.0| 7.99|**3290**|**2968.35**|**TurboPackV**|
|99910930| 25.0| 7.99|2122|2347|**TurboPack**|
|99910930| 25.0| 7.99|2105|2219|**TurboFor**|
|100332929| 25.1| 8.03|**3580**|**2998.17**|**TurboPack256V**|
|101015650| 25.3| 8.08|2380|2371|**TurboVByte**|
|101879302| 25.5| 8.15|65|2141|[QMX](#QMX)|
|102074663| 25.5| 8.17|1428|1979|[MaskedVByte](#MaskedVByte)|
|102074663| 25.5| 8.17|565|1052|[PC.Vbyte](#PolyCom)|
|102083036| 25.5| 8.17|1300|1067|[FP.VByte](#FastPFor)|
|112500000| 28.1| 9.00|382|**3035**|[VarintG8IU](#VarintG8IU)|
|125000000| 31.2|10.00|1111|2948|[StreamVbyte](#StreamVByte)|
|400000000| 100.00| 32.00| 2240|2237|Copy|
| | | | N/A | N/A |EliasFano|
@ -96,35 +96,33 @@ FP=FastPFor SC:simdcomp PC:Polycom<br>
TurboPForDA,TurboForDA: Direct Access is normally used when accessing few individual values.
------------------------------------------------------------------------
##### - Data files (2016):
- CPU: Sandy bridge i7-2600k at 4.2GHz
##### - Data files:
- gov2.sorted from [DocId data set](#DocId data set) Block size=128 (lz4+blosc+VSimple w/ 64Ki)
./icbench -fS -r gov2.sorted
|Size |Ratio %|Bits/Integer|C Time MI/s|D Time MI/s|Function |
|-----------:|------:|-----:|-------:|-------:|---------------------|
| 3.319.692.190| 13.88| 4.44|**336.68**|**1410.74**|**TurboPFor**|
| 3.337.758.854| 13.95| 4.47| 5.06| 513.00|PC.OptPFD|
| 3.357.673.495| 14.04| 4.49|**357.77**|**1192.14**|**TurboPFor**|
| 3.501.671.314| 14.64| 4.68| 321.45| 827.01|**VSimple**|
| 3.766.174.764| 15.75| 5.04|**617.88**| 712.31|**EliasFano**|
| 3.820.190.182| 15.97| 5.11| 118.81| 650.21|Simple16|
| 4.521.326.518| 18.90| 6.05| 209.17| 824.26|Simple-8b|
| 4.647.699.724| 19.43| 6.22|**889.02**|1130.50|**TurboVbyte**|
| 4.683.323.301| 19.58| 6.27|**828.97**|1007.44|**TurboVbyte**|
| 4.953.768.342| 20.71| 6.63|**1766.05**|**1943.87**|**TurboPackV**|
| 4.953.768.342| 20.71| 6.63|1419.35|1512.86|**TurboPack**|
| 5.203.353.057| 21.75| 6.96|1560.34|1806.60|SIMDPackD1 FPF|
| 6.221.886.390| 26.01| 8.32|1666.76|1737.72|**TurboFor**|
| 6.221.886.390| 26.01| 8.32|1660.52| 565.25|**TurboForDA**|
| 6.699.519.000| 28.01| 8.96| 472.01| 495.12|Vbyte FPF|
| 6.700.989.563| 28.02| 8.96| 728.72| 991.57|MaskedVByte|
| 7.622.896.878| 31.87|10.20| 208.73|1197.74|VarintG8IU|
| 8.594.342.216| 35.93|11.50|1307.22|1593.07|libfor|
|23.918.861.764|100.00|32.00|1456.17|1480.78|Copy|
| 3.321.663.893| 13.9| 4.44|**328**|**1452**|**TurboPFor**|
| 3.337.758.854| 14.0| 4.47| 5| 513|PC.OptPFD|
| 3.350.717.959| 14.0| 4.48|**365**|**1744**|**TurboPFor256**|
| 3.501.671.314| 14.6| 4.68| 322| 827|**VSimple**|
| 3.766.174.764| 15.8| 5.04|**618**| 712|**EliasFano**|
| 3.820.190.182| 16.0| 5.11| 119| 650|PC.Simple16|
| 4.521.326.518| 18.9| 6.05| 209| 824|Simple-8b|
| 4.647.699.724| 19.4| 6.22|**889**|1131|**TurboVbyte**|
| 4.953.768.342| 20.7| 6.63|1419|1513|**TurboPack**|
| 4.955.740.045| 20.7| 6.63|**1766**|**2567**|**TurboPackV**|
| 5.203.353.057| 21.8| 6.96|1560|1807|FP.SIMDPackD1|
| 5.393.769.503| 22.5| 7.21|**2251.43**|**2715.30**|**TurboPackV256**|
| 6.221.886.390| 26.0| 8.32|1667|1738|**TurboFor**|
| 6.221.886.390| 26.0| 8.32|1661| 565|**TurboForDA**|
| 6.699.519.000| 28.0| 8.96| 472| 495|FP.Vbyte|
| 6.700.989.563| 28.0| 8.96| 729| 992|MaskedVByte|
| 7.622.896.878| 31.9|10.20| 209|1198|VarintG8IU|
| 8.594.342.216| 35.9|11.50|1307|1594|libfor|
|23.918.861.764|100.0|32.00|1456|1481|Copy|
|Size |Ratio %|Bits/Integer|C Time MI/s|D Time MI/s|Function |