Bulat_Ziganshin
Silver Member | Редактировать | Профиль | Сообщение | Цитировать | Сообщить модератору
LZMA is fine. it was problems of my HT4-enabled code. i'm going to fix it. the only real LZMA problem is dictionary >=2GB wiith BT4
Код: C:\>fazip.exe lzma:max:2000m:ht4 z:\4g m:\1200
dict=2000mb: buf=2252mb head=1536mb son=0mb
100%: 4,531,060,447 -> 805,786,088: 17.78% Cpu 2 mb/s (2216.774 sec), real 3 mb/s (1683.414 sec) = 132%
C:\>fazip.exe lzma:max:2000m:ht4:h3g z:\4g m:\1200
dict=2000mb: buf=2252mb head=3072mb son=0mb
100%: 4,531,060,447 -> 805,196,672: 17.77% Cpu 2 mb/s (2003.989 sec), real 3 mb/s (1482.672 sec) = 135%
C:\>fazip.exe lzma:max:2000m:ht4:h4095m:mc240 z:\4g m:\1200
dict=2000mb: buf=2252mb head=3840mb son=0mb
100%: 4,531,060,447 -> 797,307,062: 17.60% Cpu 1 mb/s (6574.428 sec), real 1 mb/s (5963.810 sec) = 110%
C:\>fazip.exe lzma:max:2000m:hc4 z:\4g m:\1200
dict=2000mb: buf=2502mb head=1024mb son=8000mb
100%: 4,531,060,447 -> 805,324,025: 17.77% Cpu 1 mb/s (4527.274 sec), real 1 mb/s (3902.200 sec) = 116%
C:\>fazip.exe lzma:max:2000m:bt4 z:\4g m:\1200
dict=2000mb: buf=3002mb head=1024mb son=16000mb
100%: 4,531,060,447 -> 789,564,045: 17.43% Cpu 2 mb/s (2162.330 sec), real 3 mb/s (1559.318 sec) = 139%
C:\>fazip.exe d m:\1200 m:\4g
100%: 789,564,045 -> 4,531,060,447: 17.43% Cpu 104 mb/s (41.418 sec), real 99 mb/s (43.568 sec) = 95%
C:\>fc /b Z:\4g m:\4g
Comparing files Z:\4g and M:\4G
FC: no differences encountered |
1. each 1 GB of dictionary requires 10 GB with BT4 matchfinder, 6 GB with HC4 and 1.5+ GB with HT4
2. hopefully i will fix a few remaining problems and all m/f will support dictionaries up to 4000m
3. Vanilla LZMA sources need to fix a few lines around kMaxHistorySize, LZMA_LOG_BSR, kDicLogSizeMaxCompress, numSons, prevNumSons, AllocRefs . i will publish my own fazip.exe |
) 
