String Conversion/Open Bug

[Godlike-Productions]

Following on from the discussion here - #732 (reply in thread)

This actually appears to be a problem on conversion or reading of the string, rather than a gzip file.

Here's a panel that opens a .9kf file 2 different ways. The first uses the juce gzip function, the second unzips using gzip via an OS command.

The first method loads it into a memoryBlock and does the conversion there and then extracts the last 25 characters of the json string (this is before it is decoded from json - it's a raw string) It also outputs the full hex of the memoryBlock to the console. The hex is the complete file - if you take it, encode it as ASCII then the full file is created, but when we try to read the data as a string, the last characters are dropped.

The 2nd method opens the unzipped file as a String. Both fail to import the last few characters of the file.

There are 2 9kf files included, plus 2 unzipped files (they are json files, just without the extension). The second method will create these files as part of the process.

I've included the actual 25 characters in the panel, copied from an external program.

H9000 Gzip Bug_1_0_2025-11-05_15-36.zip

Any help would be great.

[Godlike-Productions]

This does seem to open and display the entire file (that has been unzipped), but only in text mode. I can't work out how to read the gzipped file in binary mode (ie "rb" as the second arguement of the first line) into a memoryBlock, and I'm not sure how to use io.open from the file browser.

f = assert(io.open("D:/\Temp/\Dynamic Send/\Drum Glitch Tension","r")) fileToConvert = f:read ("*all") console (type(fileToConvert)) console (fileToConvert)

[Godlike-Productions]

OK, if you replace chainLoadExternal with the following, it works - but this bypasses the ctrlr file load procedure, and loads using the low level LUA io library, and I can only get it to work loading as text.

function chainLoadExternal(--[[ CtrlrModulator --]] mod, --[[ number --]] value, --[[ number --]] source)

--[[
This is a list of keys that we require

Chain Name - metadata,name
Program Names - metadata, program_names - this is a comma delimited list
Slots Preset - slots,#,preset - this is a base64 gzipped json file
Internal Data is pulled from the Slots Preset
External ID - slots, #, program_metadata, id
Factory - slots, #, program_metadata, factory
Algorithm Name - slots, #, program_metadata, name

If there is no preset saved (as opposed to a psuedo preset)
Then slots, #, preset_metadata will be null

When there is a preset
External Preset ID (not always present) - slots, #, preset_metadata, preset_id
External 2 ID - slots, #, preset_metadata, program_id

Internal
Internal Alg ID - metadata, program_id
Internal Alg Name - metadata, program_name
Internal Preset ID - metadata, preset_id

--]]
 if isPanelReady() == false then -- check panel readiness
		console ("Panel Not Ready")    
        return
	    end
	
metaKey = "metadata"
programKey = "program_id"
presetIDKey = "preset_id"
nameKey = "name"
algoNameKey = "program_name"
slotsKey = "slots"
--zeroKey = "0"
--oneKey = "1"
--twoKey = "2"
--threeKey = "3"
chainName = "name"
chainAlgoKey = "preset"
programMetaKey = "program_metadata"
presetMetaKey = "preset_metadata"
idKey = "id"
presetKey = "preset"
factoryKey = "factory"
chainEnd3 = "{}]}"
chainEnd4 = "]}"
slotCount = 0
chainAlgoKey = "program_names"


savePath = L(panel:getLabelComponent("filePathLabel"):getPropertyString("uiLabelText"))
gzipPath = L(panel:getLabelComponent("gzipPathLabel"):getPropertyString("uiLabelText"))

fileToConvert = utils.openFileWindow("Open Chain File to read (*.9kf)",File(savePath),"*.9kf",true)
fileToConvertPath = fileToConvert:getFullPathName()
chainPath, chainFile, chainExtension = SplitFilename(fileToConvertPath) -- this is needed for saving
if fileToConvert:existsAsFile() then
    console ("Chain File Exists: "..fileToConvertPath)
    tempFileName = fileToConvert:getFileName()
    tempOutput = io.popen('gzip -d -S 9kf -k "'..fileToConvertPath..'"')
    
    
else
    return
end --if

local inputBlock = MemoryBlock()
local testHeader = MemoryBlock("1F 8B 08 00")

--fileToParsePath = tempFileName:getFileNameWithoutExtension()
    fileToParsePath = string.gsub(fileToConvertPath,".9kf","")
    console (String(tempFileName))
    console (fileToParsePath)

f = assert(io.open(fileToParsePath,"r"))
fileToConvert = f:read ("*all")
console (type(fileToConvert))
console (fileToConvert)
--fileToRead = utils.openFileWindow("Open json File to read (*.*)",File(savePath),"*.*",true)
--fileToRead = File(fileToParsePath)

--[[
if fileToRead:existsAsFile() then -- this needs to be checked again

    console ("File Exists")
    console ("--------- External Gzip -------------")
    str2 = fileToRead:loadFileAsString()
    console (str2)

--]]
    str2Len = string.len(fileToConvert)
    console (String(str2Len))
    lastCharacters2 = string.sub(fileToConvert,str2Len - 25,str2Len)
    panel:getLabelComponent("externalOutput"):setProperty("uiLabelText",lastCharacters2, false)
 
--end --if
end -- method

[dnaldoog]

You were right - there was a bug.

When parsing the decompressed file any \0 encountered truncated the message.
It was happening for the external gzip program as well as the Ctrlr decompressGzip() function, which means there is no bug in the gunzip process itself but rather the parsing of extracted data.

I implemented a Binary Safe function that ignores \0
toBinaryString()

So, in your code you would do something like:

if inputBlock:getSize() > 0 then
        if inputBlock:getRange(0,4):toHexString(1):upper() == testHeader:toHexString(1):upper() then
            console("Step 1: Decompressing outer gzip file...")
+           str=MemoryBlock()
-            str = inputBlock:decompressGzip()
+         str:decompressGZip()

        end --if
    end --if

-    console (str)
+  console (str:toBinaryString())

decompressGzip() now returns a MemoryBlock not a JUCE String #

Please test this binary debug build and if it is working I will submit a PR to Damien for the new release!
CtrlrX_5.6.34-Maintenance_GZIPMB_debug.zip

Output from this panel:
test GZIP truncation Eventide_1_0.zip

Decompression successful! Data size: 6949 bytes
{"dsp_mode":0,"functions":[{"subscription":null,"value":0.0},{"subscription":null,"value":0.0},{"subscription":null,"value":0.0},{"subscription":null,"value":0.0},{"subscription":null,"value":0.0},{"subscription":null,"value":0.0},{"subscription":null,"value":0.0},{"subscription":null,"value":0.0}],"master_gain":{"bypass":{"subscription":null,"values":[0]},"in_gain":{"subscription":null,"values":[0.0]},"mute":{"subscription":null,"values":[0]},"out_gain":{"subscription":null,"values":[0.0]},"tails":{"subscription":null,"values":[0]},"wet_dry_mix":{"subscription":null,"values":[100.0]}},"metadata":{"crc32":-1674915244,"effect type":{"Delay":0.8999999761581421,"Distortion":1.0,"Modulation":1.0,"Reverb":0.6000000238418579},"fxchain_id":0,"instrument type":{"Bass":1.0,"Brass":1.0,"Guitar":0.8999999761581421,"Keyboard":1.0,"Vocal":1.0},"is_factory":false,"name":"Drum Glitch Tension","product type":{"Emulation":1.0,"H8000":1.0,"H9":1.0,"H9000":1.0,"Space":1.0},"program_names":"Dynamic Send, UltraTap, Dream Chamber","software":"2.0.5[2] (ade503dd6)","version":2},"routing":{"locations":[0,5,-1,8],"routes":[[[0,[0]],[1,[1]]],[[0,[0]],[1,[1]],[8,[2]],[9,[3]]],[[0,[0,8]],[1,[1,9]]],[[0,[0]],[1,[1]]]]},"slots":[{"preset":"H4sIAAAAAAAEA5RSwU6FMBC8+xWmZyAtIDw4GuPNg/HdjCFLaaBKKbZFJS/8uy1J0RNiT9uZ2c3u7F7QrZTahLJ+jTAqbyIcoHvF3j1wwsRBD7JhHrLfRx+v5LlTTHceCknsMqBvqxb4gMoLqucRtHaRnmpNFR8Nl5YZpr4P0Af0E7PsM35ZAsSHLW1fHK1yMRl2rLCczL8qG+D9wZ4NE6OshPXoWCufzFSNmivBv/5MIBi7Sa0zYAzQN28zjiyzPpIWmJCMeEVJ9jQNozDvCbpZG2YXyrVXJW6fghlowIBreFSyVSAqqmgSozIkpyxPi1OK82DjeIPKLIuLJM9+wAGEtQjdzTbg9PqJDQ2yk2l6nsftvmIL/DoTt4NlufoGAAD//wMANS4h+6kCAAA=","preset_metadata":null,"program_metadata":{"crc32":-1867498407,"dsp_mode":0,"factory":false,"favorite":false,"id":6629376,"inputs":2,"inputs / outputs":{"2/4":1.0},"is_exportable":true,"name":"Dynamic Send","outputs":4,"rating":0}},{"preset":"H4sIAAAAAAAEA4xVXY+iSBR931+x4bl3AgXaTSf7QDeKmKZYaURgsjFQKIKFGgGhatL/fW9hT8/0THamTYzWrXPvPed+wBcpofk6T4qDdP9FStkpqWvxr27TmpyLU1Mc4ebQUnojXRLabuD2s/zvy41UHN7cfg3+NMCrttl8LPCxbT4W+faTrMjwQeju7k65U8eCVpMU9IMKmk11Oq6rY/Z7YooI3W2adXZm66rof6sEiAnd4FVtmiRLmkS4FPV6m5DmeGbSfXNuNzfSIakgu7R88j3DN/6RbqTTeVNDoiKT7scIjZXbW2E7Zi1p/mzYaeA606V7BWKDPT8n1ZqciYqk+7+QPFbubpGiXn2Gu2+Bxt8cvqalzTnxk5MkYtE2h55e0wOlDZvvUiu7kIrKiaVs02raxM/22KZBnc3mu8CadnbRFdGBdlGgt6k6b6JVV7il0eIy4k65V7E5kTEno+H8fMVm03fY2q7wMVUN8MvRU0mYw/cj1zfgd8ExX3ZPj/MysfQuRLsL+PIMUTlC+ZDHNQlgFxouiYJLh2GTIPexK+Jw15Eq4ATRS0r1Ll55u/TRHjuPmuLAfbLS+lDFND04EGfSvtrYTzZE69Ty2AZ0g6/gUqcH72iXx95hw7lJV1QbzqbROqbRwVfFpT0CHTIGzSnq0TU3/FcD2Ql0Hq9GXPg8lQbo15XMnG8JClrCIM/zELeLrX4EmG7AHB5obE3r784sDjGFejRJeK3F/9WczOYUYsshGu3S1bJwi3ngT73nReA9LB/t2j48sBR5SqR622S1EPdliuQ2DmOoj3eKrWWbmPs2W/UyqaZyFBoF1IFFoUeBjzr0rATdPuj2iYzNiLmgW2DjQIfeeluiZqfMwqJuQo+C/YjhMu9cfznC3Oix72gQk6eWroZIuUDOwq3iXTrDdLDP5g349tCD3vHFfOw111xCnH0n+k1Qz9JAp2nlbUXvhzwiHvhBT4HzHPQHGrnOAMzknrumIbtmzoEDgnkbiTxQqz34Mnzt7XAGvzae6nQzEzMKPea57Pq5Bhw4Ng0Ec64MHNQHBjieWVMGfXnDw1wK/MgxbdgJA2Z1ojmwN4DrSAH95ov2VRPwWGhOuWBwhr54O+CzhVnZv+NeLkC/jTC3mWMuoH4TDtxB44OY3x+1wg4KPOxTuUeOGQHfXH7FixnkTjHMm/DnP2ktHfDNO4ghO3wC+fYK/spd+VHrRHBuyCwSO8XETmWW3opnBvZBI+wE1EwB3jAnDtQjEni+WWlvO5hVARt2Fupil46YMw00qUnolQn0zq6UYd7BPnpv79vMygV+/M5+8C5ptSy2i+Pf8Gj9/j0l3hEvL3/8BwAA//8DAMRbsSMABwAA","preset_metadata":{"is_factory":true,"name":"ULTRATAP","preset_id":6226177,"product type":{"H9":1},"program_crc32":-2061872137,"program_id":6226176,"program_name":"UltraTap"},"program_metadata":{"crc32":-2061872137,"dsp_mode":0,"factory":true,"favorite":false,"id":6226176,"info":"UltraTap is a versatile multi-tap delay-line effect capable of a myriad of sounds from rhythmic delays, to wacky comb filtering, to huge pad-like volume swells, to unique reverbs, and everything in between. \n\n  \nMix - [MIX] : wet/dry mixer, 100% is all wet signal.  \n  \nLength - [LENGTH] : Total time over which the taps are spaced in, up to 4 secs of tap time.  \n  \n#ofTaps - [TAPS] : The number of taps, from 1 to 64.  \n  \nPredelay - [PREDLY] : The amount of time before the taps start, up to 1 sec.  \n  \nSpread - [SPREAD] : The rhythmic spacing of the taps. More negative values will group taps towards the beginning, for a �slowing-down� feeling. More positive values will group more taps towards the end for a �speeding-up� delay sound. A zero value will result in constant spacing.  \n  \nTaper - [TAPER] : Controls the fade of the taps. More negative values will increasingly give a fade-up over the taps, and more positive values will give a fade-down over the taps. A zero value will result in equal gain across all taps.  \n  \nTone - [TONE] : A tone control. Negative values will make darker sounding taps, while positive values will make brighter sounding taps.  \n  \nSlurm - [SLURM] : Juicy tap slurring/smearing and modulation.  \n  \nChop - [CHOP] : A pre-tap-machine �chopping� tremolo OR auto-volume processor. The tremolo has several LFO waveform choices: off [OFF], triangle [TRIANG], sawtooth [SAW], ramp [RAMP], square [SQUARE], or sample/hold [SMPHLD]. The auto-volume processor will either do volume swells [SWELL (0-9 input sensitivity control)], or a gating effect, called Trigger, that chops off the end of sounds [TRIG (0-9 input sensitivity control)]. There is also a setting for expression pedal control of the pre-tap-machine volume [EXPDL].  \n  \nSpeed, Rise, or Release - [SPEED], [RISE], [RELEAS] : This knob acts as a multi-function parameter control for the [CHOP] knob. For the LFO waveforms, [SPEED] will change the LFO speed. For [SWELL], [RISE] will adjust the swell rise time, and for [TRIGGR], [RELEAS] sets the amount of time after triggering before the gate kicks in and chokes off the sound.  \n  \n\n","inputs":2,"inputs / outputs":{"2/2":1.0},"is_exportable":false,"name":"UltraTap","outputs":2,"product type":{"H9":1.0},"rating":0,"runs_at_96k":false,"six_character_abbreviation":"UltraT","weight":4}},{},{"preset":"H4sIAAAAAAAEA5RSy27DIBC89ysqzrFlsI0f1/YvqsrChjhUYCOM06ZR/r1ACs6pSTnBzM7uzi5nQMTYjYRPoD2D/qTIsrjbsvbLoLkyfLbMtAqxA0ciVmbZt+z9sgN8irK/g1MfLlfDHks8r+ZfmQ3h4sGeDZNq7uRM77cCncdPZjqqT53kX3d7L6EzakWU7/fJ3H+kGWhrC1pEnGBA8rTK/CkqXOcVxJ5GgYb5ryAPSACKAECfcxScspi1zJzssNW1JTxyDCr/FDEAFrXjReSTMsWNO3XWIFzCvNoBSZkyh1gEpqWVSGYIJYa4gSg9j5rIbtBDjkCbNLgqMcobGxYoTkGLamTzWacBnIi0GwCvmhH5/HIgsmca2NFJTcxmCvqe5aLIFFzAqy1lJxqhwhnRdNhmjALSbb27mIV/syCrfXK9+fei2wjsI27/tvtltstNg12hY1xe0vh3XF1y5ePmHH95+gEAAP//AwAnF1mFcwMAAA==","preset_metadata":{"program_crc32":-967562390,"program_id":2821376,"program_name":"Dream Chamber"},"program_metadata":{"crc32":-967562390,"dsp_mode":0,"effect type":{"Delay":0.90,"Reverb":0.60},"factory":true,"favorite":false,"id":2821376,"info":"Chamber effect (delays between diffusion and verb).  Stereo in, stereo out.","inputs":2,"inputs / outputs":{"2/2":1.0},"instrument type":{"Guitar":0.90},"is_exportable":true,"name":"Dream Chamber","outputs":2,"product type":{"H8000":1.0},"rating":7,"runs_at_96k":true,"weight":1}}]}
3880 bytes (compressed original)
*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~
Decompression successful! Data size: 6136 bytes
{"dsp_mode":0,"functions":[{"subscription":null,"value":0.0},{"subscription":null,"value":0.0},{"subscription":null,"value":0.0},{"subscription":null,"value":0.0},{"subscription":null,"value":0.0},{"subscription":null,"value":0.0},{"subscription":null,"value":0.0},{"subscription":null,"value":0.0}],"master_gain":{"bypass":{"subscription":null,"values":[0]},"in_gain":{"subscription":null,"values":[0.0]},"mute":{"subscription":null,"values":[0]},"out_gain":{"subscription":null,"values":[0.0]},"tails":{"subscription":null,"values":[0]},"wet_dry_mix":{"subscription":null,"values":[100.0]}},"metadata":{"crc32":-412343991,"effect type":{"Delay":0.8999999761581421,"Distortion":1.0,"Modulation":1.0,"Reverb":1.0},"fxchain_id":0,"instrument type":{"Bass":1.0,"Brass":1.0,"Guitar":0.8999999761581421,"Keyboard":1.0,"Vocal":1.0},"is_factory":false,"name":"Big Drum Room","product type":{"Emulation":1.0,"H8000":1.0,"H9":0.8999999761581421,"H9000":1.0,"Space":1.0},"program_names":"Dynamic Send, Shimmer, Dream Chamber","software":"2.0.5[2] (ade503dd6)","version":2},"routing":{"locations":[0,5,4,-1],"routes":[[[0,[0]],[1,[1]]],[[0,[0]],[1,[1]],[8,[2]],[9,[3]]],[[0,[0,8]],[1,[1,9]]]]},"slots":[{"preset":"H4sIAAAAAAAEA5RSy06FMBDd+xWmayAtIK+lMe5cGO/OGDKUBqqUYltUcsO/296k6ApxVjPnnJnM64xupdQmlM1rhFGVRgV2RkqcJ2mRJQG6V+zd0wVOIxygB9kyD9nw0ftxdGPDU6+Y7j0WktilwNDVHfARVWfULBNo7Tw9N5oqPhkuLTPOwxCgDxhmZtln/LIGiI9b2r44usjFbNixwnI2/6psgA8HezZMTLIWdknHWvlkpm7VUgv+9WcCwdhNajcDxgB982vGkWUuRtISE5IRr6jInqZlFJY9Qb9ow+xBufaqxN1TMAMtGHANT0p2CkRNFU1iVIWkyPK0LFKcBxvHW1RlWVwmefYDjiDsitDdYh1Or5/Y2CI7maanZdoeLLbArzdxN1jXq28AAAD//wMAoflsYLgCAAA=","preset_metadata":null,"program_metadata":{"crc32":-1867498407,"dsp_mode":0,"factory":false,"favorite":false,"id":6629376,"inputs":2,"inputs / outputs":{"2/4":1.0},"is_exportable":true,"name":"Dynamic Send","outputs":4,"rating":0}},{"preset":"H4sIAAAAAAAEA5RUW2+jRhR+76+oeI4qGMBd/Ob4gnE9g2ITg6kqa7iEDB4uMhBgVvnvPUPaJKuVutu38bl8l3OO+apQnl0yykpl/lWJxpo2jXw1XdTEN1a3rIJM2XF+p7xQ3qWQ/VP96/VOYeV7238X/zaVF12b/hxw1bX/C7mljP+k5jYt6upSVMmPpWjSY5+2l+Q2Xgo2/FC7pqrSKXQVaUsT2lLZwprLE43b6jYq8/bWpXdKSQtgV45bB+P1QblT6lvaAA9LlPlMm+mG+buMVUkXt7+2Yz1J3VrKXANoiGc3WlziW6wjZa5/QbMv5kyffWQ+YD4F/+V8ZkWR3hQJxLsMNvjGDXLScfcc2clLXHCV2tpTVGza8OjMHE4q6mttGDhsv9w9xzapnLwacL5Q9/micYpdf0YZc/P14Hq4w8uencv7nG6sKtIPT7Ge1MlbT7/Pzz3OcY+Fg0j+OBLPQe7qLDHM2N4ApzVG/qYBfKh9RHiVCcDUyOpqYu8KnNlb7fbwbe1ydz2jjQl9iCyNgYhFj1ePuutlAourQUBTaA/PKfjBR6MHHzzd3o9hQAT1rS7Q73lov/PKfBXaROLp7tEwSC7xFgh7C0G8tUZYz6hvDIFOeFRi6X3yDbHxuxjiTWQfxol7OXE3/2APgDn1Rf4hn/LeAnzLmWotDeRMsbnPHcndE/BDxFmQPB5B30u0Dd/mBO8kePhOS6SfVMwtEfqmkPuacMv761m/SlwdfmuuB3MVsYpFZpL8wQDcXmoL0KkLNxbMaAG1i85drUcs1ogI8C7WOrw1MvYstkH3yRKJvRmTT/WAOYBeRGBesF9Dzk3eRbzd8Rid1ABpdbqEXSwNDWZrwI5grg+m661hz86kIy5OIgzknt/v0Dk+auRwmu6wjwvrmvgEsPgV/LEzstp9cULgV6X+ge+LzNyX39yuoEHNoXaUO8VwU+BfhTs0ycoRrtSHhpdEs9oIHaCuLs7+IMJjzxJb6xMGej1H3oYa67z7mGnI45LUETKYyxzhlOof8J/+/EWU36bX11/+BgAA//8DACfgIChqBQAA","preset_metadata":{"is_factory":true,"name":"SHIMMER","preset_id":6163457,"product type":{"H9":1},"program_crc32":382685636,"program_id":6163456,"program_name":"Shimmer"},"program_metadata":{"crc32":382685636,"dsp_mode":0,"effect type":{"Reverb":1.0},"factory":true,"favorite":false,"id":6163456,"info":"We don�t have proof, but we�re pretty sure this is what the guitars sound like in heaven. Set the [A-PCH] and [B-PCH] to just above and below 1200c, turn the [DELAY] all the way down, and everything else all the way up. Oh, and remember to walk toward the light. \n\n  \nMix - [MIX] : wet/dry mixer, 100% is all wet signal  \n  \nDecay - [DECAY] : arbitrary 0-100 decay (less decay will also take away reverb attack)  \n  \nSize - [SIZE] : size of the reverb  \n  \nDelay - [DELAY] : post reverb and pre pitch-shift delay time in milliseconds or note-based in tempo mode  \n  \nLow Band Decay - [LO-DCY] : amount of post reverb and pitch-shifter low band signal (this is in the feedback path)  \n  \nHigh Band Decay - [HI-DCY] : amount of post reverb and pitch-shifter high band signal (this is in the feedback path)  \n  \nPitch Shift A - [PICH-A] : Pitch-shifter A pitch in cents (500c=P4th, 700c=P5th, 1200c=1 Octave, 1900=1 Octave+P5, 2400=2 Octaves)  \n  \nPitch Shift B - [PICH-B] : Pitch-shifter B pitch in cents (500c=P4th, 700c=P5th, 1200c=1 Octave, 1900=1 Octave+P5, 2400=2 Octaves)  \n  \nPitch Decay - [PITCH] : The PITCH-DECAY knob controls the amount of pitch shifting in the reverb tail. It increases from 0 to 100. Beyond 100 are two FREEZE modes. PITCH FREEZE locks out the pitch shifters, but feeds the reverb, allowing you to freeze the Shimmer pitch climb at opportune times. PITCH+VERB FREEZE freezes everything (pitch and reverb) for dry soloing on top of the frozen reverb.  \n  \nMid Band Decay - [MIDDCY] : amount of post reverb and pitch-shifter mid band signal (this is in the feedback path)  \n  \n\n","inputs":2,"inputs / outputs":{"2/2":1.0},"is_exportable":false,"name":"Shimmer","outputs":2,"product type":{"H9":0.90,"Space":1.0},"rating":0,"runs_at_96k":false,"six_character_abbreviation":"Shimmr","weight":4}},{"preset":"H4sIAAAAAAAEA5RSy27DIBC89ysqzrFlsI0f1/YvqsrChjhUYCOM06ZR/r1ACs6pSTnBzM7uzi5nQMTYjYRPoD2D/qTIsrjbsvbLoLkyfLbMtAqxA0ciVmbZt+z9sgN8irK/g1MfLlfDHks8r+ZfmQ3h4sGeDZNq7uRM77cCncdPZjqqT53kX3d7L6EzakWU7/fJ3H+kGWhrC1pEnGBA8rTK/CkqXOcVxJ5GgYb5ryAPSACKAECfcxScspi1zJzssNW1JTxyDCr/FDEAFrXjReSTMsWNO3XWIFzCvNoBSZkyh1gEpqWVSGYIJYa4gSg9j5rIbtBDjkCbNLgqMcobGxYoTkGLamTzWacBnIi0GwCvmhH5/HIgsmca2NFJTcxmCvqe5aLIFFzAqy1lJxqhwhnRdNhmjALSbb27mIV/syCrfXK9+fei2wjsI27/tvtltstNg12hY1xe0vh3XF1y5ePmHH95+gEAAP//AwAnF1mFcwMAAA==","preset_metadata":{"program_crc32":-967562390,"program_id":2821376,"program_name":"Dream Chamber"},"program_metadata":{"crc32":-967562390,"dsp_mode":0,"effect type":{"Delay":0.90,"Reverb":0.60},"factory":true,"favorite":false,"id":2821376,"info":"Chamber effect (delays between diffusion and verb).  Stereo in, stereo out.","inputs":2,"inputs / outputs":{"2/2":1.0},"instrument type":{"Guitar":0.90},"is_exportable":true,"name":"Dream Chamber","outputs":2,"product type":{"H8000":1.0},"rating":7,"runs_at_96k":true,"weight":1}},{}]}
3292 bytes (compressed original)
*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~*~

[Godlike-Productions]

Thanks so much. I'll work through implementing this today.

I'll have to revert the code back to the internal gzip as I was progressing with the io.open method,. It might take me a few days as I found in issue with my code doing checks for the sparse array rather than assuming that Eventide always fill the lowest slots, that I need to fix.

[dnaldoog]

So, can you confirm it’s working? I guess it is? If so, I’ll do a PR for the upstream branch.

[Godlike-Productions]

I can't run it. I'll try to reboot.

[Godlike-Productions]

No luck. It won't run. Was it perhaps compiled with debug set?

[dnaldoog]

Correction:

local testHeader = MemoryBlock("1F 8B 08 00")
might be too restrictive and create false negatives.

- local testHeader = MemoryBlock("1F 8B 08 00")
+ local testHeader = MemoryBlock("1F 8B")

[dnaldoog]

Ah, you need the redistributable VC runtime.
It’s normally included in the installer, but I just sent you the executable. It should be already present on your system from the installation of the previous version of CtrlrX, unless you’re using a clean VirtualBox environment or purged the previous install something like that?

https://aka.ms/vs/17/release/vc_redist.x64.exe

[Godlike-Productions]

The old version of CtrlrX that you built ran fine, but just the exe this time didn't. I'm not running it in a sandbox, just good old windows 10.

I'll install the runtime and tey again in an hour or so. Just out on my daily hike at the momebt.

[dnaldoog]

This was the fix:

https://stackoverflow.com/questions/2799834/lua-c-api-how-to-push-a-string-with-a-null-character-in-the-middle

[dnaldoog]

Here is a Windows Installer that will include installation of VCRUNTIME140.dll

https://github.com/dnaldoog/CtrlrX/releases/tag/5.6.34_GZIPMB_Nov06

TEST PANEL: test GZIP truncation Eventide_2_0.zip

To parse the decompressed string containing potential null characters using decompressGZIP you can now choose from several functions all exactly the same just depending which name makes more sense for you:

				.def("toBinaryString", &LMemoryBlock::toBinaryString, luabind::raw(_2))
				.def("toRawString", &LMemoryBlock::toBinaryString, luabind::raw(_2))
				.def("toBinarySafeString", &LMemoryBlock::toBinaryString, luabind::raw(_2))
				.def("toLuaString", &LMemoryBlock::toBinaryString, luabind::raw(_2))
				.def("pushLString", &LMemoryBlock::toBinaryString, luabind::raw(_2))
				.def("toStringWithNulls", &LMemoryBlock::toBinaryString, luabind::raw(_2))
				.def("toStringNoTerminator", &LMemoryBlock::toBinaryString, luabind::raw(_2))

In the example panel I used pushLString, but any of these are fine.

[Godlike-Productions]

I think I found one of my issues. I do another decompressGzip later - but now that it returns a memoryBlock instead of a string, I'll need to do the conversion. I'll look at it in a bit. Going crosseyed here.

[dnaldoog]

Yes, that whole Eventide system is like a Russian Babooshka doll. So convoluted.

[Godlike-Productions]

It really is. I'm tempted to rename the tool H9000 Babooshka after that comment. In positive news, this probably unlocks the file format for their plugins and other stomp boxes, except maybe the H90, which I need to look into.

Good news, I've successfully gotten it to read all of the common variants that I've made during normal use. I have a few edge cases that I created specifically to look at the file structure that I need to work on (where there are 2 or more empty slots together).

I still have to go through the integrity check method and re-encoding method, but they should be straight forward. I'll also redo the original preset modification to use the internal gzip method.

Thankyou so much for your assistance, and to Damien. This would not have been possible without the modifications to the source.

[dnaldoog]

That’s great to hear- will be very interesting to see how you go. Not having to install/call an external library will be a huge upgrade for your users.

[Godlike-Productions]

OK, I seem to have ironed out the edge cases as well.

Just got to make changes to the Preset part.

Renaming is now done :P

[dnaldoog]

Here is a small panel saves/loads JSON Gzipped.

Save import-export JSON - Gzip only_3.zip

[dnaldoog]

That’s great! The name stuck!

Is it each of the unchecked rows that need to be enabled/disabled without dimming them?

what enables/disables them if so? The checkbox field?

[Godlike-Productions]

Basically all the information to the left of the New Algorithm Bank boxes needs to be read only. I've tried puting a blocker (a transparent group) over the top of the other 4 group boxes, but it keeps moving into the Slot 1 Group, even if I lock it. I might just need to build 4 smaller blockers, 1 for each Slot Group, and bring them to the front after the modulators are drawn. Its a pain. I only want it to be there in the Chain Tool tab.

Actually the labels aren't a problem as I can turn off uiLabelEditOnSingleClick and uiLabelEditOnDoubleClick and they effectively become unchangeable. If the Toggle Button had the same options, it would also solve the problem. It's really only the factory toggle buttons that need the protection.

Changing them doesn't actually break anything as I never read information from any of the modulators except the New Algorithm Bank and New Algorithm Number boxes. They just display information for the users and it is useful to me if a problem arises. I could probably get rid of a bunch of them, but the Name and Factory are the most important ones, and it's the factory check box that's the one that keeps changing if you click it.

All of the information is pulled from the json files and shows the information from the various locations of the file that need to be updated. I do a check to make sure that the file is internally consistent (so far they all have been, but I flag any inconsistencies and give the user a chance to just overwrite it and update it.)

The factory checkbox comes from the file. Fortunately Eventide has a factory key that I can read. I use it to disable the New Algorithm Box and New Algorithm Number because factory algorithms have fixed locations and changing them would break stuff.

When I scan the file, I determine which of the 4 blocks have stuff in them. If they are empty I turn off visibility of the group box. I also use this information to skip any interrogation or updates on those slots. Basically if they are empty or factory, I leave them alone.