--- Log for 22.06.121 Server: lithium.libera.chat Channel: #rockbox --- Nick: rb-logbot Version: Dancer V4.16 Started: 20 days and 11 hours ago 00.43.00 # if you have jtag with data watchpoints, then just set a write breakpoint 00.43.25 # <__builtin> can I do that on ipod6g? 00.43.43 # if not, then look what's around this variable in map file 00.44.18 # <__builtin> I might just instrument key points in the code to log the value 00.44.24 # <__builtin> and bisect from there 00.44.30 # you can load up elf in Ghidra and look for clues there (navigate over the references) 00.46.02 # if you how valid and invalid data values you can add tick hook checking that to try to detect the thread that causes corruption 00.48.50 # braewoods: xor with 0xffffffff is just one of many possibilities. If you look up how crcs are categorized then you'll find find xorout as one of the parameters 00.59.02 Quit advcomp2019_ (Ping timeout: 258 seconds) 01.09.32 # ("many" is extraggeration, as most crc are either xorout with 0 or crclength of ones) 01.19.14 Join lebellium [0] (~lebellium@2a01:cb10:2e:2000:e9f0:22d6:72e8:fd2) 01.30.18 Quit fmlatghor (Ping timeout: 264 seconds) 01.34.41 *** Saving seen data "./dancer.seen" 01.57.59 # desowin: i see. i just noted that XOR with all bits turned on is equivalent to logical NOT. 01.58.03 # err bitwise not 01.58.59 # hm. new challenge. 01.59.19 # most inflate libraries assume all the compressed data is in RAM at once 01.59.46 # so i need to find that isn't or modify one so it can take the datastream in partial chunks 02.05.24 Quit lebellium (Quit: Leaving) 02.09.35 Join fmlatghor [0] (~lcoogan@2601:5cd:8100:2890:9220:3aff:fe1a:350d) 02.19.09 Quit _bilgus (Ping timeout: 258 seconds) 03.07.50 Join Guest69 [0] (~Guest69@115.96.233.140) 03.08.02 Quit Guest69 (Client Quit) 03.34.45 *** Saving seen data "./dancer.seen" 04.57.50 Quit ufdm (Read error: Connection reset by peer) 04.57.59 Join ufdm [0] (~ufdm@c-73-164-63-214.hsd1.mn.comcast.net) 05.15.16 Quit ufdm (Quit: Leaving) 05.27.44 # this is challenging. finding an inflate library that supports gradual processing so i don't need to load the whole data stream into RAM first 05.29.41 Join ufdm [0] (~ufdm@c-73-164-63-214.hsd1.mn.comcast.net) 05.34.46 *** Saving seen data "./dancer.seen" 06.12.15 Join amachronic [0] (~amachroni@user/amachronic) 06.16.03 # braewoods: surely zlib can work in low RAM... unzip doesn't consume all RAM due to a huge zipfile. 06.21.09 # amachronic: no idea. i'm also trying to avoid adding too much code size for more RAM constrained targets. 06.21.22 # trying to see what my options are 06.22.30 # heh. the image viewer plugin uses a smaller library for png decompression. 06.23.00 # yeah that's deflate too isn't it? 06.23.20 # yes... it usually uses zlib of course. 06.24.52 # problem with tinf is it lacks a streaming or resumeable inflate algorithm so not possible to use unless I modify it. 06.25.45 # zlib does have that but not sure how much i'd have to strip out just to have the part i need 06.26.14 # well at some level there must be a "get the bytes from buffer" function and that should be an easy thing to modify to support streaming 06.26.23 # but zlib is probably too big not worth hacking it apart 06.26.58 # i already imported a space optimized version of the ZIP crc32 algorithm 06.27.06 # that's already in rockbox master 06.27.34 # it also freed up some space on some space stared targets 06.27.47 # since it was functionall identical to an alternative crc32 in use by mi4 06.28.11 # how constrained is that gigabeat bootloader anyhow? 06.28.25 # it isn't. it's a side benefit for other ports. 06.28.29 # however 06.29.04 # i decided while i was at it to make a ZIP library we could use for other things in rockbox 06.29.16 # so that means trying to keep the memory footprint low 06.29.57 # hmm, so 2 MB is currently the minimum RAM for a couple targets but 8 MB+ is more usual 06.30.22 # indeed. even that may be too low for this. 06.30.52 # but for now i intend just to get this sucker working; we can swap out these parts for more memory hungry parts if we find we can spare it after all. 06.31.22 # i want to see how it performs in a space optimized version first 06.31.28 # I'd go the other way... use something big & easy and if it proves necessary reduce it 06.31.39 # depending on what functions you call a lot of code may go away at link time 06.32.01 # so big library != big space consumption if you only call a few functions 06.32.29 # but, if you've already got something working might as well start small 06.32.57 # well.. maybe it ultimately doesn't matter. 06.33.01 # but 06.33.39 # i'm finding the most significant RAM consumption is all the buffers 06.33.48 # code size is going to pale by comparison 06.34.11 # yeah I just wanted to point out like that float formatting thing was a biggest code size impact on targets with the most room to spare. 06.34.26 # ie. on the targets with low RAM the code size was also smaller 06.34.49 # I guess they work that way for a reason :) 06.35.12 # i'm considering introducing fast crc32 algorithms for non-bootloader targets 06.35.34 # they use a beefier lookup table to enhance the end result 06.35.50 # 1024 bytes vs 64 bytes 06.36.37 Join aevin [0] (eivindsy@microbel.pvv.ntnu.no) 06.36.58 # nb. Rockbox has limited IO speeds around ~10 MB/s to begin with so anything faster than that is not really needed 06.37.44 # from a streaming perspective at least 06.37.54 # amachronic: depends on the port. my gigabeat S hits 20 with an SSD drive. 06.38.49 # ah, nvm then 06.39.22 # I wasted a lot of time myself trying to make things small and just had room to spare in the end 06.41.06 # unless you hit real cpu or size problems you might as well pick the low-complexity solutions at first 06.41.36 # ^^^ exactly. 06.41.46 # only add complexity when necessary 06.43.41 # well i'll see how well my library performs first 06.44.03 # i'm just trying to find a solution for handling DEFLATE stored filed 06.44.11 # STORE is trivial; it's not compressed at all 06.44.55 # but i realized tinf works for imageviewer but not for ZIP archives due to how large files can get 06.45.08 # pngs are typically much smaller 06.45.15 # and only a single data stream 06.45.32 # ZIP files though vary wildly 06.45.46 # so i'm trying to make it more robust by finding a resumeable stream decoder 06.45.54 # so i don't need to buffer it all in ram 06.46.04 # having to do that would limit what types of files i can work with 07.19.53 Quit Rondom (Remote host closed the connection) 07.20.05 Join Rondom [0] (~rondom@user/rondom) 07.22.42 Join _bilgus [0] (~bilgus@162.154.213.134) 07.34.49 *** Saving seen data "./dancer.seen" 07.50.44 Quit markun (Ping timeout: 265 seconds) 07.52.15 Join markun [0] (~markun@178-84-100-63.dynamic.upc.nl) 08.32.30 Quit fmlatghor (Remote host closed the connection) 08.32.54 Join fmlatghor [0] (~lcoogan@2601:5cd:8100:2890:9220:3aff:fe1a:350d) 09.06.18 Quit amachronic (Quit: amachronic) 09.34.53 *** Saving seen data "./dancer.seen" 11.10.11 Join advcomp2019 [0] (~advcomp20@user/advcomp2019) 11.34.56 *** No seen item changed, no save performed. 12.07.01 Nick Arsen is now known as ArsenArsen (~arsen@managarm/dev/Arsen) 12.07.09 Nick ArsenArsen is now known as Arsen (~arsen@managarm/dev/Arsen) 12.07.42 Nick Arsen is now known as ArsenArsen (~arsen@managarm/dev/Arsen) 12.18.53 # i'm just going to forget about the whole inflate algorithm problem for awhile and just focus on implementing ZIP support without it for now 12.35.56 Quit j-r (Remote host closed the connection) 12.37.16 Join j-r [0] (~j-r@p2003000621560785404207fffefd0a65.dip0.t-ipconnect.de) 12.39.46 Quit akaWolf (Ping timeout: 265 seconds) 12.42.14 Nick j-r is now known as j--r (~j-r@p2003000621560785404207fffefd0a65.dip0.t-ipconnect.de) 12.42.33 Nick j--r is now known as j-r (~j-r@p2003000621560785404207fffefd0a65.dip0.t-ipconnect.de) 12.43.21 Join akaWolf [0] (~akaWolf@akawolf.org) 12.43.31 Quit j-r (Remote host closed the connection) 12.43.46 Join j-r [0] (~j-r@p2003000621560785404207fffefd0a65.dip0.t-ipconnect.de) 13.13.42 Join lebellium [0] (~lebellium@2a01:cb10:2e:2000:b93f:bcd5:5f34:d31c) 13.30.46 # Build Server message: 3New build round started. Revision b5c40d9991, 297 builds, 9 clients. 13.34.59 *** Saving seen data "./dancer.seen" 13.47.56 # Build Server message: 3Build round completed after 1030 seconds. 13.47.59 # Build Server message: 3Revision b5c40d9991 result: All green 14.30.56 Quit akaWolf (Ping timeout: 258 seconds) 14.31.55 Nick ArsenArsen is now known as Arsen (~arsen@managarm/dev/Arsen) 14.36.38 Join akaWolf [0] (~akaWolf@akawolf.org) 15.22.14 Quit akaWolf (Ping timeout: 252 seconds) 15.35.03 *** Saving seen data "./dancer.seen" 15.37.53 Join akaWolf [0] (~akaWolf@akawolf.org) 15.43.46 Quit _bilgus (Ping timeout: 258 seconds) 16.30.19 Join amachronic [0] (~amachroni@user/amachronic) 16.50.08 # Build Server message: 3New build round started. Revision 8a6b2f3abc, 297 builds, 9 clients. 17.06.09 # Build Server message: 3Build round completed after 960 seconds. 17.06.17 # Build Server message: 3Revision 8a6b2f3abc result: All green 17.06.58 # Build Server message: 3New build round started. Revision 6da490099b, 297 builds, 9 clients. 17.22.33 # Build Server message: 3Build round completed after 936 seconds. 17.22.37 # Build Server message: 3Revision 6da490099b result: All green 17.24.56 Quit amachronic (Quit: amachronic) 17.35.06 *** Saving seen data "./dancer.seen" 17.47.55 Quit lebellium (Quit: Leaving) 17.59.28 Quit ufdm (Ping timeout: 258 seconds) 18.00.56 Quit mendel_munkis (Remote host closed the connection) 18.01.15 Join mendel_munkis [0] (~mendel_mu@ool-ae2cb218.dyn.optonline.net) 18.32.44 Quit akaWolf (Ping timeout: 268 seconds) 18.44.18 Join akaWolf [0] (~akaWolf@akawolf.org) 19.35.10 *** Saving seen data "./dancer.seen" 20.30.49 Nick mendel_munkis is now known as munkis (~mendel_mu@ool-ae2cb218.dyn.optonline.net) 20.31.08 Nick munkis is now known as mendel_munkis_ (~mendel_mu@ool-ae2cb218.dyn.optonline.net) 20.31.21 Nick mendel_munkis_ is now known as munkis (~mendel_mu@ool-ae2cb218.dyn.optonline.net) 21.35.11 *** No seen item changed, no save performed. 22.39.50 Quit fmlatghor (Remote host closed the connection) 22.40.13 Join fmlatghor [0] (~lcoogan@2601:5cd:8100:2890:9220:3aff:fe1a:350d) 23.35.13 *** Saving seen data "./dancer.seen"