Are these fails expected?

[bezik46]

sudo sh pack_firmware.sh
Packing firmware...Please wait
Parallel mksquashfs: Using 2 processors
Creating 4.0 filesystem on packed.squash, block size 131072.
[========================================================================================================|] 385/385 100%

Exportable Squashfs 4.0 filesystem, lzma compressed, data block size 131072
        compressed data, compressed metadata, compressed fragments,
        compressed xattrs, compressed ids
        duplicates are removed
Filesystem size 2366.48 Kbytes (2.31 Mbytes)
        21.68% of uncompressed filesystem size (10915.02 Kbytes)
Inode table size 4308 bytes (4.21 Kbytes)
        20.67% of uncompressed inode table size (20839 bytes)
Directory table size 5582 bytes (5.45 Kbytes)
        44.71% of uncompressed directory table size (12484 bytes)
Number of duplicate files found 43
Number of inodes 634
Number of files 368
Number of fragments 33
Number of symbolic links 124
Number of device nodes 64
Number of fifo nodes 0
Number of socket nodes 0
Number of directories 78
Number of hard-links 0
Number of ids (unique uids + gids) 3
Number of uids 2
        root (0)
        saned (111)
Number of gids 2
        root (0)
        nm-openvpn (117)
Rootfs created as packed.squash
Firmware joined as output_firmware.bin
Generating footer...
Header Magic number: 0x32524448 found 0x3C9DEFAA ...failed
Header Magic device: 0x00000100 found 0x36BF2E42 ...failed
tclinux.bin size: 3145728 (0x0993EC8D) found 3145728 (0x0993EC8D) ...failed
tclinux.bin checksum: 0x6A6586FA found 0x7610B606 ...failed
Checksum fixed. Creating footer...
TP Product ID: 0x4685b102 (1183166722)
TP Version: 2.0.0.1
TP Version in HEX: 0x2.0x0.0x0.0x1
Calculated CRC:99f2bb100a842c1fbc271304b8a0352b output_firmware.bin
Done...Please double check size. If your file ends at lower 003800e8, then it's good
00300000  6f 6b 30 6f 77 70 61 6b  64 69 65 39 38 77 64 6b  |ok0owpakdie98wdk|
00300010  00 00 00 00 00 00 00 00  00 00 00 00 00 00 00 00  |................|
*
00300040  00 00 00 00 00 00 00 00  00 00 00 00 46 85 b1 02  |............F...|
00300050  02 00 00 01 03 01 04 00  00 00 00 00 00 00 00 00  |................|
00300060  00 00 00 00 00 00 00 00  00 00 00 00 00 00 00 00  |................|
*
003000d0  00 00 00 00 99 f2 bb 10  0a 84 2c 1f bc 27 13 04  |..........,..'..|
003000e0  b8 a0 35 2b 00 00 00 00                           |..5+....|
003000e8
All good! use result.bin to update device

I assume these are expected & fixed later, hence the all good at the end ?

[mobrembski]

Hi! I dont have this terminal anymore, so i cant check but as i remember - yes, those fails are expected because youre creating a new image so it dont have magic in header yet. wt., 26 mar 2024, 10:06 użytkownik bezik46 ***@***.***> napisał:

…

sudo sh pack_firmware.sh Packing firmware...Please wait Parallel mksquashfs: Using 2 processors Creating 4.0 filesystem on packed.squash, block size 131072. [========================================================================================================|] 385/385 100% Exportable Squashfs 4.0 filesystem, lzma compressed, data block size 131072 compressed data, compressed metadata, compressed fragments, compressed xattrs, compressed ids duplicates are removed Filesystem size 2366.48 Kbytes (2.31 Mbytes) 21.68% of uncompressed filesystem size (10915.02 Kbytes) Inode table size 4308 bytes (4.21 Kbytes) 20.67% of uncompressed inode table size (20839 bytes) Directory table size 5582 bytes (5.45 Kbytes) 44.71% of uncompressed directory table size (12484 bytes) Number of duplicate files found 43 Number of inodes 634 Number of files 368 Number of fragments 33 Number of symbolic links 124 Number of device nodes 64 Number of fifo nodes 0 Number of socket nodes 0 Number of directories 78 Number of hard-links 0 Number of ids (unique uids + gids) 3 Number of uids 2 root (0) saned (111) Number of gids 2 root (0) nm-openvpn (117) Rootfs created as packed.squash Firmware joined as output_firmware.bin Generating footer... Header Magic number: 0x32524448 found 0x3C9DEFAA ...failed Header Magic device: 0x00000100 found 0x36BF2E42 ...failed tclinux.bin size: 3145728 (0x0993EC8D) found 3145728 (0x0993EC8D) ...failed tclinux.bin checksum: 0x6A6586FA found 0x7610B606 ...failed Checksum fixed. Creating footer... TP Product ID: 0x4685b102 (1183166722) TP Version: 2.0.0.1 TP Version in HEX: 0x2.0x0.0x0.0x1 Calculated CRC:99f2bb100a842c1fbc271304b8a0352b output_firmware.bin Done...Please double check size. If your file ends at lower 003800e8, then it's good 00300000 6f 6b 30 6f 77 70 61 6b 64 69 65 39 38 77 64 6b |ok0owpakdie98wdk| 00300010 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| * 00300040 00 00 00 00 00 00 00 00 00 00 00 00 46 85 b1 02 |............F...| 00300050 02 00 00 01 03 01 04 00 00 00 00 00 00 00 00 00 |................| 00300060 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| * 003000d0 00 00 00 00 99 f2 bb 10 0a 84 2c 1f bc 27 13 04 |..........,..'..| 003000e0 b8 a0 35 2b 00 00 00 00 |..5+....| 003000e8 All good! use result.bin to update device I assume these are expected & fixed later, hence the all good at the end ? — Reply to this email directly, view it on GitHub <#6>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAGUQBGXQDAQZMD3AS5JFX3Y2E27ZAVCNFSM6AAAAABFIQEEDOVHI2DSMVQWIX3LMV43ASLTON2WKOZSGIYDONRUGQ4DQOA> . You are receiving this because you are subscribed to this thread.Message ID: ***@***.***>

[bezik46]

OK, but the resulting output file is very much different in size

Got the v2 firmware from TP LInk page: https://www.tp-link.com/us/support/download/xz000-g3/

XZ000-G3v2_UP_230129.bin is 3.50 MB (3,674,112 bytes)
result.bin is 3.00 MB (3,149,824 bytes)

so 0.5 Mb is gone somewhere!?

The file definitely ends in expected:

00300000  6f 6b 30 6f 77 70 61 6b  64 69 65 39 38 77 64 6b  |ok0owpakdie98wdk|
00300010  00 00 00 00 00 00 00 00  00 00 00 00 00 00 00 00  |................|
*
00300040  00 00 00 00 00 00 00 00  00 00 00 00 46 85 b1 02  |............F...|
00300050  02 00 00 01 03 01 04 00  00 00 00 00 00 00 00 00  |................|
00300060  00 00 00 00 00 00 00 00  00 00 00 00 00 00 00 00  |................|
*
003000d0  00 00 00 00 99 f2 bb 10  0a 84 2c 1f bc 27 13 04  |..........,..'..|
003000e0  b8 a0 35 2b 00 00 00 00                           |..5+....|

How can I be sure that created .bin is actually usable by device (so it does not get bricked, as I have no idea if there is any way to recover it in a worse case)

[bezik46]

So now we take the created smaller result.bin & run it again via the same process (one more time)

All "looks" correct, but the created file is now 2.5Mb (another 0.5Mb gone)

┌──(kali㉿kali)-[~/Downloads/tprepack-master.1]
└─$ sudo make unpack
sudo sh extract_rootfs.sh
Using file: ./input.bin
Checking image type...
hexdump: result_orig.bin: No such file or directory
hexdump: all input file arguments failed
Detected full dump!
2621672+0 records in
2621672+0 records out
2621672 bytes (2.6 MB, 2.5 MiB) copied, 2.72831 s, 961 kB/s
WARNING: Extracting will take some time, please be patient
During process you will be asked for a password, this is due to unsquashfs cannot fully extract image without root
Looking for Squashfs image...Please wait
Found Squashfs! Offset of squashfs: 196608
Copying header with linux to extracted_header.bin
196608+0 records in
196608+0 records out
196608 bytes (197 kB, 192 KiB) copied, 0.190227 s, 1.0 MB/s
Header has been written
Copying squashfs to extracted_squashfs
2425064+0 records in
2425064+0 records out
2425064 bytes (2.4 MB, 2.3 MiB) copied, 2.28191 s, 1.1 MB/s
Squashfs has been written
Unpacking Squashfs...
Parallel unsquashfs: Using 2 processors
556 inodes (385 blocks) to write

[========================================================================================================|] 941/941 100%

created 368 files
created 78 directories
created 124 symlinks
created 64 devices
created 0 fifos
created 0 sockets
created 0 hardlinks
DONE! Now you can modify system in squashfs-root. Then run make repack
                                                                                                                         
┌──(kali㉿kali)-[~/Downloads/tprepack-master.1]
└─$ sudo make repack
sudo sh pack_firmware.sh
Packing firmware...Please wait
Parallel mksquashfs: Using 2 processors
Creating 4.0 filesystem on packed.squash, block size 131072.
[========================================================================================================|] 385/385 100%

Exportable Squashfs 4.0 filesystem, lzma compressed, data block size 131072
        compressed data, compressed metadata, compressed fragments,
        compressed xattrs, compressed ids
        duplicates are removed
Filesystem size 2366.48 Kbytes (2.31 Mbytes)
        21.68% of uncompressed filesystem size (10915.02 Kbytes)
Inode table size 4308 bytes (4.21 Kbytes)
        20.67% of uncompressed inode table size (20839 bytes)
Directory table size 5582 bytes (5.45 Kbytes)
        44.71% of uncompressed directory table size (12484 bytes)
Number of duplicate files found 43
Number of inodes 634
Number of files 368
Number of fragments 33
Number of symbolic links 124
Number of device nodes 64
Number of fifo nodes 0
Number of socket nodes 0
Number of directories 78
Number of hard-links 0
Number of ids (unique uids + gids) 3
Number of uids 2
        root (0)
        saned (111)
Number of gids 2
        root (0)
        nm-openvpn (117)
Rootfs created as packed.squash
Firmware joined as output_firmware.bin
Generating footer...
Header Magic number: 0x32524448 found 0x52A0CC56 ...failed
Header Magic device: 0x00000100 found 0x4AB179CD ...failed
tclinux.bin size: 2621440 (0xD4ABBA6E) found 2621440 (0xD4ABBA6E) ...failed
tclinux.bin checksum: 0xB26B194C found 0xC1997CE4 ...failed
Checksum fixed. Creating footer...
TP Product ID: 0x4685b102 (1183166722)
TP Version: 2.0.0.1
TP Version in HEX: 0x2.0x0.0x0.0x1
Calculated CRC:ca26807055b179bd06a0f81237f6edae output_firmware.bin
Done...Please double check size. If your file ends at lower 003800e8, then it's good
00280000  6f 6b 30 6f 77 70 61 6b  64 69 65 39 38 77 64 6b  |ok0owpakdie98wdk|
00280010  00 00 00 00 00 00 00 00  00 00 00 00 00 00 00 00  |................|
*
00280040  00 00 00 00 00 00 00 00  00 00 00 00 46 85 b1 02  |............F...|
00280050  02 00 00 01 03 01 04 00  00 00 00 00 00 00 00 00  |................|
00280060  00 00 00 00 00 00 00 00  00 00 00 00 00 00 00 00  |................|
*
002800d0  00 00 00 00 ca 26 80 70  55 b1 79 bd 06 a0 f8 12  |.....&.pU.y.....|
002800e0  37 f6 ed ae 00 00 00 00                           |7.......|
002800e8
All good! use result.bin to update device

Then we run it YET again again and all still "looks OK" (but really it is NOT!!! because the squash FS did not get extracted at all), and the resulting file is 232 BYTES!

┌──(kali㉿kali)-[~/Downloads/tprepack-master.2]
└─$ sudo make unpack
sudo sh extract_rootfs.sh
Using file: ./input.bin
Checking image type...
hexdump: result_orig.bin: No such file or directory
hexdump: all input file arguments failed
Detected full dump!
2097384+0 records in
2097384+0 records out
2097384 bytes (2.1 MB, 2.0 MiB) copied, 2.20949 s, 949 kB/s
WARNING: Extracting will take some time, please be patient
During process you will be asked for a password, this is due to unsquashfs cannot fully extract image without root
Looking for Squashfs image...Please wait
Found Squashfs! Offset of squashfs: 
Copying header with linux to extracted_header.bin
dd: invalid number: ''
Header has been written
Copying squashfs to extracted_squashfs
dd: invalid number: ''
Squashfs has been written
Unpacking Squashfs...
Could not open ./extracted_squashfs.bin, because No such file or directory
DONE! Now you can modify system in squashfs-root. Then run make repack
                                                                                                                         
┌──(kali㉿kali)-[~/Downloads/tprepack-master.2]
└─$ sudo make repack
sudo sh pack_firmware.sh
Packing firmware...Please wait
Cannot stat source directory "squashfs-root/" because No such file or directory
Rootfs created as packed.squash
cat: extracted_header.bin: No such file or directory
cat: packed.squash: No such file or directory
Firmware joined as output_firmware.bin
Generating footer...
Header Magic number: 0x32524448 found 0x00000000 ...failed
Header Magic device: 0x00000100 found 0x00000000 ...failed
tclinux.bin size: 0 (0x00000000) found 0 (0x00000000) ...ok
tclinux.bin checksum: 0xFFFFFFFF found 0x00000000 ...failed
Checksum fixed. Creating footer...
TP Product ID: 0x4685b102 (1183166722)
TP Version: 2.0.0.1
TP Version in HEX: 0x2.0x0.0x0.0x1
Calculated CRC:445ac4681f3e2079ebaad2246b14e36d output_firmware.bin
Done...Please double check size. If your file ends at lower 003800e8, then it's good
00000000  6f 6b 30 6f 77 70 61 6b  64 69 65 39 38 77 64 6b  |ok0owpakdie98wdk|
00000010  00 00 00 00 00 00 00 00  00 00 00 00 00 00 00 00  |................|
*
00000040  00 00 00 00 00 00 00 00  00 00 00 00 46 85 b1 02  |............F...|
00000050  02 00 00 01 03 01 04 00  00 00 00 00 00 00 00 00  |................|
00000060  00 00 00 00 00 00 00 00  00 00 00 00 00 00 00 00  |................|
*
000000d0  00 00 00 00 44 5a c4 68  1f 3e 20 79 eb aa d2 24  |....DZ.h.> y...$|
000000e0  6b 14 e3 6d 00 00 00 00                           |k..m....|
000000e8
All good! use result.bin to update device

Something is definitely not correct in the scripts

[sneider96]

bezik46, best regards, I would like help. Can you give me a tutorial on how to modify it, whether it's the dumped firmware or the firmware from the TPlink servers? I use Windows 10. I don't know what system or tools should be used. I would appreciate it if you're handicapped.