squashfs-tools-ng.git/lib/sqfs, branch v1.0.4

libsqfs: block processor: backport exact fragment matching

2021-01-19T09:45:59+00:00

This commit is an amalgamation of the commits on master that implement exact matching of fragment blocks during deduplication. Signed-off-by: David Oberhollenzer

libsqfs: implement exact matching in the default block writer.

2021-01-19T09:45:59+00:00

Instead of comparing (compresed, disk-size, checksum) tuples to find block matches, do an exact, byte-for-byte comparison of the data stored on disk to avoid the possibility of a spurious colision. Since this is the desired behaviour, make it the default, optionally overrideable through a flag. Signed-off-by: David Oberhollenzer

Fix: Move fragment consolidation back to block processor serial part

2021-01-19T09:30:20+00:00

Keeping a list of fragments stored away in the current fragment block and consolidating them in the thread pool takes them out of circulation. If we have a lot of tiny fragments, this can lead to a situation where all the limit is reached, but we cannot do anything, because we are waiting for a block to complete, but they are all attached to the current fragment block and the queue is empty. Signed-off-by: David Oberhollenzer

Fix more normalization of slashes in filenames.

2021-01-15T16:36:02+00:00

It looks like the last commit missed a couple more occurences where '\' was treated incorrectly. Fixes were still needed in sqfs_dir_reader_find_by_path and sqfs_dir_reader_get_full_hierarchy. This path is used in extras/browse.c.

Fix: libsquashfs: xattr_writer: return NULL if calloc fails

2020-12-29T11:37:37+00:00

Instead of dereferencing the NULL pointer and crashing. Signed-off-by: David Oberhollenzer

Fix block processor single block with don't fragment flag bug

2020-08-11T22:25:34+00:00

This commit fixes a bug where the block processor state machine would not add the "last block" flag if there is only one not entirely filled block and the "don't fragment" flag is set. If the flag isn't set, the inode start block position is not updated and points to the beginning of the image instead. Signed-off-by: David Oberhollenzer

Cleanup: move zlib/lz4 code from lib/sqfs/comp/ to lib/

2020-08-04T17:27:42+00:00

The source code of a modified liblz4 and zlib are included with the option to compile them into libsquashfs if they are not available on the system. So far, the source code was included directly in the compressor sub directory within libsqsuashfs. This commit moves the libraries out into the lib directory. Signed-off-by: David Oberhollenzer

Fix: xattr reader: read the header after seaking to an OOL value

2020-07-29T11:31:08+00:00

If an xattr value is stored OOL, the value actually holds an 8 byte reference to another, previously stored value. This reference points to the header that we need to read to know the actual size of the value before reading it, not the value itself, so after reading the reference and seeking to it, the xattr reader needs to read the actual header. Signed-off-by: David Oberhollenzer

Fix block bounds checking in libsquashfs data reader

2020-06-20T17:18:32+00:00

Instead of doing the fragile size comparison in both loops, simply bail from the function if offset is out of bounds, clamp the size to the available range of the file and abail if it is zero. As a result, a lot of checks can be removed and the function will not return data beyond EOF. This problem occoured with files that have a short last block instead of a fragment. Signed-off-by: David Oberhollenzer

Fix: don't include alloca.h on systems that don't provide this header

2020-06-13T14:09:40+00:00

This commit fixes a build issue on BSD based systems, where alloca is defined in stdlib.h and there is no such thing as "alloca.h". Signed-off-by: David Oberhollenzer