squashfs-tools-ng.git/lib/sqfs/data_writer, branch v1.0.4

Rename sqfs_data_writer_t back to sqfs_block_processor_t

2020-01-29T16:22:50+00:00

Signed-off-by: David Oberhollenzer

Cleanup: Move fragment deduplication code over to fragment table

2020-01-26T14:09:06+00:00

This removes further clutter from the data writer. Any future efforts on making fragment by hash lookup faster can focus on that area only and don't clutter the block processor. Signed-off-by: David Oberhollenzer

Cleanup: use fragment table primitive in data writer

2020-01-24T15:15:55+00:00

Signed-off-by: David Oberhollenzer

Cleanup: remove single use helper functions from data writer

2020-01-24T15:15:47+00:00

This commit moves the single use helper functions that are called from worker thread context into the worker thread function. Signed-off-by: David Oberhollenzer

Cleanup: remove the payload pointers from sqfs_inode_generic_t

2020-01-19T19:05:13+00:00

There are 3 types of extra payload: - Directory index - File block sizes - Symlink target This commit removes the type specific pointers and modifies the code to use the payload area directly. To simplify the file block case and mitigate alignment issues, the type of the extra field is changed to sqfs_u32. For symlink target, the extra field can simply be cast to a character pointer (it had to be cast anyway for most uses). For block sizes, probably the most common usecase, it can be used as is. For directory indices, there is a helper function anyway. Signed-off-by: David Oberhollenzer

Merge windows and pthread thread pool implementations

2019-12-13T01:27:17+00:00

Since they are both structured the same way using condition variables, they are only a few defines away from removing code duplication. Signed-off-by: David Oberhollenzer

Cleanup data writer

2019-12-13T01:05:42+00:00

Signed-off-by: David Oberhollenzer

Don't kick off the threads until the queue is full

2019-12-12T15:43:01+00:00

The idea is as follows: Initially let the user submit blocks until the queue is filled, then kick of the threads. Every thread will end up getting a block without any waits until they completely deplete the queue. Assuming the threads take longer to process the data than it takes the main thread to do I/O and submit new blocks, the queue should stay mostly filled with minimal wait times. Signed-off-by: David Oberhollenzer

Fix thread pool queue accounting

2019-12-12T11:48:33+00:00

- ONLY manipulate the back log counter in the main thread. - Fix the order of operations when submitting blocks. Signed-off-by: David Oberhollenzer

Replace SetEvent synchronization with condition variables

2019-12-08T15:48:59+00:00

It's cleaner, more stable and works pretty much the same way as the pthread version. The downside is that the minimum target for the library is now Windows Vista, or Server 2008. But both are over a decade old anyway, so this shouldn't be an issue. Signed-off-by: David Oberhollenzer