block_stream might drop up to n_jobs - 1 complete frames

[beasteers]

The offending line is here:

birdvoxpaint/birdvoxpaint/util.py

Line 80 in a1ecf85

y_blocks = (y for y in y_blocks if y.size == block_length)

This line is meant to drop blocks that don't have enough samples. But since we're working with multiprocessing and are loading block_size * n_jobs, if we have block_size * (n_jobs - 1) + 3, it would drop that entire block instead of just the +3.

Another issue with that line is that it assumes a mono signal, so that's not good either.

A solution could be:

single_block_length = block_length // n_blocks
y_blocks = (
    y[:(y.shape[0] // single_block_length) * single_block_length] 
    for y in y_blocks)

This just makes sure that y.shape[0] is divisible by block_length / n_jobs

[lostanlen]

yes, but now what if y.shape[0] < single_block_length ?

[beasteers]

Right, good point. How bout this?

single_block_length = block_length // n_blocks
y_blocks = (
    y[:(y.shape[0] // single_block_length) * single_block_length] 
    for y in y_blocks)

# +
y_blocks = (y for y in y_blocks if y.shape[0])

Not sure how many nested generators is too many lol 🤷🏼‍♀️