This was discovered when using a Scarlett 6i6.
You can trigger the test more quickly by setting the initial loop indices to begin with the 6i6 and with 3 channels.

It distorts because the callback only implements mono or stereo.