Apparently Matroska files can link to separate files and splice them seamlessly?

https://mod16.org/hurfdurf/?p=8

For some time I've had an awesome usecase for this. Need to play a bit with this thing and see if I can make it work... (And if any players support this...)