Dealing with data that come through as a stream of bytes

[ohmycaptainnemo]

Hi,

I really like npTDMS and am aware that it already allows for processing the TDMS file in chunks. But I could not find any examples of how to use npTDMS when the data is not in form of a file.
For example, I have a situation in which a large TDMS file comes through as chunks of bytes. Unfortunately, this means that even though reading the first chunk of bytes works as expected, the rest of the chunks result in the error:

ValueError: File should either start with 'b`TDSh`' or 'b`TDSm

or warnings such as:

[nptdms.reader WARNING] Last segment of file has less data than expected, will attempt to read to the end of the file

[nptdms.tdms_segment WARNING] Data size 3705 is not a multiple of the chunk size 7232. Will attempt to read last chunk

Which makes sense. Furthermore, in my case, I cannot read the large TDMS file into the memory and then wrap it in a BytesIO object as I do not have large memory at my disposal. So the only way I can think of is to process the chunks of data as they come through.

I would appreciate any thoughts or ideas regarding how it would be possible and how to use npTDMS for this use case.