layout_streaming.h

uint32_t STREAMING_DEFAULT_CHUNK_SIZE = 2 * 1024 * 1024

Default Streaming Chunk Size. This is used in StreamingLayoutCW

class StreamingLayoutCW : public ouster::osf::ChunksWriter

Sreaming Layout chunking strategy

TODO[pb]: sorting TBD as in RFC0018 but first pass should be good enough because usually messages from the same source and of the same type comes sorted from pcap/bag sources.

When messages laid out into chunks in an ordered as they come (not full RFC0018 compliant, see TODO below), with every chunk holding messages exclusively of a single stream_id. Tries not to exceede chunk_size (if possible). However if a single message size is bigger than specified chunk_size it’s still recorded.

Public Functions

StreamingLayoutCW(Writer &writer, uint32_t chunk_size = STREAMING_DEFAULT_CHUNK_SIZE)
Parameters:

  • writer – [in] Writer object for use when writing messages

  • chunk_size – [in] The chunk size to use, this arg is optional.

virtual void save_message(const uint32_t stream_id, const ts_t ts, const std::vector<uint8_t> &buf) override

Save a message to a specified stream.

Parameters:

  • stream_id – [in] The stream id to associate with the message.

  • ts – [in] The timestamp for the messages.

  • buf – [in] A vector of message buffers to record.

Throws:

std::logic_error – Exception on inconsistent timestamps.

virtual void finish() override

Finish the process of saving messages and write out the stream stats.

virtual uint32_t chunk_size() const override

Get the chunksize

Returns:

the chunk size