Gjsify LogoGjsify Logo

Buffers are the basic unit of data transfer in GStreamer. They contain the timing and offset along with other arbitrary metadata that is associated with the #GstMemory blocks that the buffer contains.

Buffers are usually created with gst_buffer_new(). After a buffer has been created one will typically allocate memory for it and add it to the buffer. The following example creates a buffer that can hold a given video frame with a given width, height and bits per plane.

  GstBuffer *buffer;
GstMemory *memory;
gint size, width, height, bpp;
...
size = width * height * bpp;
buffer = gst_buffer_new ();
memory = gst_allocator_alloc (NULL, size, NULL);
gst_buffer_insert_memory (buffer, -1, memory);
...

Alternatively, use gst_buffer_new_allocate() to create a buffer with preallocated data of a given size.

Buffers can contain a list of #GstMemory objects. You can retrieve how many memory objects with gst_buffer_n_memory() and you can get a pointer to memory with gst_buffer_peek_memory()

A buffer will usually have timestamps, and a duration, but neither of these are guaranteed (they may be set to #GST_CLOCK_TIME_NONE). Whenever a meaningful value can be given for these, they should be set. The timestamps and duration are measured in nanoseconds (they are #GstClockTime values).

The buffer DTS refers to the timestamp when the buffer should be decoded and is usually monotonically increasing. The buffer PTS refers to the timestamp when the buffer content should be presented to the user and is not always monotonically increasing.

A buffer can also have one or both of a start and an end offset. These are media-type specific. For video buffers, the start offset will generally be the frame number. For audio buffers, it will be the number of samples produced so far. For compressed data, it could be the byte offset in a source or destination file. Likewise, the end offset will be the offset of the end of the buffer. These can only be meaningfully interpreted if you know the media type of the buffer (the preceding CAPS event). Either or both can be set to #GST_BUFFER_OFFSET_NONE.

gst_buffer_ref() is used to increase the refcount of a buffer. This must be done when you want to keep a handle to the buffer after pushing it to the next element. The buffer refcount determines the writability of the buffer, a buffer is only writable when the refcount is exactly 1, i.e. when the caller has the only reference to the buffer.

To efficiently create a smaller buffer out of an existing one, you can use gst_buffer_copy_region(). This method tries to share the memory objects between the two buffers.

If a plug-in wants to modify the buffer data or metadata in-place, it should first obtain a buffer that is safe to modify by using gst_buffer_make_writable(). This function is optimized so that a copy will only be made when it is necessary.

Several flags of the buffer can be set and unset with the GST_BUFFER_FLAG_SET() and GST_BUFFER_FLAG_UNSET() macros. Use GST_BUFFER_FLAG_IS_SET() to test if a certain #GstBufferFlags flag is set.

Buffers can be efficiently merged into a larger buffer with gst_buffer_append(). Copying of memory will only be done when absolutely needed.

Arbitrary extra metadata can be set on a buffer with gst_buffer_add_meta(). Metadata can be retrieved with gst_buffer_get_meta(). See also #GstMeta.

An element should either unref the buffer or push it out on a src pad using gst_pad_push() (see #GstPad).

Buffers are usually freed by unreffing them with gst_buffer_unref(). When the refcount drops to 0, any memory and metadata pointed to by the buffer is unreffed as well. Buffers allocated from a #GstBufferPool will be returned to the pool when the refcount drops to 0.

The #GstParentBufferMeta is a meta which can be attached to a #GstBuffer to hold a reference to another buffer that is only released when the child #GstBuffer is released.

Typically, #GstParentBufferMeta is used when the child buffer is directly using the #GstMemory of the parent buffer, and wants to prevent the parent buffer from being returned to a buffer pool until the #GstMemory is available for re-use. (Since: 1.6)

record

Hierarchy

  • Buffer

Index

Constructors

Properties

dts: number

decoding timestamp of the buffer, can be #GST_CLOCK_TIME_NONE when the dts is not known or relevant. The dts contains the timestamp when the media should be processed.

field
duration: number

duration in time of the buffer data, can be #GST_CLOCK_TIME_NONE when the duration is not known or relevant.

field
mini_object: Gst.MiniObject

the parent structure

field
offset: number

a media specific offset for the buffer data. For video frames, this is the frame number of this buffer. For audio samples, this is the offset of the first sample in this buffer. For file data or compressed data this is the byte offset of the first byte in this buffer.

field
offset_end: number

the last offset contained in this buffer. It has the same format as offset.

field

pointer to the pool owner of the buffer

field
pts: number

presentation timestamp of the buffer, can be #GST_CLOCK_TIME_NONE when the pts is not known or relevant. The pts contains the timestamp when the media should be presented to the user.

field
name: string

Methods

  • Creates and adds a #GstCustomMeta for the desired name. name must have been successfully registered with gst_meta_register_custom().

    Parameters

    • name: string

      the registered name of the desired custom meta

    Returns CustomMeta

  • Adds a #GstReferenceTimestampMeta to buffer that holds a timestamp and optionally duration based on a specific timestamp reference. See the documentation of #GstReferenceTimestampMeta for details.

    Parameters

    • reference: Gst.Caps

      identifier for the timestamp reference.

    • timestamp: number

      timestamp

    • duration: number

      duration, or %GST_CLOCK_TIME_NONE

    Returns ReferenceTimestampMeta

  • Appends all the memory from buf2 to buf1. The result buffer will contain a concatenation of the memory of buf1 and buf2.

    Parameters

    • buf2: Gst.Buffer

      the second source #GstBuffer to append.

    Returns Gst.Buffer

  • append_memory(mem: Memory): void
  • Appends the memory block mem to buffer. This function takes ownership of mem and thus doesn't increase its refcount.

    This function is identical to gst_buffer_insert_memory() with an index of -1. See gst_buffer_insert_memory() for more details.

    Parameters

    Returns void

  • Appends size bytes at offset from buf2 to buf1. The result buffer will contain a concatenation of the memory of buf1 and the requested region of buf2.

    Parameters

    • buf2: Gst.Buffer

      the second source #GstBuffer to append.

    • offset: number

      the offset in buf2

    • size: number

      the size or -1 of buf2

    Returns Gst.Buffer

  • Copies the information from src into dest.

    If dest already contains memory and flags contains GST_BUFFER_COPY_MEMORY, the memory from src will be appended to dest.

    flags indicate which fields will be copied.

    Parameters

    • src: Gst.Buffer

      a source #GstBuffer

    • flags: Gst.BufferCopyFlags

      flags indicating what metadata fields should be copied.

    • offset: number

      offset to copy from

    • size: number

      total size to copy. If -1, all data is copied.

    Returns boolean

  • Creates a sub-buffer from parent at offset and size. This sub-buffer uses the actual memory space of the parent buffer. This function will copy the offset and timestamp fields when the offset is 0. If not, they will be set to #GST_CLOCK_TIME_NONE and #GST_BUFFER_OFFSET_NONE. If offset equals 0 and size equals the total size of buffer, the duration and offset end fields are also copied. If not they will be set to #GST_CLOCK_TIME_NONE and #GST_BUFFER_OFFSET_NONE.

    Parameters

    • flags: Gst.BufferCopyFlags

      the #GstBufferCopyFlags

    • offset: number

      the offset into parent #GstBuffer at which the new sub-buffer begins.

    • size: number

      the size of the new #GstBuffer sub-buffer, in bytes. If -1, all data is copied.

    Returns Gst.Buffer

  • extract(offset: number): [number, Uint8Array]
  • Copies size bytes starting from offset in buffer to dest.

    Parameters

    • offset: number

      the offset to extract

    Returns [number, Uint8Array]

  • extract_dup(offset: number, size: number): Uint8Array
  • Extracts a copy of at most size bytes the data at offset into newly-allocated memory. dest must be freed using g_free() when done.

    Parameters

    • offset: number

      the offset to extract

    • size: number

      the size to extract

    Returns Uint8Array

  • fill(offset: number, src: Uint8Array): number
  • Copies size bytes from src to buffer at offset.

    Parameters

    • offset: number

      the offset to fill

    • src: Uint8Array

      the source address

    Returns number

  • find_memory(offset: number, size: number): [boolean, number, number, number]
  • Finds the memory blocks that span size bytes starting from offset in buffer.

    When this function returns %TRUE, idx will contain the index of the first memory block where the byte for offset can be found and length contains the number of memory blocks containing the size remaining bytes. skip contains the number of bytes to skip in the memory block at idx to get to the byte for offset.

    size can be -1 to get all the memory blocks after idx.

    Parameters

    • offset: number

      an offset

    • size: number

      a size

    Returns [boolean, number, number, number]

  • Calls func with user_data for each meta in buffer.

    func can modify the passed meta pointer or its contents. The return value of func defines if this function returns or if the remaining metadata items in the buffer should be skipped.

    Parameters

    Returns boolean

  • Finds the first #GstCustomMeta on buffer for the desired name.

    Parameters

    • name: string

      the registered name of the custom meta to retrieve.

    Returns CustomMeta

  • get_memory(idx: number): Memory
  • get_memory_range(idx: number, length: number): Memory
  • Gets length memory blocks in buffer starting at idx. The memory blocks will be merged into one large #GstMemory.

    If length is -1, all memory starting from idx is merged.

    Parameters

    • idx: number

      an index

    • length: number

      a length

    Returns Memory

  • Gets the metadata for api on buffer. When there is no such metadata, %NULL is returned. If multiple metadata with the given api are attached to this buffer only the first one is returned. To handle multiple metadata with a given API use gst_buffer_iterate_meta() or gst_buffer_foreach_meta() instead and check the meta->info.api member for the API type.

    Parameters

    • api: GType<unknown>

      the #GType of an API

    Returns Meta

  • get_n_meta(api_type: GType<unknown>): number
  • Finds the first #GstReferenceTimestampMeta on buffer that conforms to reference. Conformance is tested by checking if the meta's reference is a subset of reference.

    Buffers can contain multiple #GstReferenceTimestampMeta metadata items.

    Parameters

    • reference: Gst.Caps

      a reference #GstCaps

    Returns ReferenceTimestampMeta

  • get_size(): number
  • get_sizes(): [number, number, number]
  • Gets the total size of the memory blocks in buffer.

    When not %NULL, offset will contain the offset of the data in the first memory block in buffer and maxsize will contain the sum of the size and offset and the amount of extra padding on the last memory block. offset and maxsize can be used to resize the buffer memory blocks with gst_buffer_resize().

    Returns [number, number, number]

  • get_sizes_range(idx: number, length: number): [number, number, number]
  • Gets the total size of length memory blocks stating from idx in buffer.

    When not %NULL, offset will contain the offset of the data in the memory block in buffer at idx and maxsize will contain the sum of the size and offset and the amount of extra padding on the memory block at idx + length -1. offset and maxsize can be used to resize the buffer memory blocks with gst_buffer_resize_range().

    Parameters

    • idx: number

      an index

    • length: number

      a length

    Returns [number, number, number]

  • insert_memory(idx: number, mem: Memory): void
  • Inserts the memory block mem into buffer at idx. This function takes ownership of mem and thus doesn't increase its refcount.

    Only gst_buffer_get_max_memory() can be added to a buffer. If more memory is added, existing memory blocks will automatically be merged to make room for the new memory.

    Parameters

    • idx: number

      the index to add the memory at, or -1 to append it to the end

    • mem: Memory

      a #GstMemory.

    Returns void

  • is_all_memory_writable(): boolean
  • Checks if all memory blocks in buffer are writable.

    Note that this function does not check if buffer is writable, use gst_buffer_is_writable() to check that if needed.

    Returns boolean

  • is_memory_range_writable(idx: number, length: number): boolean
  • Checks if length memory blocks in buffer starting from idx are writable.

    length can be -1 to check all the memory blocks after idx.

    Note that this function does not check if buffer is writable, use gst_buffer_is_writable() to check that if needed.

    Parameters

    • idx: number

      an index

    • length: number

      a length, should not be 0

    Returns boolean

  • Fills info with the #GstMapInfo of all merged memory blocks in buffer.

    flags describe the desired access of the memory. When flags is #GST_MAP_WRITE, buffer should be writable (as returned from gst_buffer_is_writable()).

    When buffer is writable but the memory isn't, a writable copy will automatically be created and returned. The readonly copy of the buffer memory will then also be replaced with this writable copy.

    The memory in info should be unmapped with gst_buffer_unmap() after usage.

    Parameters

    Returns [boolean, MapInfo]

  • Fills info with the #GstMapInfo of length merged memory blocks starting at idx in buffer. When length is -1, all memory blocks starting from idx are merged and mapped.

    flags describe the desired access of the memory. When flags is #GST_MAP_WRITE, buffer should be writable (as returned from gst_buffer_is_writable()).

    When buffer is writable but the memory isn't, a writable copy will automatically be created and returned. The readonly copy of the buffer memory will then also be replaced with this writable copy.

    The memory in info should be unmapped with gst_buffer_unmap() after usage.

    Parameters

    • idx: number

      an index

    • length: number

      a length

    • flags: Gst.MapFlags

      flags for the mapping

    Returns [boolean, MapInfo]

  • memcmp(offset: number, mem: Uint8Array): number
  • Compares size bytes starting from offset in buffer with the memory in mem.

    Parameters

    • offset: number

      the offset in buffer

    • mem: Uint8Array

      the memory to compare

    Returns number

  • memset(offset: number, val: number, size: number): number
  • Fills buf with size bytes with val starting from offset.

    Parameters

    • offset: number

      the offset in buffer

    • val: number

      the value to set

    • size: number

      the size to set

    Returns number

  • n_memory(): number
  • Gets the amount of memory blocks that this buffer has. This amount is never larger than what gst_buffer_get_max_memory() returns.

    Returns number

  • peek_memory(idx: number): Memory
  • Gets the memory block at idx in buffer. The memory block stays valid until the memory block in buffer is removed, replaced or merged, typically with any call that modifies the memory in buffer.

    Parameters

    • idx: number

      an index

    Returns Memory

  • prepend_memory(mem: Memory): void
  • Prepends the memory block mem to buffer. This function takes ownership of mem and thus doesn't increase its refcount.

    This function is identical to gst_buffer_insert_memory() with an index of 0. See gst_buffer_insert_memory() for more details.

    Parameters

    Returns void

  • remove_all_memory(): void
  • remove_memory(idx: number): void
  • remove_memory_range(idx: number, length: number): void
  • Removes length memory blocks in buffer starting from idx.

    length can be -1, in which case all memory starting from idx is removed.

    Parameters

    • idx: number

      an index

    • length: number

      a length

    Returns void

  • remove_meta(meta: Meta): boolean
  • replace_all_memory(mem: Memory): void
  • replace_memory(idx: number, mem: Memory): void
  • replace_memory_range(idx: number, length: number, mem: Memory): void
  • Replaces length memory blocks in buffer starting at idx with mem.

    If length is -1, all memory starting from idx will be removed and replaced with mem.

    buffer should be writable.

    Parameters

    • idx: number

      an index

    • length: number

      a length, should not be 0

    • mem: Memory

      a #GstMemory

    Returns void

  • resize(offset: number, size: number): void
  • Sets the offset and total size of the memory blocks in buffer.

    Parameters

    • offset: number

      the offset adjustment

    • size: number

      the new size or -1 to just adjust the offset

    Returns void

  • resize_range(idx: number, length: number, offset: number, size: number): boolean
  • Sets the total size of the length memory blocks starting at idx in buffer

    Parameters

    • idx: number

      an index

    • length: number

      a length

    • offset: number

      the offset adjustment

    • size: number

      the new size or -1 to just adjust the offset

    Returns boolean

  • set_size(size: number): void
  • get_max_memory(): number
  • Gets the maximum amount of memory blocks that a buffer can hold. This is a compile time constant that can be queried with the function.

    When more memory blocks are added, existing memory blocks will be merged together to make room for the new block.

    Returns number

  • Tries to create a newly allocated buffer with data of the given size and extra parameters from allocator. If the requested amount of memory can't be allocated, %NULL will be returned. The allocated buffer memory is not cleared.

    When allocator is %NULL, the default memory allocator will be used.

    Note that when size == 0, the buffer will not have memory associated with it.

    Parameters

    • allocator: Gst.Allocator

      the #GstAllocator to use, or %NULL to use the default allocator

    • size: number

      the size in bytes of the new buffer's data.

    • params: AllocationParams

      optional parameters

    Returns Gst.Buffer

  • Creates a new buffer that wraps the given data. The memory will be freed with g_free() and will be marked writable.

    Parameters

    • data: Uint8Array

      data to wrap

    Returns Gst.Buffer

  • Creates a new #GstBuffer that wraps the given bytes. The data inside bytes cannot be %NULL and the resulting buffer will be marked as read only.

    Parameters

    • bytes: Bytes

      a #GBytes to wrap

    Returns Gst.Buffer

  • Allocates a new buffer that wraps the given memory. data must point to maxsize of memory, the wrapped buffer will have the region from offset and size visible.

    When the buffer is destroyed, notify will be called with user_data.

    The prefix/padding must be filled with 0 if flags contains #GST_MEMORY_FLAG_ZERO_PREFIXED and #GST_MEMORY_FLAG_ZERO_PADDED respectively.

    Parameters

    • flags: MemoryFlags

      #GstMemoryFlags

    • data: Uint8Array

      data to wrap

    • maxsize: number

      allocated size of data

    • offset: number

      offset in data

    • notify: GLib.DestroyNotify

      called with user_data when the memory is freed

    Returns Gst.Buffer

Legend

  • Module
  • Object literal
  • Variable
  • Function
  • Function with type parameter
  • Index signature
  • Type alias
  • Type alias with type parameter
  • Enumeration
  • Enumeration member
  • Property
  • Method
  • Interface
  • Interface with type parameter
  • Constructor
  • Property
  • Method
  • Index signature
  • Class
  • Class with type parameter
  • Constructor
  • Property
  • Method
  • Accessor
  • Index signature
  • Inherited constructor
  • Inherited property
  • Inherited method
  • Inherited accessor
  • Protected property
  • Protected method
  • Protected accessor
  • Private property
  • Private method
  • Private accessor
  • Static property
  • Static method