DPDK  19.02.0
Data Structures | Functions
rte_malloc.h File Reference
#include <stdio.h>
#include <stddef.h>
#include <rte_compat.h>
#include <rte_memory.h>

Go to the source code of this file.

Data Structures

struct  rte_malloc_socket_stats

Functions

void * rte_malloc (const char *type, size_t size, unsigned align)
void * rte_zmalloc (const char *type, size_t size, unsigned align)
void * rte_calloc (const char *type, size_t num, size_t size, unsigned align)
void * rte_realloc (void *ptr, size_t size, unsigned align)
void * rte_malloc_socket (const char *type, size_t size, unsigned align, int socket)
void * rte_zmalloc_socket (const char *type, size_t size, unsigned align, int socket)
void * rte_calloc_socket (const char *type, size_t num, size_t size, unsigned align, int socket)
void rte_free (void *ptr)
int rte_malloc_validate (const void *ptr, size_t *size)
int rte_malloc_get_socket_stats (int socket, struct rte_malloc_socket_stats *socket_stats)
int __rte_experimental rte_malloc_heap_memory_add (const char *heap_name, void *va_addr, size_t len, rte_iova_t iova_addrs[], unsigned int n_pages, size_t page_sz)
int __rte_experimental rte_malloc_heap_memory_remove (const char *heap_name, void *va_addr, size_t len)
int __rte_experimental rte_malloc_heap_memory_attach (const char *heap_name, void *va_addr, size_t len)
int __rte_experimental rte_malloc_heap_memory_detach (const char *heap_name, void *va_addr, size_t len)
int __rte_experimental rte_malloc_heap_create (const char *heap_name)
int __rte_experimental rte_malloc_heap_destroy (const char *heap_name)
int __rte_experimental rte_malloc_heap_get_socket (const char *name)
int __rte_experimental rte_malloc_heap_socket_is_external (int socket_id)
void rte_malloc_dump_stats (FILE *f, const char *type)
void __rte_experimental rte_malloc_dump_heaps (FILE *f)
int rte_malloc_set_limit (const char *type, size_t max)
rte_iova_t rte_malloc_virt2iova (const void *addr)

Detailed Description

RTE Malloc. This library provides methods for dynamically allocating memory from hugepages.

Definition in file rte_malloc.h.

Function Documentation

void* rte_malloc ( const char *  type,
size_t  size,
unsigned  align 
)

This function allocates memory from the huge-page area of memory. The memory is not cleared. In NUMA systems, the memory allocated resides on the same NUMA socket as the core that calls this function.

Parameters
typeA string identifying the type of allocated objects (useful for debug purposes, such as identifying the cause of a memory leak). Can be NULL.
sizeSize (in bytes) to be allocated.
alignIf 0, the return is a pointer that is suitably aligned for any kind of variable (in the same manner as malloc()). Otherwise, the return is a pointer that is a multiple of align. In this case, it must be a power of two. (Minimum alignment is the cacheline size, i.e. 64-bytes)
Returns
  • NULL on error. Not enough memory, or invalid arguments (size is 0, align is not a power of two).
  • Otherwise, the pointer to the allocated object.
Examples:
examples/distributor/main.c, examples/eventdev_pipeline/main.c, examples/fips_validation/fips_dev_self_test.c, examples/fips_validation/main.c, examples/l2fwd-crypto/main.c, examples/multi_process/client_server_mp/mp_server/init.c, examples/qos_sched/main.c, examples/server_node_efd/server/init.c, examples/vm_power_manager/channel_manager.c, and examples/vm_power_manager/channel_monitor.c.
void* rte_zmalloc ( const char *  type,
size_t  size,
unsigned  align 
)

Allocate zero'ed memory from the heap.

Equivalent to rte_malloc() except that the memory zone is initialised with zeros. In NUMA systems, the memory allocated resides on the same NUMA socket as the core that calls this function.

Parameters
typeA string identifying the type of allocated objects (useful for debug purposes, such as identifying the cause of a memory leak). Can be NULL.
sizeSize (in bytes) to be allocated.
alignIf 0, the return is a pointer that is suitably aligned for any kind of variable (in the same manner as malloc()). Otherwise, the return is a pointer that is a multiple of align. In this case, it must obviously be a power of two. (Minimum alignment is the cacheline size, i.e. 64-bytes)
Returns
  • NULL on error. Not enough memory, or invalid arguments (size is 0, align is not a power of two).
  • Otherwise, the pointer to the allocated object.
Examples:
examples/eventdev_pipeline/pipeline_worker_tx.c, examples/fips_validation/fips_validation.c, examples/fips_validation/fips_validation_ccm.c, examples/fips_validation/fips_validation_tdes.c, examples/flow_classify/flow_classify.c, examples/kni/main.c, examples/tep_termination/main.c, examples/vhost/main.c, examples/vhost_scsi/vhost_scsi.c, and examples/vm_power_manager/channel_manager.c.
void* rte_calloc ( const char *  type,
size_t  num,
size_t  size,
unsigned  align 
)

Replacement function for calloc(), using huge-page memory. Memory area is initialised with zeros. In NUMA systems, the memory allocated resides on the same NUMA socket as the core that calls this function.

Parameters
typeA string identifying the type of allocated objects (useful for debug purposes, such as identifying the cause of a memory leak). Can be NULL.
numNumber of elements to be allocated.
sizeSize (in bytes) of a single element.
alignIf 0, the return is a pointer that is suitably aligned for any kind of variable (in the same manner as malloc()). Otherwise, the return is a pointer that is a multiple of align. In this case, it must obviously be a power of two. (Minimum alignment is the cacheline size, i.e. 64-bytes)
Returns
  • NULL on error. Not enough memory, or invalid arguments (size is 0, align is not a power of two).
  • Otherwise, the pointer to the allocated object.
Examples:
examples/eventdev_pipeline/main.c.
void* rte_realloc ( void *  ptr,
size_t  size,
unsigned  align 
)

Replacement function for realloc(), using huge-page memory. Reserved area memory is resized, preserving contents. In NUMA systems, the new area resides on the same NUMA socket as the old area.

Parameters
ptrPointer to already allocated memory
sizeSize (in bytes) of new area. If this is 0, memory is freed.
alignIf 0, the return is a pointer that is suitably aligned for any kind of variable (in the same manner as malloc()). Otherwise, the return is a pointer that is a multiple of align. In this case, it must obviously be a power of two. (Minimum alignment is the cacheline size, i.e. 64-bytes)
Returns
  • NULL on error. Not enough memory, or invalid arguments (size is 0, align is not a power of two).
  • Otherwise, the pointer to the reallocated memory.
Examples:
examples/eventdev_pipeline/pipeline_worker_tx.c.
void* rte_malloc_socket ( const char *  type,
size_t  size,
unsigned  align,
int  socket 
)

This function allocates memory from the huge-page area of memory. The memory is not cleared.

Parameters
typeA string identifying the type of allocated objects (useful for debug purposes, such as identifying the cause of a memory leak). Can be NULL.
sizeSize (in bytes) to be allocated.
alignIf 0, the return is a pointer that is suitably aligned for any kind of variable (in the same manner as malloc()). Otherwise, the return is a pointer that is a multiple of align. In this case, it must be a power of two. (Minimum alignment is the cacheline size, i.e. 64-bytes)
socketNUMA socket to allocate memory on. If SOCKET_ID_ANY is used, this function will behave the same as rte_malloc().
Returns
  • NULL on error. Not enough memory, or invalid arguments (size is 0, align is not a power of two).
  • Otherwise, the pointer to the allocated object.
void* rte_zmalloc_socket ( const char *  type,
size_t  size,
unsigned  align,
int  socket 
)

Allocate zero'ed memory from the heap.

Equivalent to rte_malloc() except that the memory zone is initialised with zeros.

Parameters
typeA string identifying the type of allocated objects (useful for debug purposes, such as identifying the cause of a memory leak). Can be NULL.
sizeSize (in bytes) to be allocated.
alignIf 0, the return is a pointer that is suitably aligned for any kind of variable (in the same manner as malloc()). Otherwise, the return is a pointer that is a multiple of align. In this case, it must obviously be a power of two. (Minimum alignment is the cacheline size, i.e. 64-bytes)
socketNUMA socket to allocate memory on. If SOCKET_ID_ANY is used, this function will behave the same as rte_zmalloc().
Returns
  • NULL on error. Not enough memory, or invalid arguments (size is 0, align is not a power of two).
  • Otherwise, the pointer to the allocated object.
Examples:
examples/ip_reassembly/main.c, examples/ipsec-secgw/sa.c, examples/l2fwd-jobstats/main.c, examples/l2fwd-keepalive/main.c, examples/l2fwd/main.c, examples/l3fwd-acl/main.c, examples/l3fwd-power/main.c, examples/link_status_interrupt/main.c, examples/multi_process/client_server_mp/mp_client/client.c, examples/netmap_compat/lib/compat_netmap.c, examples/packet_ordering/main.c, examples/qos_meter/main.c, examples/server_node_efd/node/node.c, and examples/vhost_crypto/main.c.
void* rte_calloc_socket ( const char *  type,
size_t  num,
size_t  size,
unsigned  align,
int  socket 
)

Replacement function for calloc(), using huge-page memory. Memory area is initialised with zeros.

Parameters
typeA string identifying the type of allocated objects (useful for debug purposes, such as identifying the cause of a memory leak). Can be NULL.
numNumber of elements to be allocated.
sizeSize (in bytes) of a single element.
alignIf 0, the return is a pointer that is suitably aligned for any kind of variable (in the same manner as malloc()). Otherwise, the return is a pointer that is a multiple of align. In this case, it must obviously be a power of two. (Minimum alignment is the cacheline size, i.e. 64-bytes)
socketNUMA socket to allocate memory on. If SOCKET_ID_ANY is used, this function will behave the same as rte_calloc().
Returns
  • NULL on error. Not enough memory, or invalid arguments (size is 0, align is not a power of two).
  • Otherwise, the pointer to the allocated object.
Examples:
examples/performance-thread/common/lthread_sched.c.
void rte_free ( void *  ptr)
int rte_malloc_validate ( const void *  ptr,
size_t *  size 
)

If malloc debug is enabled, check a memory block for header and trailer markers to indicate that all is well with the block. If size is non-null, also return the size of the block.

Parameters
ptrpointer to the start of a data block, must have been returned by a previous call to rte_malloc(), rte_zmalloc(), rte_calloc() or rte_realloc()
sizeif non-null, and memory block pointer is valid, returns the size of the memory block
Returns
-1 on error, invalid pointer passed or header and trailer markers are missing or corrupted 0 on success
int rte_malloc_get_socket_stats ( int  socket,
struct rte_malloc_socket_stats socket_stats 
)

Get heap statistics for the specified heap.

Note
This function is not thread-safe with respect to rte_malloc_heap_create()/rte_malloc_heap_destroy() functions.
Parameters
socketAn unsigned integer specifying the socket to get heap statistics for
socket_statsA structure which provides memory to store statistics
Returns
Null on error Pointer to structure storing statistics on success
int __rte_experimental rte_malloc_heap_memory_add ( const char *  heap_name,
void *  va_addr,
size_t  len,
rte_iova_t  iova_addrs[],
unsigned int  n_pages,
size_t  page_sz 
)

Add memory chunk to a heap with specified name.

Note
Multiple memory chunks can be added to the same heap
Before accessing this memory in other processes, it needs to be attached in each of those processes by calling rte_malloc_heap_memory_attach in each other process.
Memory must be previously allocated for DPDK to be able to use it as a malloc heap. Failing to do so will result in undefined behavior, up to and including segmentation faults.
Calling this function will erase any contents already present at the supplied memory address.
Parameters
heap_nameName of the heap to add memory chunk to
va_addrStart of virtual area to add to the heap. Must be aligned by page_sz.
lenLength of virtual area to add to the heap. Must be aligned by page_sz.
iova_addrsArray of page IOVA addresses corresponding to each page in this memory area. Can be NULL, in which case page IOVA addresses will be set to RTE_BAD_IOVA.
n_pagesNumber of elements in the iova_addrs array. Ignored if iova_addrs is NULL.
page_szPage size of the underlying memory
Returns
  • 0 on success
  • -1 in case of error, with rte_errno set to one of the following: EINVAL - one of the parameters was invalid EPERM - attempted to add memory to a reserved heap ENOSPC - no more space in internal config to store a new memory chunk
int __rte_experimental rte_malloc_heap_memory_remove ( const char *  heap_name,
void *  va_addr,
size_t  len 
)

Remove memory chunk from heap with specified name.

Note
Memory chunk being removed must be the same as one that was added; partially removing memory chunks is not supported
Memory area must not contain any allocated elements to allow its removal from the heap
All other processes must detach from the memory chunk prior to it being removed from the heap.
Parameters
heap_nameName of the heap to remove memory from
va_addrVirtual address to remove from the heap
lenLength of virtual area to remove from the heap
Returns
  • 0 on success
  • -1 in case of error, with rte_errno set to one of the following: EINVAL - one of the parameters was invalid EPERM - attempted to remove memory from a reserved heap ENOENT - heap or memory chunk was not found EBUSY - memory chunk still contains data
int __rte_experimental rte_malloc_heap_memory_attach ( const char *  heap_name,
void *  va_addr,
size_t  len 
)

Attach to an already existing chunk of external memory in another process.

Note
This function must be called before any attempt is made to use an already existing external memory chunk. This function does not need to be called if a call to rte_malloc_heap_memory_add was made in the current process.
Parameters
heap_nameHeap name to which this chunk of memory belongs
va_addrStart address of memory chunk to attach to
lenLength of memory chunk to attach to
Returns
0 on successful attach -1 on unsuccessful attach, with rte_errno set to indicate cause for error: EINVAL - one of the parameters was invalid EPERM - attempted to attach memory to a reserved heap ENOENT - heap or memory chunk was not found
int __rte_experimental rte_malloc_heap_memory_detach ( const char *  heap_name,
void *  va_addr,
size_t  len 
)

Detach from a chunk of external memory in secondary process.

Note
This function must be called in before any attempt is made to remove external memory from the heap in another process. This function does not need to be called if a call to rte_malloc_heap_memory_remove will be called in current process.
Parameters
heap_nameHeap name to which this chunk of memory belongs
va_addrStart address of memory chunk to attach to
lenLength of memory chunk to attach to
Returns
0 on successful detach -1 on unsuccessful detach, with rte_errno set to indicate cause for error: EINVAL - one of the parameters was invalid EPERM - attempted to detach memory from a reserved heap ENOENT - heap or memory chunk was not found
int __rte_experimental rte_malloc_heap_create ( const char *  heap_name)

Creates a new empty malloc heap with a specified name.

Note
Heaps created via this call will automatically get assigned a unique socket ID, which can be found using rte_malloc_heap_get_socket()
Parameters
heap_nameName of the heap to create.
Returns
  • 0 on successful creation
  • -1 in case of error, with rte_errno set to one of the following: EINVAL - heap_name was NULL, empty or too long EEXIST - heap by name of heap_name already exists ENOSPC - no more space in internal config to store a new heap
int __rte_experimental rte_malloc_heap_destroy ( const char *  heap_name)

Destroys a previously created malloc heap with specified name.

Note
This function will return a failure result if not all memory allocated from the heap has been freed back to the heap
This function will return a failure result if not all memory segments were removed from the heap prior to its destruction
Parameters
heap_nameName of the heap to create.
Returns
  • 0 on success
  • -1 in case of error, with rte_errno set to one of the following: EINVAL - heap_name was NULL, empty or too long ENOENT - heap by the name of heap_name was not found EPERM - attempting to destroy reserved heap EBUSY - heap still contains data
int __rte_experimental rte_malloc_heap_get_socket ( const char *  name)

Find socket ID corresponding to a named heap.

Parameters
nameHeap name to find socket ID for
Returns
Socket ID in case of success (a non-negative number) -1 in case of error, with rte_errno set to one of the following: EINVAL - name was NULL ENOENT - heap identified by the name name was not found
int __rte_experimental rte_malloc_heap_socket_is_external ( int  socket_id)

Check if a given socket ID refers to externally allocated memory.

Note
Passing SOCKET_ID_ANY will return 0.
Parameters
socket_idSocket ID to check
Returns
1 if socket ID refers to externally allocated memory 0 if socket ID refers to internal DPDK memory -1 if socket ID is invalid
void rte_malloc_dump_stats ( FILE *  f,
const char *  type 
)

Dump statistics.

Dump for the specified type to a file. If the type argument is NULL, all memory types will be dumped.

Note
This function is not thread-safe with respect to rte_malloc_heap_create()/rte_malloc_heap_destroy() functions.
Parameters
fA pointer to a file for output
typeA string identifying the type of objects to dump, or NULL to dump all objects.
void __rte_experimental rte_malloc_dump_heaps ( FILE *  f)

Dump contents of all malloc heaps to a file.

Note
This function is not thread-safe with respect to rte_malloc_heap_create()/rte_malloc_heap_destroy() functions.
Parameters
fA pointer to a file for output
int rte_malloc_set_limit ( const char *  type,
size_t  max 
)

Set the maximum amount of allocated memory for this type.

This is not yet implemented

Parameters
typeA string identifying the type of allocated objects.
maxThe maximum amount of allocated bytes for this type.
Returns
  • 0: Success.
  • (-1): Error.
rte_iova_t rte_malloc_virt2iova ( const void *  addr)

Return the IO address of a virtual address obtained through rte_malloc

Parameters
addrAddress obtained from a previous rte_malloc call
Returns
RTE_BAD_IOVA on error otherwise return an address suitable for IO
Examples:
examples/fips_validation/fips_dev_self_test.c, examples/fips_validation/main.c, and examples/l2fwd-crypto/main.c.