onnx-mlir

Logo

Representation and Reference Lowering of ONNX Models in MLIR Compiler Infrastructure

View the Project on GitHub onnx/onnx-mlir

How-Tos

Inference Using Python
Inference Using C/C++
Inference Using Java

References

ONNX Dialect
OMTensor C99 Runtime API
OMTensorList C99 Runtime API
OMTensor Java Runtime API
OMTensorList Java Runtime API
Generate ONNX Dialect
About Documentation

Development

Add an Operation
Testing Guidelines
Error Handling
Command-line Options
Instrumentation
Constant Propagation
Add an Accelerator

Tools

Tools

RunONNXModel.py
DocCheck

This project is maintained by onnx

Hosted on GitHub Pages — Theme by orderedlist

onnx-mlir: com.ibm.onnxmlir.OMTensor Class Reference
onnx-mlir

Public Member Functions

 OMTensor (byte[] data, long[] shape, boolean flag)
 
 OMTensor (byte[] data, long[] shape)
 
 OMTensor (short[] data, long[] shape)
 
 OMTensor (int[] data, long[] shape)
 
 OMTensor (long[] data, long[] shape)
 
 OMTensor (float[] data, long[] shape)
 
 OMTensor (double[] data, long[] shape)
 
byte[] getBoolData ()
 
void setBoolData (byte[] data)
 
byte[] getByteData ()
 
void setByteData (byte[] data)
 
short[] getShortData ()
 
void setShortData (short[] data)
 
int[] getIntData ()
 
void setIntData (int[] data)
 
long[] getLongData ()
 
void setLongData (long[] data)
 
float[] getFloatData ()
 
void setFloatData (float[] data)
 
double[] getDoubleData ()
 
void setDoubleData (double[] data)
 
long[] getShape ()
 
void setShape (long[] shape)
 
long[] getStrides ()
 
void setStrides (long[] strides)
 
int getDataType ()
 
void setDataType (int dataType)
 
long getBufferSize ()
 
long getRank ()
 
long getNumElems ()
 

Static Public Attributes

static final int ONNX_TYPE_UNDEFINED = 0
 
static final int ONNX_TYPE_FLOAT = 1
 
static final int ONNX_TYPE_UINT8 = 2
 
static final int ONNX_TYPE_INT8 = 3
 
static final int ONNX_TYPE_UINT16 = 4
 
static final int ONNX_TYPE_INT16 = 5
 
static final int ONNX_TYPE_INT32 = 6
 
static final int ONNX_TYPE_INT64 = 7
 
static final int ONNX_TYPE_STRING = 8
 
static final int ONNX_TYPE_BOOL = 9
 
static final int ONNX_TYPE_FLOAT16 = 10
 
static final int ONNX_TYPE_DOUBLE = 11
 
static final int ONNX_TYPE_UINT32 = 12
 
static final int ONNX_TYPE_UINT64 = 13
 
static final int ONNX_TYPE_COMPLEX64 = 14
 
static final int ONNX_TYPE_COMPLEX128 = 15
 
static final int ONNX_TYPE_BFLOAT16 = 16
 
static final int ONNX_TYPE_FLOAT8E4M3FN = 17
 
static final int ONNX_TYPE_FLOAT8E4M3FNUZ = 18
 
static final int ONNX_TYPE_FLOAT8E5M2 = 19
 
static final int ONNX_TYPE_FLOAT8E5M2FNUZ = 20
 
static final int LAST_ONNX_TYPE = 20
 
static final int[] ONNX_TYPE_SIZE
 
static final String[] ONNX_TYPE_NAME
 

Protected Member Functions

 OMTensor (ByteBuffer data, long[] shape, ByteOrder endian, int dataType)
 
 OMTensor (ByteBuffer data, long[] shape, long[] strides, int dataType)
 
ByteBuffer getData ()
 
void setData (ByteBuffer data)
 

Detailed Description

Class describing the runtime information such as rank, shape, strides, data type, etc. associated with a tensor input/output.

Constructor & Destructor Documentation

◆ OMTensor() [1/9]

com.ibm.onnxmlir.OMTensor.OMTensor ( byte[]  data,
long[]  shape,
boolean  flag 
)
inline

Constructor

Parameters
databyte data array for tensor
shapedata shape array
flagtrue for boolean tensor, false for byte tensor
Returns
OMTensor with boolean or byte data

◆ OMTensor() [2/9]

com.ibm.onnxmlir.OMTensor.OMTensor ( byte[]  data,
long[]  shape 
)
inline

Constructor

Parameters
databyte data array for tensor
shapedata shape array
Returns
OMTensor with byte data

◆ OMTensor() [3/9]

com.ibm.onnxmlir.OMTensor.OMTensor ( short[]  data,
long[]  shape 
)
inline

Constructor

Parameters
datashort data array for tensor
shapedata shape array
Returns
OMTensor with short data

◆ OMTensor() [4/9]

com.ibm.onnxmlir.OMTensor.OMTensor ( int[]  data,
long[]  shape 
)
inline

Constructor

Parameters
dataint data array for tensor
shapedata shape array
Returns
OMTensor with int data

◆ OMTensor() [5/9]

com.ibm.onnxmlir.OMTensor.OMTensor ( long[]  data,
long[]  shape 
)
inline

Constructor

Parameters
datalong data array for tensor
shapedata shape array
Returns
OMTensor with long data

◆ OMTensor() [6/9]

com.ibm.onnxmlir.OMTensor.OMTensor ( float[]  data,
long[]  shape 
)
inline

Constructor

Parameters
datafloat data array for tensor
shapedata shape array
Returns
OMTensor with float data

◆ OMTensor() [7/9]

com.ibm.onnxmlir.OMTensor.OMTensor ( double[]  data,
long[]  shape 
)
inline

Constructor

Parameters
datadouble data array for tensor
shapedata shape array
Returns
OMTensor with double data

◆ OMTensor() [8/9]

com.ibm.onnxmlir.OMTensor.OMTensor ( ByteBuffer  data,
long[]  shape,
ByteOrder  endian,
int  dataType 
)
inlineprotected

Constructor (For OMRunner only. Not intended for end user)

Parameters
datadata buffer
shapedata shape
dataTypedata type
endiandata endian

◆ OMTensor() [9/9]

com.ibm.onnxmlir.OMTensor.OMTensor ( ByteBuffer  data,
long[]  shape,
long[]  strides,
int  dataType 
)
inlineprotected

Constructor (For JNI wrapper only. Not intended for end user)

Parameters
datadata buffer
shapedata shape
stridesdata stride
dataTypedata type

Member Function Documentation

◆ getBoolData()

byte [] com.ibm.onnxmlir.OMTensor.getBoolData ( )
inline

Bool data getter

Returns
bool data array

◆ getBufferSize()

long com.ibm.onnxmlir.OMTensor.getBufferSize ( )
inline

Data buffer size getter

Returns
total size of the data buffer in bytes

◆ getByteData()

byte [] com.ibm.onnxmlir.OMTensor.getByteData ( )
inline

Byte data getter

Returns
byte data array

◆ getData()

ByteBuffer com.ibm.onnxmlir.OMTensor.getData ( )
inlineprotected

Raw data getter (For JNI wrapper only. Not intended for end user)

Returns
raw data

◆ getDataType()

int com.ibm.onnxmlir.OMTensor.getDataType ( )
inline

Data type getter

Returns
data type

◆ getDoubleData()

double [] com.ibm.onnxmlir.OMTensor.getDoubleData ( )
inline

Double data getter

Returns
double data array

◆ getFloatData()

float [] com.ibm.onnxmlir.OMTensor.getFloatData ( )
inline

Float data getter

Returns
float data array

◆ getIntData()

int [] com.ibm.onnxmlir.OMTensor.getIntData ( )
inline

Int data getter

Returns
int data array

◆ getLongData()

long [] com.ibm.onnxmlir.OMTensor.getLongData ( )
inline

Long data getter

Returns
long data array

◆ getNumElems()

long com.ibm.onnxmlir.OMTensor.getNumElems ( )
inline

Number of elements getter

Returns
number of data elements in the data buffer

◆ getRank()

long com.ibm.onnxmlir.OMTensor.getRank ( )
inline

Rank getter (return long to be consistent with C/C++ API)

Returns
rank of the OMTensor

◆ getShape()

long [] com.ibm.onnxmlir.OMTensor.getShape ( )
inline

Data shape getter

Returns
data shape array

◆ getShortData()

short [] com.ibm.onnxmlir.OMTensor.getShortData ( )
inline

Short data getter

Returns
short data array

◆ getStrides()

long [] com.ibm.onnxmlir.OMTensor.getStrides ( )
inline

Data strides getter

Returns
data strides array

◆ setBoolData()

void com.ibm.onnxmlir.OMTensor.setBoolData ( byte[]  data)
inline

Bool data setter

Parameters
databool array to be set

◆ setByteData()

void com.ibm.onnxmlir.OMTensor.setByteData ( byte[]  data)
inline

Byte data setter

Parameters
databyte array to be set

◆ setData()

void com.ibm.onnxmlir.OMTensor.setData ( ByteBuffer  data)
inlineprotected

Raw data setter (For JNI wrapper only. Not intended for end user)

Parameters
dataraw data to be set

◆ setDataType()

void com.ibm.onnxmlir.OMTensor.setDataType ( int  dataType)
inline

Data type setter

Parameters
dataTypedata type to be set

◆ setDoubleData()

void com.ibm.onnxmlir.OMTensor.setDoubleData ( double[]  data)
inline

Double data setter

Parameters
datadouble array to be set

◆ setFloatData()

void com.ibm.onnxmlir.OMTensor.setFloatData ( float[]  data)
inline

Float data setter

Parameters
datafloat array to be set

◆ setIntData()

void com.ibm.onnxmlir.OMTensor.setIntData ( int[]  data)
inline

Int data setter

Parameters
dataint array to be set

◆ setLongData()

void com.ibm.onnxmlir.OMTensor.setLongData ( long[]  data)
inline

Long data setter

Parameters
datalong array to be set

◆ setShape()

void com.ibm.onnxmlir.OMTensor.setShape ( long[]  shape)
inline

Data shape setter

Parameters
shapedata shape array to be set

◆ setShortData()

void com.ibm.onnxmlir.OMTensor.setShortData ( short[]  data)
inline

Short data setter

Parameters
datashort array to be set

◆ setStrides()

void com.ibm.onnxmlir.OMTensor.setStrides ( long[]  strides)
inline

Data strides setter

Parameters
stridesdata strides array to be set

Member Data Documentation

◆ LAST_ONNX_TYPE

final int com.ibm.onnxmlir.OMTensor.LAST_ONNX_TYPE = 20
static

◆ ONNX_TYPE_BFLOAT16

final int com.ibm.onnxmlir.OMTensor.ONNX_TYPE_BFLOAT16 = 16
static

◆ ONNX_TYPE_BOOL

final int com.ibm.onnxmlir.OMTensor.ONNX_TYPE_BOOL = 9
static

◆ ONNX_TYPE_COMPLEX128

final int com.ibm.onnxmlir.OMTensor.ONNX_TYPE_COMPLEX128 = 15
static

◆ ONNX_TYPE_COMPLEX64

final int com.ibm.onnxmlir.OMTensor.ONNX_TYPE_COMPLEX64 = 14
static

◆ ONNX_TYPE_DOUBLE

final int com.ibm.onnxmlir.OMTensor.ONNX_TYPE_DOUBLE = 11
static

◆ ONNX_TYPE_FLOAT

final int com.ibm.onnxmlir.OMTensor.ONNX_TYPE_FLOAT = 1
static

◆ ONNX_TYPE_FLOAT16

final int com.ibm.onnxmlir.OMTensor.ONNX_TYPE_FLOAT16 = 10
static

◆ ONNX_TYPE_FLOAT8E4M3FN

final int com.ibm.onnxmlir.OMTensor.ONNX_TYPE_FLOAT8E4M3FN = 17
static

◆ ONNX_TYPE_FLOAT8E4M3FNUZ

final int com.ibm.onnxmlir.OMTensor.ONNX_TYPE_FLOAT8E4M3FNUZ = 18
static

◆ ONNX_TYPE_FLOAT8E5M2

final int com.ibm.onnxmlir.OMTensor.ONNX_TYPE_FLOAT8E5M2 = 19
static

◆ ONNX_TYPE_FLOAT8E5M2FNUZ

final int com.ibm.onnxmlir.OMTensor.ONNX_TYPE_FLOAT8E5M2FNUZ = 20
static

◆ ONNX_TYPE_INT16

final int com.ibm.onnxmlir.OMTensor.ONNX_TYPE_INT16 = 5
static

◆ ONNX_TYPE_INT32

final int com.ibm.onnxmlir.OMTensor.ONNX_TYPE_INT32 = 6
static

◆ ONNX_TYPE_INT64

final int com.ibm.onnxmlir.OMTensor.ONNX_TYPE_INT64 = 7
static

◆ ONNX_TYPE_INT8

final int com.ibm.onnxmlir.OMTensor.ONNX_TYPE_INT8 = 3
static

◆ ONNX_TYPE_NAME

final String [] com.ibm.onnxmlir.OMTensor.ONNX_TYPE_NAME
static
Initial value:
= new String[] {
"UNDEFINED",
"FLOAT",
"UINT8",
"INT8",
"UINT16",
"INT16",
"INT32",
"INT64",
"STRING",
"BOOL",
"FLOAT16",
"DOUBLE",
"UINT32",
"UINT64",
"COMPLEX64",
"COMPLEX128",
"BFLOAT16",
"FLOAT8E4M3FN",
"FLOAT8E4M3FNUZ",
"FLOAT8E5M2",
"FLOAT8E5M2FNUZ",
}

◆ ONNX_TYPE_SIZE

final int [] com.ibm.onnxmlir.OMTensor.ONNX_TYPE_SIZE
static
Initial value:
= new int[] {
0,
4,
1,
1,
2,
2,
4,
8,
0,
1,
2,
8,
4,
8,
8,
16,
2,
1,
1,
1,
1,
}

◆ ONNX_TYPE_STRING

final int com.ibm.onnxmlir.OMTensor.ONNX_TYPE_STRING = 8
static

◆ ONNX_TYPE_UINT16

final int com.ibm.onnxmlir.OMTensor.ONNX_TYPE_UINT16 = 4
static

◆ ONNX_TYPE_UINT32

final int com.ibm.onnxmlir.OMTensor.ONNX_TYPE_UINT32 = 12
static

◆ ONNX_TYPE_UINT64

final int com.ibm.onnxmlir.OMTensor.ONNX_TYPE_UINT64 = 13
static

◆ ONNX_TYPE_UINT8

final int com.ibm.onnxmlir.OMTensor.ONNX_TYPE_UINT8 = 2
static

◆ ONNX_TYPE_UNDEFINED

final int com.ibm.onnxmlir.OMTensor.ONNX_TYPE_UNDEFINED = 0
static

The documentation for this class was generated from the following file: