Technical DetailsΒΆ This section enters into implementation details, technical descriptions, deeper than the code documentation. Float stored in 8 bits Papers E4M3FN and E5M2 E4M3FNUZ and E5M2FNUZ Cast E8M0 4 bit integer types Papers Cast Packing and Unpacking Float stored in 4 bits Papers E2M1 Cast Packing and Unpacking 2 bit integer types Papers Cast Packing and Unpacking (2-bit) Float stored in 6 bits Papers E2M3 and E3M2 Cast Packing and Unpacking In-place KV Cache for Attention