You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
For the frontends to properly reconstruct a tensor during intermediate callback, the data type, shape, and data buffer must be provided. Currently, we can only get the tensor data as a std::vector<float> or as a tt::runtime::Tensor, which itself holds a void pointer to a ttnn::Tensor, which can't be used unless the frontend depends on tt-metal as well.
I believe if the tt::runtime::Tensor held a TensorDesc for itself, or had the shape and dtype of itself then calling getOpOutputTensor should suffice.
The text was updated successfully, but these errors were encountered:
For the frontends to properly reconstruct a tensor during intermediate callback, the data type, shape, and data buffer must be provided. Currently, we can only get the tensor data as a
std::vector<float>
or as att::runtime::Tensor
, which itself holds a void pointer to attnn::Tensor
, which can't be used unless the frontend depends on tt-metal as well.I believe if the
tt::runtime::Tensor
held aTensorDesc
for itself, or had theshape
and dtype of itself then callinggetOpOutputTensor
should suffice.The text was updated successfully, but these errors were encountered: