Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Provide API to get runtime Tensor buffer, dtype, and shape. #1957

Open
LPanosTT opened this issue Jan 24, 2025 · 0 comments
Open

Provide API to get runtime Tensor buffer, dtype, and shape. #1957

LPanosTT opened this issue Jan 24, 2025 · 0 comments
Assignees

Comments

@LPanosTT
Copy link
Contributor

LPanosTT commented Jan 24, 2025

For the frontends to properly reconstruct a tensor during intermediate callback, the data type, shape, and data buffer must be provided. Currently, we can only get the tensor data as a std::vector<float> or as a tt::runtime::Tensor, which itself holds a void pointer to a ttnn::Tensor, which can't be used unless the frontend depends on tt-metal as well.

I believe if the tt::runtime::Tensor held a TensorDesc for itself, or had the shape and dtype of itself then calling getOpOutputTensor should suffice.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants