Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] 如何在推理时输出隐藏层 #2937

Open
3 tasks
owerbai opened this issue Dec 22, 2024 · 5 comments
Open
3 tasks

[Bug] 如何在推理时输出隐藏层 #2937

owerbai opened this issue Dec 22, 2024 · 5 comments
Assignees

Comments

@owerbai
Copy link

owerbai commented Dec 22, 2024

Checklist

  • 1. I have searched related issues but cannot get the expected help.
  • 2. The bug has not been fixed in the latest version.
  • 3. Please note that if the bug-related issue you submitted lacks corresponding environment info and a minimal reproducible demo, it will be challenging for us to reproduce and resolve the issue, reducing the likelihood of receiving feedback.

Describe the bug

我期望获取output的hidden_state和logits,logits看上去是可行的,不知道hidden_state是否有获取方法?

Reproduction

111

Environment

111111

Error traceback

1111
@alanMachineLeraning
Copy link

同求

@lvhan028
Copy link
Collaborator

等 v0.7.0 发布后,可以看看是否满足需求。
在 v0.7.0 中,可以输出 logits,以及最后一层的 hidden_states

@lvhan028 lvhan028 self-assigned this Jan 13, 2025
@alanMachineLeraning
Copy link

预计什么时候发布呢

@alanMachineLeraning
Copy link

logits看上去是可行的,这个怎么输出?

@lvhan028
Copy link
Collaborator

本周会发布。到时可以在 pipeline.md 文档中查阅 logits, last_hidden_states 的获取方法

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants