Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Why the result image is all black, when cfg-scale == 0 and temperature == 0 in Class-conditionalImageGeneration #77

Open
870572761 opened this issue Dec 26, 2024 · 1 comment

Comments

@870572761
Copy link

870572761 commented Dec 26, 2024

Hi.
When I test Class-conditionalImageGeneration function in LlamaGen's GPT-L model.
When I use cfg-scale == 0 temperature == 0 in the model.
sample_c2icfg0t0
When I set cfg-scale 0, when temperature == 0
sample_c2icfg0t0
When I set cfg-scale 2, when temperature == 0
sample_c2icfg2t0
When I set cfg-scale 3, when temperature == 0
sample_c2icfg3t0
When I set cfg-scale 4 when temperature == 0
sample_c2icfg4t0
When I set cfg-scale 10 when temperature == 0
sample_c2i
So when cfg-scale to 10 could make 360 class otter(Also maybe sth wrong in #76 )
Also I find when I set cfg-scale 0, 2, 3, 4, 10 when temperature == 1
sample_c2icfg1
sample_c2icfg2
sample_c2icfg3
sample_c2icfg4
Question 1: Why the result image is all black, when cfg-scale == 0 and temperature == 0 in Class-conditionalImageGeneration? Could I understand that the model depend heavily on the temperature random? Is it only when setting temperature != 0 could working?(Maybe > 1.0)
Also I notice your Experiments that model performance very bad when cfg-scale == 0. But I do not find temperature Experiments
image

@870572761
Copy link
Author

It is my hyperparameter

python3 autoregressive/sample/sample_c2i.py \
  --vq-ckpt ./pretrained_models/vq_ds16_c2i.pt \
  --gpt-ckpt ./pretrained_models/c2i_L_384.pt \
  --gpt-model GPT-L \
  --image-size 384

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant