Convert pixart alpha model to diffuser error

[segalinc]

I am trying to convert a trained model to diffusers but I when running convert_pixart_alpha_to_diffusers.py with same args as guided in the notebook I get the error

RuntimeError: Error(s) in loading state_dict for Transformer2DModel:
        Unexpected key(s) in state_dict: "caption_projection.y_embedding". 

[lawrence-cj]

Right, will upload a new version. This error is caused by the update of diffusers lib.

[segalinc]

For now I fixed switching the strict arg to false when loading the convertes dict in the transformer

…

On Tue, Jan 9, 2024, 6:55 PM Junsong Chen ***@***.***> wrote: Right, will upload a new version. This error is caused by the update of diffusers lib. — Reply to this email directly, view it on GitHub <#67 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ACHLPEUJWN3C26VAAZSFB73YNX7LTAVCNFSM6AAAAABBSLLVUSVHI2DSMVQWIX3LMV43SRDJONRXK43TNFXW4Q3PNVWWK3TUHM4DANZUGUYTQ> . You are receiving this because you authored the thread.Message ID: ***@***.*** com>

[lawrence-cj]

Already fixed, plz check it out. c3b30e5

[segalinc]

Great thanks

…

On Tue, Jan 9, 2024, 7:04 PM Junsong Chen ***@***.***> wrote: Already fixed, plz check it out. — Reply to this email directly, view it on GitHub <#67 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ACHLPESQEHEBTMGFZXFN7W3YNYALHAVCNFSM6AAAAABBSLLVUSVHI2DSMVQWIX3LMV43SRDJONRXK43TNFXW4Q3PNVWWK3TUHM4DANZUGU3DM> . You are receiving this because you authored the thread.Message ID: ***@***.*** com>