Skip to content

How is conditioning dropout done in training? #106

@max-fofanov

Description

@max-fofanov

First of all thank you for your awesome work. I wonder how do you do conditioning dropout? If you pass torch.zeros_like(...) like you do on inference how can this be utilized when training? Passing the torch.zeros_like(...) into Unet instead of garment encoder input doesn't allow gradients to flow, as far as I understand. And if you pass torch.zeros_like as an input to garment encoder, why do you inference the model in a different way, creating torch.zeros_like directly in the attention processor instead of creating it before using ref_unet and passing it through it. Thank you for the answer!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions