Model XMem getting stuck at nn.init.orthogonal_ #162
Description
I'm using XMem for my project, but it gets stuck at network = XMem(config, args.model).cuda().eval()
I have located that it gets stuck at self.key_proj = KeyProjection(1024, self.key_dim), nn.init.orthogonal_(self.key_proj.weight.data) . The weird thing is that it works in the original repo, but not in another folder even though they are using the same initialization code, same model, and the import module part is correct.
I saw another issue having the same thing, but did not have a solution. Does anyone know what's the cause/how to get around with it? Thanks!