Classification Error

Hi,
I've been training my model using ADNI dataset, when i'm training I'm getting a loss of 0.05 but during validation It's just predicting one class out of the two for all set of images.
I'm really confused ,i dont know what am I doing wrong.
Please help.