Question about parameters Initialization

[ChenyuChen1]

Hello, I'm appreciate that your work help me a lot. I have a question that dose Transformer model need parameters initialization?

[khawar-islam]

@ChenyuChen1 Did you train a CeiT transformer from scratch?