[Migrated from original issue] ROCm/composable_kernel#823
Original issue author: @bghimireamd
In CK for (conv + bias + activation) we currently have activation as RELU.
It would be great to have other activations. We can start with the ones that take less performance hit on CK.
eg: TANH, SOFTRELU