The complexity-dominant operation in the truncated EK1 is a calculation
jax.scipy.linalg.solve_cholesky((S_sqrtm, True), z)
which is used to update the mean.
Sparse Jacobians will imply sparse S_sqrtm (or at least sparse S), and a Krylov method like CG might make the whole shebang faster.