Invertibility characterization of Wiener-Hopf plus Hankel operators via odd asymmetric factorizations