We consider the action of Hecke operators on weakly holomorphic modular forms and a Hecke-equivariant duality between the spaces of holomorphic and weakly holomorphic cusp forms. As an application, we obtain congruences modulo supersingular primes, which connect Hecke eigenvalues and certain singular moduli.