Most likely, the players you are trying to invade do not wish to be invaded and have the option turned off or limited. Also, the mode works on a "first come, first serve" basis, meaning that only one zombie can invade the player, so there is a lot of competition - a lot of "zombie players" who are trying to join games at the same time.