AP rounds from guns will be a thing from what I heard - rockets with an FMJ or AP (war)head, wouldn't be too effective. To penetrate armor, you need a small and fast projectile.
Just take a look at real life ballistics - 9mm, 50AE or 12ga slugs are awful to penetrate armor, but perfect to stop...