For Alpha / testing round - yes. For a Beta - absolutely not.

If you get lucky and your app 'goes viral' then this is a good problem to have. Odds are that you will able to sort out any issues relatively quickly, whereas artificially limiting growth would potentially result in losing out on a lot.

As Reid Hoffman famously put it - "If you are not embarrassed by the first version of your product, you've launched too late."