Time is essence in any such decisions. Early discussion to help him to transition is advisable. Such decisions are made before weekend so that your and his week starts fresh. Make sure that the documentation of non-productive efforts are in place.

At Early startup stage its important to make the performance feedback instant and part of the culture. So that it helps people to make decisions including you who are running the business risk.