Delegate. Delegate that supervision of some people to someone else. That's what middle management is for - there's a limit on how many direct reports you can effectively handle; someone does need to "keep mental track of is measuring individual performance and success", but above a certain number (whatever that is for you personally) you can't be that someone for everyone in your company.