There definitely is something weird with Tahoe permission system. I was trying to learn Swift and after a couple keystrokes, the banner asking for the permission to access other's app data pops up without fail. Making it almost impossible to use Swift Playground. And it's been like that for a couple months now.

https://developer.apple.com/forums/thread/808758

https://developer.apple.com/forums/thread/811796