In my testing on Big Sur, Apple’s app store does this:

• Anything in the way that isn’t an app will be overwritten.
• If an app is in the way the new app will be put in a uniquely named folder that doesn’t appear uniquely named in Finder. twitter.com/qdoug/status/1319228989915922432