I came across this Microsoft document that explains the trouble I've been having with setting the app.config file by editing the project file.

The file specified by the ConfigurationOverrideFile property will be renamed to web.config when the project is deployed. This property is meaningful only for Web projects.