WordPress automatically connects the uploaded Media to a post. We're using this connection to show the downloadable files in a unit.

Since controlling of downloads for units is already a requested feature,

you may want to use the Un-attach plugin to un-attach media files from the requested unit.

Refer to below video for this : http://quick.as/v47qhjjo