The swift.org <http://swift.org/> site provides pre-built binaries for Ubuntu already, but their are tarballs and not in the DEB format, which is the preferred way to install packages on Debian-based systems.
RPM-based Linux distributions would need packages in the RPM format.
It would be nice if someone would take care and prepare/host pre-built Swift packages for different Linux distributions, so that they can be installed in a regular way used by a given Linux distribution. In the ideal case, it would be nice to have something like stable packages and nightly builds.