There probably will be breaking changes even in Swift 5, more likely only in major releases, since minor releases should not contain any breaking changes.
Application Binary Interface as I understand it, will bring binary stability but does not guarantee further source code breaking changes. That is my conclusion from this response.