We are going to implement this soon. To track progress subscribe to https://github.com/OctopusDeploy/Issues/issues/4159
The Workers (https://github.com/OctopusDeploy/Issues/issues/4158) feature is related and covers some of the use cases described in the comments.
An error occurred while saving the commentBen Aves commented
+1, We have automated UI tests that need only be run once per deployment across N physical machines.