Although we could use the same process to apply binary updates to the build server as we did on the development VMs (albeit using the command version), the build server is a little special.
The process of applying a build is that the environment (local packages folder and data) is restored from a backup and merged with objects from TFS. If we simply applied the update, the next build will, effectively, remove it.