This would prevent issue like #5052 as we could find them sooner than a user report
As we own knitr repo, we could do some clever automation. it could be triggered by each commit on knitr, and at least once before making a new release.
Anyhow, this is to be done at some point.
