In 4.1 we have a checker for compiler plugin compatibility. If I remove the plugin (or change it) in compiler settings, the check is not re-run, meaning the error marker is stale. This made sense when classpath errors could only change when the classpath itself was changed, but an additional event has to be triggered now when the compiler settings (more precisely, compiler plugin settings) have changed.