diff --git a/plugin/updater_gpu/README.md b/plugin/updater_gpu/README.md
new file mode 100644
index 000000000000..400104533f0e
--- /dev/null
+++ b/plugin/updater_gpu/README.md
@@ -0,0 +1,3 @@
+# XGBoost GPU algorithms
+
+GPU algorithms are no longer a plugin and are included in official releases. [See documentation for more details](https://xgboost.readthedocs.io/en/latest/gpu/).