The 'column_invisible' modifier doesn't work for O2M fields where the tree view is not embedded in the form view.
We have created a PR (cf. odoo/odoo#30982) which fixes this limitation. Until this PR is merged by Odoo we recommend to install the web_column_invisible_fix module.