Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Preservation of current undefined behavior of monotone constraints for multiclass #5554

Closed
meakbiyik opened this issue Apr 16, 2020 · 1 comment

Comments

@meakbiyik
Copy link

This will be an interesting feature request, because I am not asking xgboost team to implement something but just be aware of the behavior of their code if they are not, and possibly document it.

When monotone constraints are used with multi:softmax objective and mlogloss, they perform in the way that forces the constrained feature -for example if the constraint is positive- to only be used to split a node if the output points to a class other than zero. Despite the fact that there is no information in any of the documentation regarding to this phenomenon, I validated this behavior by checking out the SHAP values and the source code.

This is a very great feature, and I would like the xgboost to preserve it in the future by not having any kind of check against the objective type, and for authors to document the implications if possible. It allowed me to find a solution to a very challenging machine learning task, and I am very happy with the results :)

Thanks in advance!

@trivialfis
Copy link
Member

trivialfis commented Apr 17, 2020

Yes. It becomes quite glaring when implementing #5460 .

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants