Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Problem in Eval.py? #8

Closed
AndRossi opened this issue Oct 13, 2019 · 2 comments
Closed

Problem in Eval.py? #8

AndRossi opened this issue Oct 13, 2019 · 2 comments

Comments

@AndRossi
Copy link

Hi, thanks for developing CapsE.
I think that using capsule networks may be the next big thing in Link prediction!

I'm opening this issue because I have the impression that your evaluation strategy, implemented in evalCapsE.py, may suffer from the same controversies emerged in ConvKB under this issue:
daiquocnguyen/ConvKB#5

Am I correct?

@dschaehi
Copy link

dschaehi commented Feb 6, 2020

This problem is addressed in detail in the following paper:

Z. Sun, S. Vashishth, S. Sanyal, P. Talukdar, Y. Yang, A Re-evaluation of Knowledge Graph Completion Methods, ArXiv:1911.03903 [Cs]. (2019). http://arxiv.org/abs/1911.03903 (accessed November 14, 2019).

If the existence of the mentioned problem is true, then the authors should make this public somewhere (e.g., https://ml-retrospectives.github.io/). I think this is important to advance research in this area.

@daiquocnguyen
Copy link
Owner

I have answered this issue at daiquocnguyen/ConvKB#5

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants