Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

thumos14_gt.json #41

Open
lurchycc opened this issue Apr 10, 2022 · 8 comments
Open

thumos14_gt.json #41

lurchycc opened this issue Apr 10, 2022 · 8 comments

Comments

@lurchycc
Copy link

I noticed that the number of videos in the thumos14_gt. json file is 410, it seems that there are 3 videos missing in the test part, now I check that 'video_test_0000270' is not in the thumos14_gt. json, does this affect the evaluation result?

@linchuming
Copy link
Collaborator

@lurchycc good issue! In experiments, we directly took the THUMOS GT file from GTAD codes (https://github.com/frostinassiky/gtad/blob/master/evaluation/thumos_gt.json). To compare to GTAD, we did not change the json file. You can update the thumos14_gt.json and check the new results.

@lurchycc
Copy link
Author

Okay, thanks for your reply.

@menghuaa
Copy link

menghuaa commented Apr 27, 2022

@lurchycc good issue! In experiments, we directly took the THUMOS GT file from GTAD codes (https://github.com/frostinassiky/gtad/blob/master/evaluation/thumos_gt.json). To compare to GTAD, we did not change the json file. You can update the thumos14_gt.json and check the new results.

the question that I asked: Hello, do you remove the background data provided by the thumos 14 dataset during training and testing?
I mean in the thumos14 annotation files :val_Annotation_ours.csv、test_Annotation_ours.csv and thumos_gt.json, you remove the background data:Ambigous class. I see that GTAD don‘t remove them.

@linchuming
Copy link
Collaborator

@menghuaa, I think you means that we remove the 'Ambiguous' class label. These data label is useless to training and testing for action detection task. GTAD is an action proposal task which predicts the foreground proposal and do not need the class label, so they can use the data sample with 'Ambiguous' class. In detection evaluation, GTAD also removes the 'Ambiguous' class data label according to their thumos_gt.json.

@menghuaa
Copy link

@menghuaa,我认为您的意思是我们删除了“模棱两可”的类别标签。这些数据标签对于动作检测任务的训练和测试是无用的。GTAD 是一个动作提议任务,它预测前景提议并且不需要类标签,因此他们可以使用具有“模糊”类的数据样本。在检测评估中,GTAD 还根据他们的 thumos_gt.json 删除了“模糊”类数据标签。

thanks for your reply,for action proposal task,can I also remove the the data sample with 'Ambiguous' class in traning and testing?

@linchuming
Copy link
Collaborator

@menghuaa you can observe the gt file for ambiguous class to action proposal task. If ambiguous proposals are included in gt file, you should not remove them in training and testing.

@menghuaa
Copy link

menghuaa commented Apr 27, 2022

@menghuaa you can observe the gt file for ambiguous class to action proposal task. If ambiguous proposals are included in gt file, you should not remove them in training and testing.

ok,thanks for you reply. As an additional question, have you ever seen the features of thumos14 fine tuned on the thumos14 dataset?

@linchuming
Copy link
Collaborator

@menghuaa no, I have never seen it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants