CoSQA | Related Queries | Need Guidance

[ybagdi]

Dear CoSQA authors,

I am trying to improve on the results in your paper for the code search objective: [2105.13239] CoSQA: 20,000+ Web Queries for Code Search and Question Answering (arxiv.org)

(I have already reproduced the results from the above paper.)

I have a few queries in this regard:

• I tried rePretraining with the CSN dataset but was not getting the desired performance. This may be due to the hyperparameters values required. So, what hyperparams you used in this regard would help me in replicating the performance from scratch and be a good starting point.
• Also, for improving the performance of the existing model, are there any other model variations or any suggestion from you that would help me towards the right track?
• Also, any recommendations for study materials and research papers to look at?

Any insights or pointers that you have in mind would be greatly appreciated.

Thanks & Regards,
Yash Bagdi