Skip to content

Issues: OpenLMLab/MOSS-RLHF

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

37 Open 16 Closed
37 Open 16 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

第二篇论文中奖励模型训练的问题
#58 opened Sep 27, 2024 by Syaoran1
Issue when merging llama with diff to generate English policy model
#57 opened Aug 4, 2024 by foxlf823
RM数据构造
#55 opened Mar 26, 2024 by tcxia
4
Has anyone compared this training framework to TRL?
#54 opened Mar 25, 2024 by StarrySeas1
1
对第二篇论文中有些不明白的地方请教解惑
#53 opened Mar 13, 2024 by Obr00007576
论文中提到在PPO流程中可以固定其他模型，先训练reward model直到value loss为0，请问这边具体是怎么进行训练的呢？
#52 opened Mar 7, 2024 by HCHCXY
1
Part2中meta dataset的生成
#51 opened Feb 28, 2024 by yata0
1
训练集量级咨询
#50 opened Feb 27, 2024 by Macvh
1
PPOSFTDataset bug report和相关问题咨询
#49 opened Feb 5, 2024 by DZ9
1
关于rm中lm loss计算的疑问
#48 opened Feb 5, 2024 by DZ9
1
论文中rm对比学习训练方法疑问
#45 opened Jan 24, 2024 by yhhh777
4
Issues with using the released hh dataset.
#44 opened Jan 23, 2024 by jltchiu
2
关于rm模型训练策略与损失函数
#43 opened Jan 16, 2024 by tonylin52
12
Clarification on MetaRM-optimization Implementation
#42 opened Jan 15, 2024 by Benjamin-eecs
2
请问目前支持基座模型使用Mistral-7b吗
#39 opened Jan 11, 2024 by YijuGuo
1
自有的底座模型，自有的SFT权重，重新训练RM，可行么
#38 opened Dec 11, 2023 by camposs1979
1
Why are you not releasing your reward model for english?
#37 opened Dec 7, 2023 by AmanSinghal927
1
Inference with SFT and Policy EN models
#36 opened Nov 10, 2023 by henrypapadatos
1
请问下代码里的kl散度问题
#35 opened Nov 4, 2023 by rigorosyangffff
1
合并权重问题
#34 opened Oct 7, 2023 by red-tie
7
关于reward model的权重合并问题
#33 opened Oct 5, 2023 by HuipengXu
1
资源占用问题
#32 opened Sep 18, 2023 by Ming-Di
3
关于reward model的部分的part 2有计划时间节点吗
#31 opened Sep 14, 2023 by SpongebBob
13
Any benchmark vs SFT？
#30 opened Sep 2, 2023 by guotong1988
2
PPO data en
#27 opened Aug 11, 2023 by borisshapa
1
ProTip! What’s not been updated in a month: updated:<2024-11-28.