Skip to content

Commit

Permalink
Update [WeeklyReport]2023.10.10~2023.10.24.md
Browse files Browse the repository at this point in the history
add comment
  • Loading branch information
Corle-hyz authored Oct 30, 2023
1 parent 0a797b8 commit 9e56e6c
Showing 1 changed file with 1 addition and 0 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -42,3 +42,4 @@ Github ID:[Corle-hyz](https://github.com/Corle-hyz)
1. 明确Llama相较于Transformer修改的地方,仿照[《Reducing Activation Recomputation in Large Transformer Models》](https://arxiv.org/abs/2205.05198)的方式,从理论推导给出Llama的激活内存模型。

### 导师点评
咏哲同学基础扎实,能够快速适应全自动并行任务,本周在显存建模工作中提出不错的想法,需要进一步结合已有的工业实践进一步完善建模工作,达到可大范围推广的目标。期待咏哲的下一步的工作成果。

0 comments on commit 9e56e6c

Please sign in to comment.