diff --git a/README.md b/README.md index 3579c81..bf596d7 100644 --- a/README.md +++ b/README.md @@ -14,15 +14,15 @@ - [LLaMA](https://github.com/facebookresearch/llama) (7B, 13B, 33B, 65B) - [BLOOM](https://huggingface.co/bigscience/bloom) & [BLOOMZ](https://huggingface.co/bigscience/bloomz) (560M, 1.1B, 1.7B, 3B, 7.1B, 176B) -## Supported Training Approach +## Supported Training Approaches - [(Continually) pre-training](https://s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf) - Full-parameter training - - Selected-parameter training + - Partial-parameter training - [LoRA](https://arxiv.org/abs/2106.09685) - [Supervised fine-tuning](https://arxiv.org/abs/2109.01652) - Full-parameter training - - Selected-parameter training + - Partial-parameter training - [LoRA](https://arxiv.org/abs/2106.09685) - [RLHF](https://arxiv.org/abs/2203.02155) - [LoRA](https://arxiv.org/abs/2106.09685)