训练文本生成
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

16 lines
547 B

2 years ago
# CUDA_VISIBLE_DEVICES=2 python src/train_sft.py \
# --do_train \
# --dataset paper_data_v3_prompt \
# --dataset_dir /home/majiahui/projert/ChatGLM-Efficient-Tuning/data \
# --finetuning_type freeze \
# --max_source_length 700 \
# --max_target_length 1400 \
# --output_dir path_to_sft_checkpoint_paper_prompt_freeze \
# --per_device_train_batch_size 1 \
# --lr_scheduler_type cosine \
# --logging_steps 10 \
# --save_steps 2000 \
# --learning_rate 1e-4 \
# --num_train_epochs 5.0 \
# --fp16