README-4.md

HW2

Environment

pip install -r requirements.txt

Download

Download adapter checkpoints

bash ./download.sh

Fine tuning mT5 model

python train.py --base_model_path jimboHsueh/save_hw3 \
    --peft_path ./PETH \
    --train_data_path train.json \
    --per_device_train_batch_size 2 \
    --gradient_accumulation_steps 8 \
    --test_data_path public_test.json \
    --output_dir HW3_4 \
    --push_to_hub

-base_model_path: Path to Taiwan_llama.

-peft_path: Path to peft model.

-train_data_path: Path to train.json.

-test_data_path: Path to test.json.

Generate prediction.json

bash ./download.sh
bash ./run.sh python /path/to/Taiwan-LLaMa-folder /path/to/adapter_checkpoint \ 
/path/to/input.json /path/to/output.json