Abstract: ’Pre-training + fine-tuning’ has been widely used in various downstream tasks. Parameter-efficient fine-tuning (PEFT) has demonstrated higher efficiency and promising performance compared to ...