[New Features]Add lorapro

[greycooker]

PR types

New features

PR changes

APIs

Description

新增精调方法lorapro
暂时仅支持单卡
开发中，请勿review

[codecov]

Codecov Report

Attention: Patch coverage is 19.64286% with 45 lines in your changes missing coverage. Please review.

Project coverage is 52.91%. Comparing base (fa3fd39) to head (18a00f0).

Files with missing lines	Patch %	Lines
paddlenlp/utils/optimizer.py	14.58%	41 Missing ⚠️
paddlenlp/trainer/trainer.py	42.85%	4 Missing ⚠️

Additional details and impacted files

@@             Coverage Diff             @@
##           develop    #9729      +/-   ##
===========================================
+ Coverage    51.30%   52.91%   +1.61%     
===========================================
  Files          730      718      -12     
  Lines       121756   112549    -9207     
===========================================
- Hits         62464    59557    -2907     
+ Misses       59292    52992    -6300     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[paddle-bot]

Thanks for your contribution!