Code

Dpo training (Do not merge)#63

Code

Open

shuishen112 wants to merge 38 commits intomainmicrosoft/mttl:mainfrom dpo_routermicrosoft/mttl:dpo_routerCopy head branch name to clipboard

+1,690-7

Commits

Commits on Jul 12, 2024

• add dpo training for arrow routing

  shuishen112

  committed
  2852c0a

  Copy full SHA for 2852c0a

• add dpo train with preference data

  shuishen112

  committed
  fb47f71

  Copy full SHA for fb47f71

Commits on Jul 13, 2024

• add preference data module

  shuishen112

  committed
  665bfc4

  Copy full SHA for 665bfc4

Commits on Jul 15, 2024

• add log for training and validation

  shuishen112

  committed
  330813c

  Copy full SHA for 330813c

• wip

  shuishen112

  committed
  ec73c5a

  Copy full SHA for ec73c5a

• fix isort

  shuishen112

  committed
  93b5526

  Copy full SHA for 93b5526

Commits on Jul 16, 2024

• fix optimization with efficient checkpoint module

  shuishen112

  committed
  1f97122

  Copy full SHA for 1f97122

• wip

  shuishen112

  committed
  b4fa78b

  Copy full SHA for b4fa78b

Commits on Jul 17, 2024

• fix dpo training

  shuishen112

  committed
  6b20a61

  Copy full SHA for 6b20a61

• add simpo training

  shuishen112

  committed
  8c61ba3

  Copy full SHA for 8c61ba3

• fix

  

  wzm289

  committed
  0f0be96

  Copy full SHA for 0f0be96

• isort

  shuishen112

  committed
  3de4297

  Copy full SHA for 3de4297

• wip

  

  wzm289

  committed
  d3b77a1

  Copy full SHA for d3b77a1

Commits on Jul 24, 2024

• get cluster dataset by embedding

  

  wzm289

  committed
  6601b67

  Copy full SHA for 6601b67

Commits on Jul 30, 2024

• add args for dpo training

  shuishen112

  committed
  d69f03b

  Copy full SHA for d69f03b

Commits on Jul 31, 2024

• add log

  shuishen112

  committed
  4a0d3d6

  Copy full SHA for 4a0d3d6

Commits on Aug 7, 2024

• wip

  shuishen112

  committed
  b73de95

  Copy full SHA for b73de95

• add length normalization

  shuishen112

  committed
  7b9f417

  Copy full SHA for 7b9f417

• fix

  shuishen112

  committed
  0566d96

  Copy full SHA for 0566d96

Commits on Aug 21, 2024

• make the reference model eval mode

  

  wzm289

  committed
  1dba64d

  Copy full SHA for 1dba64d

• fix train_batch_size

  shuishen112

  committed
  38049bb

  Copy full SHA for 38049bb

• wip

  shuishen112

  committed
  75a80d9

  Copy full SHA for 75a80d9

Commits on Aug 28, 2024

• add ultrafeedback data

  shuishen112

  committed
  3904f11

  Copy full SHA for 3904f11

• add urtra data train

  shuishen112

  committed
  d169661

  Copy full SHA for d169661

Commits on Sep 5, 2024

• add ultralfeedback sft

  shuishen112

  committed
  fe40732

  Copy full SHA for fe40732

Commits on Sep 10, 2024

• training module with ultral sft

  shuishen112

  committed
  49ee734

  Copy full SHA for 49ee734

Commits on Nov 16, 2024

• fix save

  shuishen112

  committed
  8f15188

  Copy full SHA for 8f15188

• fix arrow

  shuishen112

  committed
  bf45a61

  Copy full SHA for bf45a61

Commits on Nov 17, 2024

• clean

  shuishen112

  committed
  2f08190

  Copy full SHA for 2f08190

• merge

  shuishen112

  committed
  8858e10

  Copy full SHA for 8858e10

Commits on Nov 18, 2024

• merge the code to the current version

  shuishen112

  committed
  b33316b

  Copy full SHA for b33316b

• clean the code

  shuishen112

  committed
  96bb1c4

  Copy full SHA for 96bb1c4

• clean the code

  shuishen112

  committed
  54da222

  Copy full SHA for 54da222

• add orca datamodule

  shuishen112

  committed
  147878e

  Copy full SHA for 147878e

• add orca sft training

  shuishen112

  committed
  23b3b36

  Copy full SHA for 23b3b36

Commits on Nov 19, 2024

• update orca

  shuishen112

  committed
  19fb72c

  Copy full SHA for 19fb72c

• chose finetune task

  shuishen112

  committed
  9d9ab5b

  Copy full SHA for 9d9ab5b

• format

  shuishen112

  committed
  718b138

  Copy full SHA for 718b138