Code

Node level model weights cache#652

Code

Draft

seanshi-scale wants to merge 4 commits intomainscaleapi/llm-engine:mainfrom seanshi/20241029-node-level-image-cachescaleapi/llm-engine:seanshi/20241029-node-level-image-cacheCopy head branch name to clipboard

+49

Commits

Commits on Oct 30, 2024

• sketch out model cache 'daemonset' code

  seanshi-scale

  committed
  c03fb1c

  Copy full SHA for c03fb1c

• mark todo

  seanshi-scale

  committed
  687955e

  Copy full SHA for 687955e

• more todos

  seanshi-scale

  committed
  de52820

  Copy full SHA for de52820

Commits on Oct 31, 2024

• Merge branch 'main' into seanshi/20241029-node-level-image-cache

  seanshi-scale

  committed
  7797642

  Copy full SHA for 7797642