All pull requests

Pull requests

• server: a KV page's file IO runs on a worker; the task loop only copies the state in or out

  devopsservertesting
  #118·joelteply opened Nov 14, 2026·

  ·

• Avoid vocabulary allocations in pooled embedding contexts

  conversiondevopsservertesting
  #114·joelteply opened Nov 12, 2026·

  ·
  1

• server: reconfigure grows or shrinks the contexts live, on the s4 integration branch (S2 port of #104)

  devopsserver
  #105·joelteply opened Nov 10, 2026·

  ·

• server: reconfigure grows or shrinks the contexts live; the weights are never reloaded (S2)

  server
  #104·joelteply opened Nov 10, 2026·

  ·

• context: expose measured host/device allocation plans on the loaded model

  #103·joelteply opened Nov 10, 2026·

  ·

• server: a learn step is one decode chunk, as serving's is, and its workspace is priced at one ubatch

  servertesting
  #102·joelteply opened Nov 10, 2026·

  ·

• cuda: preserve permuted-stride ACC gradients

  CUDAggmltesting
  #101·joelteply opened Nov 8, 2026·

  ·

• Yield in-place learning through the serving loop and retain served KV

  servertesting
  #100·joelteply opened Nov 8, 2026·

  ·

• server: report what the server holds beside the serving context

  mtmdserver
  #91·joelteply opened Nov 3, 2026·

  ·
  1

• server: create dormant dream adapters and save immutable snapshots

  devopsserver
  #81·joelteply opened Oct 28, 2026·

  ·
  2

• server: a page carries the draft's KV once; checkpoints stop copying it

  server
  #79·joelteply opened Oct 28, 2026·

  ·
  1

• server: a disk tier for the prompt cache (--cache-disk)

  server
  #78·joelteply opened Oct 27, 2026·

  ·

• server: /reconfigure changes the context geometry without reloading the model (S2)

  server
  #73·joelteply opened Oct 24, 2026·

  ·

• server: genes (LoRA adapters) page between the device and host RAM (stacked on #70)

  server
  #72·joelteply opened Oct 24, 2026·

  ·

• server: a slot pages to named host RAM and back; checkpoints keep a byte budget; a page carries its draft KV

  devopsservertesting
  #70·joelteply opened Oct 24, 2026·

  ·
  1

• server: rotate admitted prefill service without moving KV

  devopsservertesting
  #69·joelteply opened Oct 23, 2026·

  ·
  2

• server: expose realized context allocation geometry

  Apple MetalCUDAggmlmodelmtmdserverSYCLtesting
  #67·joelteply opened Oct 20, 2026·

  ·

• grammar: preserve tagged unions through singleton allOf

  testing
  #66·joelteply opened Oct 17, 2026·

  ·

• llama: connect labelled decode to shared physical cache rows

  ggmltesting
  #64·joelteply opened Oct 14, 2026·

  ·
  4

• cuda: implement shared FLASH_ATTN_BACK with direct quantized cache reads

  CUDAggmltesting
  #63·joelteply opened Oct 14, 2026·

  ·
  5

• train: the start's claim is released on every exit that doesn't hand it to the worker

  servertesting
  #58·joelteply opened Oct 13, 2026·

  ·

• server /train: a per-turn slowdown receipt beside the cycle average

  servertesting
  #39·joelteply opened Oct 6, 2026·

  ·
  7

• continuum: explicit Metal device selection — avoid hang in AMD Polaris lazy init (card 346b356f)

  #1·joelteply opened Jun 7, 2026·

  ·