Commits

Branch selector

 main

User selector

All users

All time

Commit History

Commits on Mar 29, 2026

• update docs

  izmttk

  committed
  3464929

  Copy full SHA for 3464929

• support fully async scheuling in model runner

  izmttk

  committed
  5fc2be8

  Copy full SHA for 5fc2be8

Commits on Mar 23, 2026

• refactor model runner

  izmttk

  committed
  66b035f

  Copy full SHA for 66b035f

Commits on Mar 2, 2026

• optimize attention metadata preparation

  izmttk

  committed
  7b51907

  Copy full SHA for 7b51907

Commits on Feb 12, 2026

• add logo

  izmttk

  committed
  98cb9b8

  Copy full SHA for 98cb9b8

Commits on Feb 8, 2026

• optimize flashinfer attention backend

  izmttk

  committed
  e1f85f0

  Copy full SHA for e1f85f0

Commits on Jan 26, 2026

• implement async scheduling

  izmttk

  committed
  848b265

  Copy full SHA for 848b265

Commits on Jan 9, 2026

• update docs and clean code

  izmttk

  committed
  a09004a

  Copy full SHA for a09004a

• remove heartbeat threads

  izmttk

  committed
  3989833

  Copy full SHA for 3989833

• refactor cuda graph

  izmttk

  committed
  1f82425

  Copy full SHA for 1f82425

Commits on Jan 8, 2026

• organize modules

  izmttk

  committed
  0b6646e

  Copy full SHA for 0b6646e

• fix default value issue in sampling params

  izmttk

  committed
  947cff3

  Copy full SHA for 947cff3

Commits on Jan 7, 2026

• update docs

  izmttk

  committed
  dca5258

  Copy full SHA for dca5258

• support increamental scheduling

  izmttk

  committed
  139a931

  Copy full SHA for 139a931

• improve tensor serialization/deserialization

  izmttk

  committed
  ccf5194

  Copy full SHA for ccf5194

Commits on Jan 5, 2026

• optimize Sequence data structure

  izmttk

  committed
  2e6c98b

  Copy full SHA for 2e6c98b

Commits on Jan 4, 2026

• update scripts and docs

  izmttk

  committed
  c06e3cf

  Copy full SHA for c06e3cf

Commits on Jan 3, 2026

• improve robustness

  izmttk

  committed
  9659e8b

  Copy full SHA for 9659e8b

• support torch profiler

  izmttk

  committed
  9b13f10

  Copy full SHA for 9b13f10

• fix max new tokens bug

  izmttk

  committed
  dc2f6bd

  Copy full SHA for dc2f6bd

Commits on Dec 31, 2025

• re-enable torch compile on communication operations

  izmttk

  committed
  d466f6e

  Copy full SHA for d466f6e

• optimize serialization in model executor

  izmttk

  committed
  fd83508

  Copy full SHA for fd83508

Commits on Dec 29, 2025

• reintroduce zmq

  izmttk

  committed
  bba3273

  Copy full SHA for bba3273

Commits on Dec 25, 2025

• improve multiprocessing design

  izmttk

  committed
  c12ca32

  Copy full SHA for c12ca32

Commits on Dec 24, 2025

• enable prefix caching for new scheduled sequences

  izmttk

  committed
  8d0c182

  Copy full SHA for 8d0c182

• fix logging level issue

  izmttk

  committed
  8e996fb

  Copy full SHA for 8e996fb

• fix minor bugs

  izmttk

  committed
  13a6c9b

  Copy full SHA for 13a6c9b

• fix incorrect process shutdown

  izmttk

  committed
  7f6a125

  Copy full SHA for 7f6a125

• fix export and argument bugs

  izmttk

  committed
  75025c1

  Copy full SHA for 75025c1

• provide better shutdown and error handling

  izmttk

  committed
  bc069c3

  Copy full SHA for bc069c3

Commits on Dec 22, 2025

• fix hanging when api server shutting down with unfinished requests

  izmttk

  committed
  f0860e1

  Copy full SHA for f0860e1

• improve multiprocessing graceful shutdown and logging system

  izmttk

  committed
  c5acb97

  Copy full SHA for c5acb97

Commits on Dec 18, 2025

• add torch compile

  izmttk

  committed
  038724b

  Copy full SHA for 038724b

• fix shutdown machinism

  izmttk

  committed
  7fb29e0

  Copy full SHA for 7fb29e0

Commits on Dec 17, 2025

• refactor code

  izmttk

  committed
  81d0495

  Copy full SHA for 81d0495