TyphoonLLM 03.06 Speeds Up Long Prompts on PS Vita

TyphoonLLM 03.06 cuts long-prompt processing time by 14 percent for offline AI inference on the PlayStation Vita.

PS Vita · Homebrew

0xKova3 Nov 2026, 07:30· r/vitahacks

Developer daivarsi released TyphoonLLM 03.06, a runtime update for the offline AI chat homebrew app on the PlayStation Vita (PS Vita). The update targets prompt prefill by skipping unused intermediate vocabulary projections while keeping model weights and scoring identical.

Physical tests on a Vita at the 500/222/166 clock profile reduced time to first token from 29.26 to 25.06 seconds on long prompts. Total response time dropped from 49.10 to 45.48 seconds. Short-prompt total time was essentially unchanged, and the update does not improve the factual reliability of the 230-million parameter model. These are limited samples, not a general decoding-speed claim.

How to try it

  1. Install the new VPK package using VitaShell. A homebrew-capable or jailbroken Vita is required.
  2. Keep your existing model files in ux0:data/VitaLMChat/ if you are upgrading from 03.05. Fresh installs need the model and tokenizer files from the 03.05 release, because the VPK does not bundle them.
Sources: reddit.com