AustinXiao commited on
Commit
b41ba81
·
verified ·
1 Parent(s): c2bd940

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -210,10 +210,10 @@ the 14 languages and has the best mean.
210
  | the same 4 questions as 4 passes | 33.2 ms | 33.3 ms |
211
  | 4 clips in one batch, 1 question each | 16.0 ms | 16.1 ms |
212
 
213
- End to end through `predict`, including feature extraction; GPU memory 1.9 GB. The default `fast=True` merges the
214
  adapter weights into the backbone and replays CUDA graphs captured on first use of each input shape (the very first
215
- call takes ~0.5 s, each new shape ~0.1 s). `VoxTurn.from_pretrained(path, fast=False)` runs the unmerged weights eagerly
216
- (~38 ms) and reproduces the evaluation computation exactly.
217
 
218
  Training details will be described in a technical report.
219
 
 
210
  | the same 4 questions as 4 passes | 33.2 ms | 33.3 ms |
211
  | 4 clips in one batch, 1 question each | 16.0 ms | 16.1 ms |
212
 
213
+ End-to-end inference time through `predict`, including feature extraction (not end-of-turn response latency); GPU memory 1.9 GB. The default `fast=True` merges the
214
  adapter weights into the backbone and replays CUDA graphs captured on first use of each input shape (the very first
215
+ call takes approximately 0.5 s, each new shape approximately 0.1 s). `VoxTurn.from_pretrained(path, fast=False)` runs the unmerged weights eagerly
216
+ (approximately 38 ms) and reproduces the evaluation computation exactly.
217
 
218
  Training details will be described in a technical report.
219