Update README.md
Browse files
README.md
CHANGED
|
@@ -210,10 +210,10 @@ the 14 languages and has the best mean.
|
|
| 210 |
| the same 4 questions as 4 passes | 33.2 ms | 33.3 ms |
|
| 211 |
| 4 clips in one batch, 1 question each | 16.0 ms | 16.1 ms |
|
| 212 |
|
| 213 |
-
End
|
| 214 |
adapter weights into the backbone and replays CUDA graphs captured on first use of each input shape (the very first
|
| 215 |
-
call takes
|
| 216 |
-
(
|
| 217 |
|
| 218 |
Training details will be described in a technical report.
|
| 219 |
|
|
|
|
| 210 |
| the same 4 questions as 4 passes | 33.2 ms | 33.3 ms |
|
| 211 |
| 4 clips in one batch, 1 question each | 16.0 ms | 16.1 ms |
|
| 212 |
|
| 213 |
+
End-to-end inference time through `predict`, including feature extraction (not end-of-turn response latency); GPU memory 1.9 GB. The default `fast=True` merges the
|
| 214 |
adapter weights into the backbone and replays CUDA graphs captured on first use of each input shape (the very first
|
| 215 |
+
call takes approximately 0.5 s, each new shape approximately 0.1 s). `VoxTurn.from_pretrained(path, fast=False)` runs the unmerged weights eagerly
|
| 216 |
+
(approximately 38 ms) and reproduces the evaluation computation exactly.
|
| 217 |
|
| 218 |
Training details will be described in a technical report.
|
| 219 |
|