---
language:
- he
- en
tags:
- topai
- duchifat
- instruct
- roleplay
license: apache-2.0
model-index:
- name: Duchifat-2.3-Instruct
  results:
  - task:
      type: text-generation
      name: arc_easy
    dataset:
      name: arc_easy
      type: arc_easy
      config: default
      split: test
    metrics:
    - name: Accuracy
      type: accuracy
      value: 0.2769
  - task:
      type: text-generation
      name: hellaswag
    dataset:
      name: hellaswag
      type: hellaswag
      config: default
      split: test
    metrics:
    - name: Accuracy
      type: accuracy
      value: 0.2594
  - task:
      type: text-generation
      name: piqa
    dataset:
      name: piqa
      type: piqa
      config: default
      split: test
    metrics:
    - name: Accuracy
      type: accuracy
      value: 0.5365
  - task:
      type: text-generation
      name: winogrande
    dataset:
      name: winogrande
      type: winogrande
      config: default
      split: test
    metrics:
    - name: Accuracy
      type: accuracy
      value: 0.5225
---

# Duchifat-2.3-Instruct

## Benchmark Results
|  Tasks   |Version|Filter|n-shot| Metric |   |Value |   |Stderr|
|----------|------:|------|-----:|--------|---|-----:|---|-----:|
|arc_easy  |      1|none  |     0|acc     |↑  |0.2769|±  |0.0092|
|          |       |none  |     0|acc_norm|↑  |0.2786|±  |0.0092|
|hellaswag |      1|none  |     0|acc     |↑  |0.2594|±  |0.0044|
|          |       |none  |     0|acc_norm|↑  |0.2581|±  |0.0044|
|piqa      |      1|none  |     0|acc     |↑  |0.5365|±  |0.0116|
|          |       |none  |     0|acc_norm|↑  |0.5082|±  |0.0117|
|winogrande|      1|none  |     0|acc     |↑  |0.5225|±  |0.0140|