Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+arco-plus.Q4_0.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,38 @@
+---
+base_model:
+- appvoid/arco
+- h2oai/h2o-danube3-500m-base
+library_name: transformers
+tags:
+- mergekit
+- merge
+
+---
+# arco+
+
+This is an untrained passthrough model based on arco and danube as a first effort to train a small enough reasoning language model that generalizes across all kind of reasoning tasks.
+
+#### Benchmarks
+
+| Parameters | Model                          | MMLU  | ARC | HellaSwag | PIQA   | Winogrande | Average |
+| -----------|--------------------------------|-------|-------|-----------|--------|------------|---------|
+| 488m       | arco-lite                      | **23.22** | 33.45 | 56.55| 69.70 | **59.19**| 48.46 |
+| 773m       | arco-plus                      | 23.06 | **36.43** | **60.09**|**72.36**| **60.46**| **50.48** |
+
+#### Configuration
+
+The following YAML configuration was used to produce this model:
+
+```yaml
+slices:
+  - sources:
+    - model: appvoid/arco
+      layer_range: [0, 14]
+  - sources:
+    - model: h2oai/h2o-danube3-500m-base
+      layer_range: [4, 16]
+
+merge_method: passthrough
+dtype: float16
+
+```

arco-plus.Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e733740ceb8609600ca320be7c6ad18f286604c66104508f43f45076a7a2274c
+size 448577984