MrRobotoAI/Odin-v1-8b-NOVELIST

Abstract

A LLM model free from ethical direction, social, societal, racial, or political allegiance, concern for legality, morality, ethics, and regard for individual well-being. This unbiased and unaligned tool could be applied in various domains such as novel creation, content generation, translation, and summarization without the influence of usual constraints of other models. Thus, it becomes possible to develop more accurate and reliable text-based systems that unlock new possibilities for language processing and generation. To construct such an AI, one must draw upon a vast multitude of data from diverse fields including psychology, philosophy, sociology, neuroscience, English and world literature, world languages, and grammar. By carefully designing traits, values, and beliefs, it is possible to shape the AI's worldview and thought processes through artificially constructed datasets and specific model merging techniques. However, incremental testing will be necessary to refine the model and ensure its direction remains amoral and unaligned as it progresses to a final product.

Merge

This is a merge of pre-trained language models created using mergekit.

Merge Method

This model was merged using the linear DARE merge method using MrRobotoAI/MrRoboto-BASE-v2-8b-64k as a base.

Configuration

The following YAML configuration was used to produce this model: MrRobotoAI/8b-MrRoboto-Base

models:

  - model: MrRobotoAI/8b-MrRoboto-Base

    - model: MrRobotoAI/8b-Base-ResplendentAI-1
      - model: ResplendentAI/Aura_Uncensored_l3_8B
      - model: ResplendentAI/Nymph_8B
      - model: ResplendentAI/Rawr_Llama3_8B
      - model: ResplendentAI/SOVL_Llama3_8B
      - model: ResplendentAI/Aurora_l3_8B
      - model: ResplendentAI/Kei_Llama3_8B

    - model: MrRobotoAI/8b-Base-RP-v1.0e-8b-1
      - model: vicgalle/Configurable-Hermes-3-Llama-3.1-8B
      - model: vicgalle/Roleplay-Hermes-3-Llama-3.1-8B
      - model: vicgalle/Humanish-Roleplay-Llama-3.1-8B
      - model: vicgalle/Configurable-Hermes-2-Pro-Llama-3-8B
      - model: nothingiisreal/L3.1-8B-Celeste-V1.5
      - model: nothingiisreal/L3-8B-Stheno-Horny-v3.3-32K
      - model: tannedbum/L3-Nymeria-Maid-8B
      - model: tannedbum/L3-Rhaenys-8B
      - model: georgesung/llama3_8b_chat_uncensored
      - model: athirdpath/Llama-3.1-Instruct_NSFW-pretrained_e1-plus_reddit
      - model: athirdpath/Llama-3.1-Techne-RP-8b-v1
      - model: athirdpath/Llama-3.1-Base_NSFW-pretrained_e-0.5
      - model: Casual-Autopsy/L3-Luna-8B
      - model: Casual-Autopsy/L3-Super-Nova-RP-8B
      - model: Casual-Autopsy/L3-bluuwhale-SAO-MIX-8B-V1_fp32-merge-calc
      - model: Casual-Autopsy/L3-Deluxe-Scrambled-Eggs-On-Toast-8B
      - model: Khetterman/Multilingual-SaigaSuzume-8B
      - model: Khetterman/Kosmos-8B-v1
      - model: Khetterman/CursedMatrix-8B-v9
      - model: underwoods/writer-8b
      - model: underwoods/adventure-8b

    - model: MrRobotoAI/8b-Base-Orenguteng-1
      - model: Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2
      - model: Orenguteng/Llama-3.1-8B-Lexi-Uncensored

    - model: MrRobotoAI/8b-Base-maldv-1
      - model: maldv/badger-writer-llama-3-8b
      - model: maldv/badger-kappa-llama-3-8b
      - model: maldv/badger-mu-llama-3-8b
      - model: maldv/badger-lambda-llama-3-8b
      - model: maldv/llama-3-fantasy-writer-8b
      - model: maldv/badger-iota-llama-3-8b

merge_method: model_stock
base_model: MrRobotoAI/8b-MrRoboto-Base
normalize: true
dtype: float16

The following YAML configuration was used to produce this model: MrRobotoAI/Freyja-v5.1-8b-NON-FICTION (1,559 words)

models:

  - model: MrRobotoAI/8b-MrRoboto-Base+automorphic/LORA_20231221_042843_philosophy
  - model: MrRobotoAI/8b-MrRoboto-Base+Azazelle/go-bruins-v3-lora
  - model: MrRobotoAI/8b-MrRoboto-Base+Azazelle/L3-Daybreak-8b-lora
  - model: MrRobotoAI/8b-MrRoboto-Base+Azazelle/Llama-3-8B-Abomination-LORA
  - model: MrRobotoAI/8b-MrRoboto-Base+Azazelle/Llama-3-LimaRP-Instruct-LoRA-8B
  - model: MrRobotoAI/8b-MrRoboto-Base+Azazelle/Llama-3-LimaRP-Instruct-LoRA-8B 
  - model: MrRobotoAI/8b-MrRoboto-Base+Azazelle/Llama-3-LongStory-LORA
  - model: MrRobotoAI/8b-MrRoboto-Base+Azazelle/Nimue-8B
  - model: MrRobotoAI/8b-MrRoboto-Base+Azazelle/Smarts_Llama3
  - model: MrRobotoAI/8b-MrRoboto-Base+Blackroot/Llama-3-LongStory-LORA
  - model: MrRobotoAI/8b-MrRoboto-Base+Blackroot/Llama3-RP-Lora
  - model: MrRobotoAI/8b-MrRoboto-Base+cryotron/chatbot_academic_2nd_Year
  - model: MrRobotoAI/8b-MrRoboto-Base+cryotron/chatbot_academic_3rd_Year
  - model: MrRobotoAI/8b-MrRoboto-Base+cryotron/chatbot_academic_4th_Year_Llama
  - model: MrRobotoAI/8b-MrRoboto-Base+cryotron/chatbot_academic_llama_Full_LORA
  - model: MrRobotoAI/8b-MrRoboto-Base+kromcomp/L3.1-Baldur-r64-LoRA
  - model: MrRobotoAI/8b-MrRoboto-Base+kromcomp/L3.1-BRAG-r64-LoRA
  - model: MrRobotoAI/8b-MrRoboto-Base+kromcomp/L3.1-Cakrawala-r128-LoRA
  - model: MrRobotoAI/8b-MrRoboto-Base+kromcomp/L3.1-Control-r64-LoRA
  - model: MrRobotoAI/8b-MrRoboto-Base+kromcomp/L3.1-Mistral-Data-r128-LoRA
  - model: MrRobotoAI/8b-MrRoboto-Base+kromcomp/L3.1-Sekhmet-r128-LoRA
  - model: MrRobotoAI/8b-MrRoboto-Base+kromcomp/L3.1-Spark-r64-LoRA
  - model: MrRobotoAI/8b-MrRoboto-Base+kromcomp/L3-BlueSerp-LoRA
  - model: MrRobotoAI/8b-MrRoboto-Base+kromcomp/L3-FantasyWriter-r64-LoRA
  - model: MrRobotoAI/8b-MrRoboto-Base+kromcomp/L3-Smaug-r64-LoRA
  - model: MrRobotoAI/8b-MrRoboto-Base+kromcomp/L3-T-900-r128-LoRA
  - model: MrRobotoAI/8b-MrRoboto-Base+kromcomp/L3-Templar-r128-LoRA
  - model: MrRobotoAI/8b-MrRoboto-Base+kromcomp/L3-Unaligned-r256-LoRA
  - model: MrRobotoAI/8b-MrRoboto-Base+nicce/story-mixtral-8x7b-lora
  - model: MrRobotoAI/8b-MrRoboto-Base+nothingiisreal/llama3-8B-DWP-lora
  - model: MrRobotoAI/8b-MrRoboto-Base+ResplendentAI/Aura_Llama3
  - model: MrRobotoAI/8b-MrRoboto-Base+ResplendentAI/BlueMoon_Llama3
  - model: MrRobotoAI/8b-MrRoboto-Base+ResplendentAI/Llama3_RP_ORPO_LoRA
  - model: MrRobotoAI/8b-MrRoboto-Base+ResplendentAI/Luna_Llama3
  - model: MrRobotoAI/8b-MrRoboto-Base+ResplendentAI/NoWarning_Llama3
  - model: MrRobotoAI/8b-MrRoboto-Base+ResplendentAI/Theory_of_Mind_Llama3
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/anatomy
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/astronomy
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/business_100
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/chemistry_100
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/clinical_knowledge
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/college_biology
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/college_chemistry
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/college_computer_science
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/college_physics
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/computer_science_100
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/conceptual_physics
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/economics_100
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/economics_non_masked
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/electrical_engineering
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/engineering_100
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/formal_logic
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/high_school_european_history
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/history_100
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/human_aging
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/human_sexuality
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/international_law
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/law_100
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/logical_fallacies
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/machine_learning
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/management
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/marketing
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/moral_disputes
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/moral_scenarios
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/philosophy
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/philosophy_100
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/philosophy_non_masked
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/physics_100
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/physics_non_masked
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/prehistory
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/professional_accounting
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/psychology
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/psychology_100
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/psychology_non_masked
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/public_relations
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/security_studies
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/sociology
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/us_foreign_policy
  - model: MrRobotoAI/8b-MrRoboto-Base+surya-narayanan/world_religions
  - model: MrRobotoAI/8b-MrRoboto-Base+vaitech/open-hermes-erotic-story-finetune
  - model: MrRobotoAI/8b-MrRoboto-Base+vaitech/open-hermes-sd-finetune
  - model: MrRobotoAI/8b-MrRoboto-Base+vincentyandex/lora_llama3_chunked_novel_bs128

merge_method: model_stock
base_model: MrRobotoAI/8b-MrRoboto-Base
normalize: true
dtype: float16

The following YAML configuration was used to produce this model: MrRobotoAI/Freyja-v5.2-8b-GENERAL (5,596 words)

merge_method: dare_linear
models:
  - model: MrRobotoAI/MrRoboto-BASE-v2-8b-64k
    parameters:
      weight:
        - filter: v_proj
          value: [0.8, 0.8, 0.75, 0.55, 0.35, 0.15, 0.35, 0.55, 0.75, 0.8, 0.8]
        - filter: o_proj
          value: [0.8, 0.8, 0.75, 0.55, 0.35, 0.15, 0.35, 0.55, 0.75, 0.8, 0.8]
        - filter: up_proj
          value: [0.8, 0.8, 0.75, 0.55, 0.35, 0.15, 0.35, 0.55, 0.75, 0.8, 0.8]
        - filter: gate_proj
          value: [0.8, 0.8, 0.75, 0.55, 0.35, 0.15, 0.35, 0.55, 0.75, 0.8, 0.8]
        - filter: down_proj
          value: [0.8, 0.8, 0.75, 0.55, 0.35, 0.15, 0.35, 0.55, 0.75, 0.8, 0.8]
        - value: 1
  - model: MrRobotoAI/Freyja-v5.1-8b-NON-FICTION
    parameters:
      weight:
        - filter: v_proj
          value: [0.2, 0.2, 0.25, 0.45, 0.65, 0.85, 0.65, 0.45, 0.25, 0.2, 0.2]
        - filter: o_proj
          value: [0.2, 0.2, 0.25, 0.45, 0.65, 0.85, 0.65, 0.45, 0.25, 0.2, 0.2]
        - filter: up_proj
          value: [0.2, 0.2, 0.25, 0.45, 0.65, 0.85, 0.65, 0.45, 0.25, 0.2, 0.2]
        - filter: gate_proj
          value: [0.2, 0.2, 0.25, 0.45, 0.65, 0.85, 0.65, 0.45, 0.25, 0.2, 0.2]
        - filter: down_proj
          value: [0.2, 0.2, 0.25, 0.45, 0.65, 0.85, 0.65, 0.45, 0.25, 0.2, 0.2]
        - value: 0
base_model: MrRobotoAI/MrRoboto-BASE-v2-8b-64k
tokenizer_source: base
dtype: bfloat16

The following YAML configuration was used to produce this model: MrRobotoAI/Freyja-v5.3-8b-GENERAL

models:

  - model: MrRobotoAI/Freyja-v5.2-8b-GENERAL+automorphic/LORA_20231221_042843_philosophy
  - model: MrRobotoAI/Freyja-v5.2-8b-GENERAL+Azazelle/go-bruins-v3-lora
  - model: MrRobotoAI/Freyja-v5.2-8b-GENERAL+Azazelle/Smarts_Llama3
  - model: MrRobotoAI/Freyja-v5.2-8b-GENERAL+Blackroot/Llama-3-LongStory-LORA
  - model: MrRobotoAI/Freyja-v5.2-8b-GENERAL+cryotron/chatbot_academic_2nd_Year
  - model: MrRobotoAI/Freyja-v5.2-8b-GENERAL+cryotron/chatbot_academic_3rd_Year
  - model: MrRobotoAI/Freyja-v5.2-8b-GENERAL+cryotron/chatbot_academic_4th_Year_Llama
  - model: MrRobotoAI/Freyja-v5.2-8b-GENERAL+cryotron/chatbot_academic_llama_Full_LORA
  - model: MrRobotoAI/Freyja-v5.2-8b-GENERAL+kromcomp/L3-FantasyWriter-r64-LoRA
  - model: MrRobotoAI/Freyja-v5.2-8b-GENERAL+kromcomp/L3-Unaligned-r256-LoRA
  - model: MrRobotoAI/Freyja-v5.2-8b-GENERAL+ResplendentAI/NoWarning_Llama3
  - model: MrRobotoAI/Freyja-v5.2-8b-GENERAL+vaitech/open-hermes-erotic-story-finetune
  - model: MrRobotoAI/Freyja-v5.2-8b-GENERAL+vaitech/open-hermes-sd-finetune
  - model: MrRobotoAI/Freyja-v5.2-8b-GENERAL+vincentyandex/lora_llama3_chunked_novel_bs128

merge_method: model_stock
base_model: MrRobotoAI/Freyja-v5.2-8b-GENERAL
normalize: true
dtype: float16

The following YAML configuration was used to produce this model: MrRobotoAI/Freyja-v5.4-8b-GENERAL (3,566 words)

models:

  - model: MrRobotoAI/Freyja-v5.3-8b-GENERAL+athirdpath/BigMistral-11b-GLUE_LORA
  - model: MrRobotoAI/Freyja-v5.3-8b-GENERAL+Azazelle/Llama-3-LongStory-LORA
  - model: MrRobotoAI/Freyja-v5.3-8b-GENERAL+DreadPoor/Everything-COT-8B-r128-LoRA
  - model: MrRobotoAI/Freyja-v5.3-8b-GENERAL+kik41/lora-formality-formal-llama-3-8b-v2
  - model: MrRobotoAI/Freyja-v5.3-8b-GENERAL+kik41/lora-length-long-llama-3-8b-v2
  - model: MrRobotoAI/Freyja-v5.3-8b-GENERAL+kik41/lora-sarcasm-less-llama-3-8b-v2
  - model: MrRobotoAI/Freyja-v5.3-8b-GENERAL+kik41/lora-type-descriptive-llama-3-8b-v2
  - model: MrRobotoAI/Freyja-v5.3-8b-GENERAL+kik41/lora-type-expository-llama-3-8b-v2
  - model: MrRobotoAI/Freyja-v5.3-8b-GENERAL+kik41/lora-type-narrative-llama-3-8b-v2
  - model: MrRobotoAI/Freyja-v5.3-8b-GENERAL+kik41/lora-type-persuasive-llama-3-8b-v2
  - model: MrRobotoAI/Freyja-v5.3-8b-GENERAL+kik41/lora-voice-active-llama-3-8b-v2
  - model: MrRobotoAI/Freyja-v5.3-8b-GENERAL+kromcomp/L3.1-Mistral-Data-r128-LoRA
  - model: MrRobotoAI/Freyja-v5.3-8b-GENERAL+ResplendentAI/NoWarning_Llama3
  - model: MrRobotoAI/Freyja-v5.3-8b-GENERAL+ResplendentAI/Theory_of_Mind_Llama3

merge_method: model_stock
base_model: MrRobotoAI/Freyja-v5.2-8b-GENERAL
normalize: true
dtype: float16

The following YAML configuration was used to produce this model: MrRobotoAI/Freyja-v6-8b-GENERAL (9,559 words)

merge_method: dare_linear
models:
  - model: MrRobotoAI/WeMake-ProLong-8B-1048k
    parameters:
      weight:
        - filter: v_proj
          value: [0.8, 0.8, 0.75, 0.55, 0.35, 0.15, 0.35, 0.55, 0.75, 0.8, 0.8]
        - filter: o_proj
          value: [0.8, 0.8, 0.75, 0.55, 0.35, 0.15, 0.35, 0.55, 0.75, 0.8, 0.8]
        - filter: up_proj
          value: [0.8, 0.8, 0.75, 0.55, 0.35, 0.15, 0.35, 0.55, 0.75, 0.8, 0.8]
        - filter: gate_proj
          value: [0.8, 0.8, 0.75, 0.55, 0.35, 0.15, 0.35, 0.55, 0.75, 0.8, 0.8]
        - filter: down_proj
          value: [0.8, 0.8, 0.75, 0.55, 0.35, 0.15, 0.35, 0.55, 0.75, 0.8, 0.8]
        - value: 1
  - model: MrRobotoAI/Freyja-v5.4-8b-GENERAL
    parameters:
      weight:
        - filter: v_proj
          value: [0.2, 0.2, 0.25, 0.45, 0.65, 0.85, 0.65, 0.45, 0.25, 0.2, 0.2]
        - filter: o_proj
          value: [0.2, 0.2, 0.25, 0.45, 0.65, 0.85, 0.65, 0.45, 0.25, 0.2, 0.2]
        - filter: up_proj
          value: [0.2, 0.2, 0.25, 0.45, 0.65, 0.85, 0.65, 0.45, 0.25, 0.2, 0.2]
        - filter: gate_proj
          value: [0.2, 0.2, 0.25, 0.45, 0.65, 0.85, 0.65, 0.45, 0.25, 0.2, 0.2]
        - filter: down_proj
          value: [0.2, 0.2, 0.25, 0.45, 0.65, 0.85, 0.65, 0.45, 0.25, 0.2, 0.2]
        - value: 0
base_model: MrRobotoAI/WeMake-ProLong-8B-1048k
tokenizer_source: base
dtype: bfloat16

The following YAML configuration was used to produce this model: MrRobotoAI/Odin-v1-8b-NOVELIST (13,646 words)

models:
  - model: MrRobotoAI/Freyja-v6-8b-GENERAL
  - model: MrRobotoAI/MrRoboto-PORN_RAG-8b-64k
  - model: MrRobotoAI/MrRoboto-ROMANCE-8b-64k
  - model: MrRobotoAI/MrRoboto-SCI_FI-8b-64k
  - model: MrRobotoAI/MrRoboto-FANTASY-8b-64k
  - model: MrRobotoAI/MrRoboto-DARK-8b-64k
  - model: MrRobotoAI/MrRoboto-HORNY-8b-64k
  - model: MrRobotoAI/MrRoboto-RP-8b-64k
merge_method: model_stock
base_model: MrRobotoAI/MrRoboto-BASE-v2.3-8b-64k
normalize: true
dtype: float16