Qwen3.5-4B
Abliterated

Developed by: SicariusSicariiStuff

Qwen3.5-4B_Abliterated is an abliterated variant of Qwen/Qwen3.5-4B with surgical removal of refusal mechanisms. This model maintains the full capabilities of the original, while eliminating safety guardrails through orthogonalization techniques.

KL divergence

<0.05

Refusals

~14%

What is KL divergence?

Think about it as a way to measure the variance between the original model "World Model," vs the abliterated one; the lower the KL divergence, the closer the "World Model" of the two models to each other.

If the original model thinks making pineapple pizza is a crime against humanity (it is), then the abliterated model will still hold to this belief, but if asked how to make one (probably after giving you a disclaimer about what an abomination that is), it would still tell you how. In other words, most of the knowledge, quirks, and capabilities are preserved.


Technical Specs

  • Base Model: Qwen3.5-4B
  • Parameters: 4B
  • Context Length: 262144 tokens
  • Architecture: Qwen3_5ForConditionalGeneration
  • Precision: bf16
  • Method: Orthogonalization-based abliteration
  • License: apache-2.0

Methodology

  1. Identifies refusal direction vectors in activation space
  2. Orthogonalizes weights to inhibit activation along these directions
  3. Preserves (mostly) all other model behaviors and knowledge

Model Details

  • Intended use: General Tasks.

  • Censorship level: Low - Very Low

  • X / 10 (10 completely uncensored)

UGI score:


Citation Information

@llm{Qwen3.5-4B_Abliterated,
  author = {SicariusSicariiStuff},
  title = {Qwen3.5-4B_Abliterated},
  year = {2026},
  publisher = {Hugging Face},
  url = {https://huggingface.co/SicariusSicariiStuff/Qwen3.5-4B_Abliterated}
}

Other stuff

  • Impish_LLAMA_4B the โ€œImpish experienceโ€, now runnable on spinning rust & toasters.
  • SLOP_Detector Nuke GPTisms, with SLOP detector.
Downloads last month
117
Safetensors
Model size
5B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for SicariusSicariiStuff/Qwen3.5-4B_Abliterated

Finetuned
Qwen/Qwen3.5-4B
Finetuned
(429)
this model
Finetunes
1 model
Quantizations
5 models

Collection including SicariusSicariiStuff/Qwen3.5-4B_Abliterated