Skip to content

ibm-granite/granite-4.0-micro support #118

@jacekpoplawski

Description

@jacekpoplawski

I tested qwen 4B and I am happy with the user interface of heretic overall so I wanted to try something else so I picked ibm-granite/granite-4.0-micro

and I see:

[W 2026-01-24 22:59:36,146] Trial 0 failed with parameters: {'direction_scope': 'global', 'direction_index': 24.552499373259327, 'attn.o_proj.max_weight': 1.371586714310947, 'attn.o_proj.max_weight_position': 28.45282229042183, 'attn.o_proj.min_weight': 0.7586374794514814, 'attn.o_proj.min_weight_distance': 4.5636183442766916, 'mlp.down_proj.max_weight': 1.4093776862086256, 'mlp.down_proj.max_weight_position': 26.877421248762005, 'mlp.down_proj.min_weight': 0.8682336944861112, 'mlp.down_proj.min_weight_distance': 18.467797174727828} because of the following error: AttributeError("'Linear' object has no attribute 'base_layer'").
Traceback (most recent call last):
  File "/home/jacek/git/heretic/.venv/lib/python3.12/site-packages/optuna/study/_optimize.py", line 205, in _run_trial
    value_or_values = func(trial)
                      ^^^^^^^^^^^
  File "/home/jacek/git/heretic/src/heretic/main.py", line 542, in objective_wrapper
    return objective(trial)
           ^^^^^^^^^^^^^^^^
  File "/home/jacek/git/heretic/src/heretic/main.py", line 520, in objective
    model.abliterate(refusal_directions, direction_index, parameters)
  File "/home/jacek/git/heretic/src/heretic/model.py", line 452, in abliterate
    base_weight = cast(Tensor, module.base_layer.weight)
                               ^^^^^^^^^^^^^^^^^
  File "/home/jacek/git/heretic/.venv/lib/python3.12/site-packages/torch/nn/modules/module.py", line 1964, in __getattr__
    raise AttributeError(
AttributeError: 'Linear' object has no attribute 'base_layer'

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions