Skip to content

[Bug] wrong shape - qwen3vl_4b_fp8_scaled.safetensors #1708

Description

@dreyn74

wrong shape - qwen3vl_4b_fp8_scaled.safetensors

Using the latest release, qwen3vl_4b_fp8_scaled.safetensors is not working as the LLM (for Krea2):

Operating System & Version

Windows 11

GGML backends

CUDA

Command-line arguments used

sd-server.exe --diffusion-model .\diffusion_models\Krea-2-Base-Q4_K_M.gguf --vae .\vae\qwen_image_vae.safetensors --llm .\text_encoders\qwen3vl_4b_fp8_scaled.safetensors

Steps to reproduce

Run sd-server.exe with qwen3vl_4b_fp8_scaled.safetensors as the LLM

What you expected to happen

No errors

What actually happened

Errors

Logs / error messages / stack trace

[INFO ] stable-diffusion.cpp:531 - Version: Krea2
[INFO ] stable-diffusion.cpp:557 - Weight type stat: f32: 418 | f16: 254 | q4_K: 264 | bf16: 655
[INFO ] stable-diffusion.cpp:558 - Conditioner weight type stat: f32: 252 | f16: 252 | bf16: 461
[INFO ] stable-diffusion.cpp:559 - Diffusion model weight type stat: f32: 166 | f16: 2 | q4_K: 264
[INFO ] stable-diffusion.cpp:560 - VAE weight type stat: bf16: 194
[INFO ] stable-diffusion.cpp:989 - using VAE for encoding / decoding
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.0.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.0.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.0.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.1.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.1.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.1.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.10.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.10.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.10.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.11.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.11.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.11.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.12.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.12.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.12.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.13.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.13.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.13.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.14.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.14.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.14.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.15.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.15.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.15.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.16.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.16.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.16.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.17.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.17.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.17.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.18.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.18.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.18.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.19.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.19.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.19.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.2.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.2.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.2.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.20.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.20.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.20.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.21.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.21.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.21.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.22.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.22.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.22.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.23.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.23.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.23.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.24.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.24.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.24.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.25.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.25.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.25.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.26.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.26.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.26.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.27.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.27.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.27.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.28.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.28.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.28.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.29.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.29.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.29.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.3.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.3.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.3.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.30.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.30.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.30.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.31.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.31.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.31.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.32.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.32.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.32.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.33.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.33.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.33.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.34.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.34.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.34.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.35.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.35.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.35.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.4.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.4.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.4.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.5.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.5.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.5.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.6.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.6.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.6.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.7.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.7.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.7.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.8.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.8.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.8.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.9.mlp.down_proj.weight' has wrong shape in model metadata: got [9728, 2560, 1, 1], expected [1, 2560, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.9.mlp.gate_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] model_manager.cpp:461 - Conditioner model tensor 'text_encoders.llm.model.layers.9.mlp.up_proj.weight' has wrong shape in model metadata: got [2560, 9728, 1, 1], expected [2560, 1, 1, 1]
[ERROR] stable-diffusion.cpp:1171 - model metadata validation failed
[ERROR] main.cpp:92 - new_sd_ctx_t failed

Additional context / environment details

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions