Issues

• Integrating this into other projects

  Infini-AI-Lab/UMbreLLa#29 · Filter by author Kenzogithubs opened on Apr 3, 2025
  1

• [request] add 4060 ti 16 gb support

  Infini-AI-Lab/UMbreLLa#23 · Filter by author cerulliber opened on Feb 13, 2025
  2

• GLM-4-9B series

  Infini-AI-Lab/UMbreLLa#19 · Filter by author dreaming-panda opened on Feb 10, 2025

• ibm-granite/granite-3.2-8b-instruct-preview

  Infini-AI-Lab/UMbreLLa#18 · Filter by author dreaming-panda opened on Feb 10, 2025

• Mistral Small 24b

  Infini-AI-Lab/UMbreLLa#16 · Filter by author phly95 opened on Feb 1, 2025
  2

• baichuan-inc/Baichuan-M1-14B-Instruct

  Infini-AI-Lab/UMbreLLa#13 · Filter by author dreaming-panda opened on Jan 24, 2025

• KV offloading

  enhancementhelp wanted
  Infini-AI-Lab/UMbreLLa#8 · Filter by author dreaming-panda opened on Jan 15, 2025

• API/Gradio Appending

  enhancementhelp wanted
  Infini-AI-Lab/UMbreLLa#6 · Filter by author dreaming-panda opened on Jan 14, 2025

• Multi GPU Support

  enhancementhelp wanted
  Infini-AI-Lab/UMbreLLa#5 · Filter by author dreaming-panda opened on Jan 14, 2025

• Long context support

  enhancementhelp wanted
  Infini-AI-Lab/UMbreLLa#4 · Filter by author dreaming-panda opened on Jan 14, 2025

• Quantization support

  enhancementhelp wanted
  Infini-AI-Lab/UMbreLLa#3 · Filter by author dreaming-panda opened on Jan 14, 2025

• Model Support

  enhancementhelp wanted
  Infini-AI-Lab/UMbreLLa#2 · Filter by author dreaming-panda opened on Jan 14, 2025
  1