描述
网址
标签
收藏类型
URL
https://github.com/Akegarasu/ChatGLM-webui
原链接
Origin
github.com
Tags
Cubox 深度链接
收藏夹
创建时间 2
更新时间
A WebUI for ChatGLM-6B. Contribute to Akegarasu/ChatGLM-webui development by creating an account on G……

ChatGLM-webui

A webui for ChatGLM made by THUDM. chatglm-6b
notion image

Features

  • Original Chat like chatglm-6b’s demo, but use Gradio Chatbox for better user experience.
  • One click install script (but you still must install python)
  • More parameters that can be freely adjusted
  • Convenient save/load dialog history, presets
  • Custom maximum context length
  • Save to Markdown
  • Use program arguments to specify model and caculation accuracy

Install

requirements

python3.10
or

Run

Arguments

  • -model-path: specify model path. If this parameter is not specified manually, the default value is . Transformers will automatically download model from huggingface.THUDM/chatglm-6b
  • -listen: launch gradio with 0.0.0.0 as server name, allowing to respond to network requests
  • -port: webui port
  • -share: use gradio to share
  • -precision: fp32(CPU only), fp16, int4(CUDA GPU only), int8(CUDA GPU only)
  • -cpu: use cpu > 本文由简悦 SimpRead 转码