sima_utils.transformer.gguf_conversion
Attributes
Classes
LLM model from a GGUF file. |
Module Contents
- sima_utils.transformer.gguf_conversion.GGUF_CONFIG_MAP: dict
- class sima_utils.transformer.gguf_conversion.GgufModel(gguf_path: str)
LLM model from a GGUF file.
- file_path
The path of a GGUF model file.
- Type:
str
- model_info
The dictionary of model information.
- Type:
dict
- tensor_info
The dictionary of model weights.
- Type:
dict
- file_path: str
- model_info: dict
- tensor_info: dict
- get_model_config() dict
Convert GGUF model config to HF style.
- sima_utils.transformer.gguf_conversion.gguf_file