sima_utils.transformer.gguf_conversion
======================================

.. py:module:: sima_utils.transformer.gguf_conversion


Attributes
----------

.. autoapisummary::

   sima_utils.transformer.gguf_conversion.GGUF_CONFIG_MAP
   sima_utils.transformer.gguf_conversion.gguf_file


Classes
-------

.. autoapisummary::

   sima_utils.transformer.gguf_conversion.GgufModel


Module Contents
---------------

.. py:data:: GGUF_CONFIG_MAP
   :type:  dict

.. py:class:: GgufModel(gguf_path: str)

   LLM model from a GGUF file.

   .. attribute:: file_path

      The path of a GGUF model file.

      :type: str

   .. attribute:: model_info

      The dictionary of model information.

      :type: dict

   .. attribute:: tensor_info

      The dictionary of model weights.

      :type: dict


   .. py:attribute:: file_path
      :type:  str


   .. py:attribute:: model_info
      :type:  dict


   .. py:attribute:: tensor_info
      :type:  dict


   .. py:method:: get_model_config() -> dict

      Convert GGUF model config to HF style.




.. py:data:: gguf_file