sima_utils.transformer.default_llm_config

Attributes

LLM_TOKENIZER_TYPE
LLM_VOCAB_SIZE
LLM_EMBED_DIM
LLM_INTERMEDIATE_SIZE
LLM_NUM_HIDDEN_LAYERS
LLM_NUM_ATTENTION_HEADS
LLM_HEAD_DIMENSION
LLM_NUM_KEY_VALUE_HEADS
LLM_CONTEXT_LENGTH
LLM_ROPE
LLM_SLIDING_WINDOW_ATTENTION
LLM_HIDDEN_ACT
LLM_LAYER_NORM

Functions

get_llm_parameter(→ any)

Get a parameter by name in the configuration dictionary.

Module Contents

sima_utils.transformer.default_llm_config.LLM_TOKENIZER_TYPE

sima_utils.transformer.default_llm_config.LLM_VOCAB_SIZE

sima_utils.transformer.default_llm_config.LLM_EMBED_DIM

sima_utils.transformer.default_llm_config.LLM_INTERMEDIATE_SIZE

sima_utils.transformer.default_llm_config.LLM_NUM_HIDDEN_LAYERS

sima_utils.transformer.default_llm_config.LLM_NUM_ATTENTION_HEADS

sima_utils.transformer.default_llm_config.LLM_HEAD_DIMENSION

sima_utils.transformer.default_llm_config.LLM_NUM_KEY_VALUE_HEADS

sima_utils.transformer.default_llm_config.LLM_CONTEXT_LENGTH

sima_utils.transformer.default_llm_config.LLM_ROPE

sima_utils.transformer.default_llm_config.LLM_SLIDING_WINDOW_ATTENTION

sima_utils.transformer.default_llm_config.LLM_HIDDEN_ACT

sima_utils.transformer.default_llm_config.LLM_LAYER_NORM

sima_utils.transformer.default_llm_config.get_llm_parameter(cfg: dict, key: str, default_if_missing: any) → any

Get a parameter by name in the configuration dictionary.

Parameters:

• cfg (dict) – The configuration dictionary.

• key (str) – The name of the parameter.

• default_if_missing (any) – The value for the parameter if missing.

Returns:

The value of the named parameter.