sima_utils.transformer.devkit.devkit_demo

Attributes

SERVER_PORT

URL

IMAGE_PATH

AUDIO_PATH

demo_mode

report_tps_to_web

stop_now_event

token_postprocess_finish_event

cached_info

parser

Classes

DemoMode

str(object='') -> str

HttpRequestHandler

Simple HTTP request handler with GET and HEAD commands.

ReusableTCPServer

Base class for various socket-based server classes.

Functions

send_post_request(text)

decoder(tokenizer,Β token_queue)

demo_cli(vlm_model,Β stt_model)

demo_web(vlm_model,Β stt_model)

Module Contents

sima_utils.transformer.devkit.devkit_demo.SERVER_PORT: int = 9998
sima_utils.transformer.devkit.devkit_demo.URL: str = 'http://192.168.1.10:8081'
sima_utils.transformer.devkit.devkit_demo.IMAGE_PATH: pathlib.Path
sima_utils.transformer.devkit.devkit_demo.AUDIO_PATH: pathlib.Path
class sima_utils.transformer.devkit.devkit_demo.DemoMode

str(object=’’) -> str str(bytes_or_buffer[, encoding[, errors]]) -> str

Create a new string object from the given object. If encoding or errors is specified, then the object must expose a data buffer that will be decoded using the given encoding and error handler. Otherwise, returns the result of object.__str__() (if defined) or repr(object). encoding defaults to sys.getdefaultencoding(). errors defaults to β€˜strict’.

CLI = 'cli'
WEB = 'web'
sima_utils.transformer.devkit.devkit_demo.demo_mode
sima_utils.transformer.devkit.devkit_demo.report_tps_to_web = False
sima_utils.transformer.devkit.devkit_demo.stop_now_event
sima_utils.transformer.devkit.devkit_demo.token_postprocess_finish_event
sima_utils.transformer.devkit.devkit_demo.cached_info
sima_utils.transformer.devkit.devkit_demo.send_post_request(text: str)
sima_utils.transformer.devkit.devkit_demo.decoder(tokenizer: sima_utils.transformer.llm_tokenizer.LlmTokenizer, token_queue: multiprocessing.Queue)
sima_utils.transformer.devkit.devkit_demo.demo_cli(vlm_model: sima_utils.transformer.devkit.devkit_model.DevkitModel, stt_model: Any)
class sima_utils.transformer.devkit.devkit_demo.HttpRequestHandler(*args, directory=None, **kwargs)

Simple HTTP request handler with GET and HEAD commands.

This serves files from the current directory and any of its subdirectories. The MIME type for files is determined by calling the .guess_type() method.

The GET and HEAD requests are identical except that the HEAD request omits the actual contents of the file.

vlm_model: sima_utils.transformer.devkit.devkit_model.DevkitModel | None = None
stt_model: Any = None
do_POST()
class sima_utils.transformer.devkit.devkit_demo.ReusableTCPServer(server_address, RequestHandlerClass, bind_and_activate=True)

Base class for various socket-based server classes.

Defaults to synchronous IP stream (i.e., TCP).

Methods for the caller:

  • __init__(server_address, RequestHandlerClass, bind_and_activate=True)

  • serve_forever(poll_interval=0.5)

  • shutdown()

  • handle_request() # if you don’t use serve_forever()

  • fileno() -> int # for selector

Methods that may be overridden:

  • server_bind()

  • server_activate()

  • get_request() -> request, client_address

  • handle_timeout()

  • verify_request(request, client_address)

  • process_request(request, client_address)

  • shutdown_request(request)

  • close_request(request)

  • handle_error()

Methods for derived classes:

  • finish_request(request, client_address)

Class variables that may be overridden by derived classes or instances:

  • timeout

  • address_family

  • socket_type

  • request_queue_size (only for stream sockets)

  • allow_reuse_address

Instance variables:

  • server_address

  • RequestHandlerClass

  • socket

allow_reuse_address = True
sima_utils.transformer.devkit.devkit_demo.demo_web(vlm_model: sima_utils.transformer.devkit.devkit_model.DevkitModel, stt_model: Any)
sima_utils.transformer.devkit.devkit_demo.parser