sima_utils.transformer.devkit.devkit_demo ========================================= .. py:module:: sima_utils.transformer.devkit.devkit_demo Attributes ---------- .. autoapisummary:: sima_utils.transformer.devkit.devkit_demo.SERVER_PORT sima_utils.transformer.devkit.devkit_demo.URL sima_utils.transformer.devkit.devkit_demo.IMAGE_PATH sima_utils.transformer.devkit.devkit_demo.AUDIO_PATH sima_utils.transformer.devkit.devkit_demo.demo_mode sima_utils.transformer.devkit.devkit_demo.report_tps_to_web sima_utils.transformer.devkit.devkit_demo.stop_now_event sima_utils.transformer.devkit.devkit_demo.token_postprocess_finish_event sima_utils.transformer.devkit.devkit_demo.cached_info sima_utils.transformer.devkit.devkit_demo.parser Classes ------- .. autoapisummary:: sima_utils.transformer.devkit.devkit_demo.DemoMode sima_utils.transformer.devkit.devkit_demo.HttpRequestHandler sima_utils.transformer.devkit.devkit_demo.ReusableTCPServer Functions --------- .. autoapisummary:: sima_utils.transformer.devkit.devkit_demo.send_post_request sima_utils.transformer.devkit.devkit_demo.decoder sima_utils.transformer.devkit.devkit_demo.demo_cli sima_utils.transformer.devkit.devkit_demo.demo_web Module Contents --------------- .. py:data:: SERVER_PORT :type: int :value: 9998 .. py:data:: URL :type: str :value: 'http://192.168.1.10:8081' .. py:data:: IMAGE_PATH :type: pathlib.Path .. py:data:: AUDIO_PATH :type: pathlib.Path .. py:class:: DemoMode str(object='') -> str str(bytes_or_buffer[, encoding[, errors]]) -> str Create a new string object from the given object. If encoding or errors is specified, then the object must expose a data buffer that will be decoded using the given encoding and error handler. Otherwise, returns the result of object.__str__() (if defined) or repr(object). encoding defaults to sys.getdefaultencoding(). errors defaults to 'strict'. .. py:attribute:: CLI :value: 'cli' .. py:attribute:: WEB :value: 'web' .. py:data:: demo_mode .. py:data:: report_tps_to_web :value: False .. py:data:: stop_now_event .. py:data:: token_postprocess_finish_event .. py:data:: cached_info .. py:function:: send_post_request(text: str) .. py:function:: decoder(tokenizer: sima_utils.transformer.llm_tokenizer.LlmTokenizer, token_queue: multiprocessing.Queue) .. py:function:: demo_cli(vlm_model: sima_utils.transformer.devkit.devkit_model.DevkitModel, stt_model: Any) .. py:class:: HttpRequestHandler(*args, directory=None, **kwargs) Simple HTTP request handler with GET and HEAD commands. This serves files from the current directory and any of its subdirectories. The MIME type for files is determined by calling the .guess_type() method. The GET and HEAD requests are identical except that the HEAD request omits the actual contents of the file. .. py:attribute:: vlm_model :type: sima_utils.transformer.devkit.devkit_model.DevkitModel | None :value: None .. py:attribute:: stt_model :type: Any :value: None .. py:method:: do_POST() .. py:class:: ReusableTCPServer(server_address, RequestHandlerClass, bind_and_activate=True) Base class for various socket-based server classes. Defaults to synchronous IP stream (i.e., TCP). Methods for the caller: - __init__(server_address, RequestHandlerClass, bind_and_activate=True) - serve_forever(poll_interval=0.5) - shutdown() - handle_request() # if you don't use serve_forever() - fileno() -> int # for selector Methods that may be overridden: - server_bind() - server_activate() - get_request() -> request, client_address - handle_timeout() - verify_request(request, client_address) - process_request(request, client_address) - shutdown_request(request) - close_request(request) - handle_error() Methods for derived classes: - finish_request(request, client_address) Class variables that may be overridden by derived classes or instances: - timeout - address_family - socket_type - request_queue_size (only for stream sockets) - allow_reuse_address Instance variables: - server_address - RequestHandlerClass - socket .. py:attribute:: allow_reuse_address :value: True .. py:function:: demo_web(vlm_model: sima_utils.transformer.devkit.devkit_model.DevkitModel, stt_model: Any) .. py:data:: parser