16 lines
1.5 KiB
Text
16 lines
1.5 KiB
Text
|
2026-07-07 13:44:42 | INFO | Starting server on 0.0.0.0:8000
|
||
|
|
2026-07-07 13:44:42 | INFO | Multi-handler server configuration complete.
|
||
|
|
2026-07-07 13:44:42 | INFO | Starting Uvicorn server...
|
||
|
|
2026-07-07 13:44:42 | INFO | Model registry initialized
|
||
|
|
2026-07-07 13:44:42 | INFO | Spawning handler process for model 'mlx-community/Qwen2.5-Coder-7B-Instruct-4bit' (type=lm, path=mlx-community/Qwen2.5-Coder-7B-Instruct-4bit)
|
||
|
|
2026-07-07 13:44:42 | INFO | Spawned handler process for 'mlx-community/Qwen2.5-Coder-7B-Instruct-4bit' (pid=5116)
|
||
|
|
2026-07-07 13:44:43 | INFO | 'mlx-community/Qwen2.5-Coder-7B-Instruct-4bit': Fetching 'mlx-community/Qwen2.5-Coder-7B-Instruct-4bit' from HuggingFace...
|
||
|
|
2026-07-07 13:45:26 | INFO | 'mlx-community/Qwen2.5-Coder-7B-Instruct-4bit': Fetched 'mlx-community/Qwen2.5-Coder-7B-Instruct-4bit'
|
||
|
|
2026-07-07 13:45:33 | INFO | Handler process for 'mlx-community/Qwen2.5-Coder-7B-Instruct-4bit' is ready
|
||
|
|
2026-07-07 13:45:33 | INFO | Registered model: mlx-community/Qwen2.5-Coder-7B-Instruct-4bit (type=lm, context_length=None)
|
||
|
|
2026-07-07 13:45:33 | INFO | Model 'mlx-community/Qwen2.5-Coder-7B-Instruct-4bit' spawned and registered successfully
|
||
|
|
2026-07-07 13:45:33 | INFO | Multi-handler initialization complete. 1 model(s) spawned.
|
||
|
|
2026-07-07 15:22:19 | INFO | Shutting down multi-handler application
|
||
|
|
2026-07-07 15:22:19 | INFO | Cleaned up handler for model: mlx-community/Qwen2.5-Coder-7B-Instruct-4bit
|
||
|
|
2026-07-07 15:22:19 | INFO | All models unregistered and cleaned up
|