Tag: Mistral AI deployment

Configure your model in code/serving.properties: To deploy Voxtral-Mini, use the following code: option.model_id=mistralai/Voxtral-Mini-3B-2507 option.tensor_parallel_degree=1 To deploy Voxtral-Small, use the following code: option.model_id=mistralai/Voxtral-Small-24B-2507 option.tensor_parallel_degree=4 Open…