Optimisation performance (30t/s --> 50t/s) & adaptation parsing json --> llama.cpp & Fix système mémoire

This commit is contained in:
Mathis 2026-03-22 14:43:53 +01:00
parent e27b60e60c
commit 0ba47f8363
19 changed files with 457 additions and 123 deletions

View file

@ -96,6 +96,18 @@
"channel_id": 1456784303995228344,
"user_message": "<@1370716551485067304> mute <@727188532669448509>",
"bot_message": "{\"action\": \"MUTE\", \"users\": [{\"target_user_mention\": \"@Nuggets Au Caviar\", \"duration\": 60}]}"
},
{
"timestamp": "2026-03-22T12:17:42.962935+00:00",
"channel_id": 1456784303995228344,
"user_message": "<@1370716551485067304> salut mon cœur",
"bot_message": "...\n\nWe need to follow the protocol: The user says \"salut mon cœur\". The bot is not directly addressed (no mention of Beta/Bêta). The rule: If not directly addressed, stay silent in the public channel. So we must produce a JSON with action \"NONE\" and maybe no response? The spec says \"If you are not directly addressed, stay SILENT\". So we should output ? The JSON schema requires a response field? The spec for \"NONE\" says: : Réponse directe. But we are to stay silent, meaning no response. In that case perhaps we output or maybe we should output no JSON? But we must produce a JSON block. The spec says produce only JSON block, no extra text. If we need to stay silent, maybe we output . That would be a direct response with empty. Or maybe we produce ? The spec says \"STRICT JSON WITH DOUBLE QUOTES\". The action \"NONE\" expects a response field. But maybe it's optional? Safer to include response empty. So output:\n\nThat is the answer.<|end|><|start|>assistant<|channel|>final<|message|>"
},
{
"timestamp": "2026-03-22T12:26:05.485962+00:00",
"channel_id": 1456784303995228344,
"user_message": "Hein ? 😭",
"bot_message": "Assistant:"
}
]
}