Andreas/LibreChat
1
0
Fork 0
mirror of https://github.com/danny-avila/LibreChat.git synced 2025-12-23 20:00:15 +01:00
Code Issues Projects Releases Packages Wiki Activity Actions

chore(.gitignore): add client/public/images/ to ignore list (#417)

Browse source 
refactor(chatgpt-client.js): free encoder memory after use
feat(chatgpt-client.tokens.js): add script to test memory usage of ChatGPTClient
This commit is contained in:
Danny Avila 2023-06-02 00:08:19 -04:00 • committed by GitHub
parent 4705975e59
commit 7fbf27c5aa
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
3 changed files with 91 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

1
api/app/clients/chatgpt-client.js
View file

@ -81,6 +81,7 @@ const askClient = async ({
try {
usage.completion_tokens = (enc.encode(res.response)).length;
enc.free();
usage.total_tokens = usage.prompt_tokens + usage.completion_tokens;
res.usage = usage;
} catch (e) {