mirror of
https://github.com/danny-avila/LibreChat.git
synced 2025-12-17 08:50:15 +01:00
* feat: Code Interpreter API & File Search Agent Uploads chore: add back code files wip: first pass, abstract key dialog refactor: influence checkbox on key changes refactor: update localization keys for 'execute code' to 'run code' wip: run code button refactor: add throwError parameter to loadAuthValues and getUserPluginAuthValue functions feat: first pass, API tool calling fix: handle missing toolId in callTool function and return 404 for non-existent tools feat: show code outputs fix: improve error handling in callTool function and log errors fix: handle potential null value for filepath in attachment destructuring fix: normalize language before rendering and prevent null return fix: add loading indicator in RunCode component while executing code feat: add support for conditional code execution in Markdown components feat: attachments refactor: remove bash fix: pass abort signal to graph/run refactor: debounce and rate limit tool call refactor: increase debounce delay for execute function feat: set code output attachments feat: image attachments refactor: apply message context refactor: pass `partIndex` feat: toolCall schema/model/methods feat: block indexing feat: get tool calls chore: imports chore: typing chore: condense type imports feat: get tool calls fix: block indexing chore: typing refactor: update tool calls mapping to support multiple results fix: add unique key to nav link for rendering wip: first pass, tool call results refactor: update query cache from successful tool call mutation style: improve result switcher styling chore: note on using \`.toObject()\` feat: add agent_id field to conversation schema chore: typing refactor: rename agentMap to agentsMap for consistency feat: Agent Name as chat input placeholder chore: bump agents 📦 chore: update @langchain dependencies to latest versions to match agents package 📦 chore: update @librechat/agents dependency to version 1.8.0 fix: Aborting agent stream removes sender; fix(bedrock): completion removes preset name label refactor: remove direct file parameter to use req.file, add `processAgentFileUpload` for image uploads feat: upload menu feat: prime message_file resources feat: implement conversation access validation in chat route refactor: remove file parameter from processFileUpload and use req.file instead feat: add savedMessageIds set to track saved message IDs in BaseClient, to prevent unnecessary double-write to db feat: prevent duplicate message saves by checking savedMessageIds in AgentController refactor: skip legacy RAG API handling for agents feat: add files field to convoSchema refactor: update request type annotations from Express.Request to ServerRequest in file processing functions feat: track conversation files fix: resendFiles, addPreviousAttachments handling feat: add ID validation for session_id and file_id in download route feat: entity_id for code file uploads/downloads fix: code file edge cases feat: delete related tool calls feat: add stream rate handling for LLM configuration feat: enhance system content with attached file information fix: improve error logging in resource priming function * WIP: PoC, sequential agents WIP: PoC Sequential Agents, first pass content data + bump agents package fix: package-lock WIP: PoC, o1 support, refactor bufferString feat: convertJsonSchemaToZod fix: form issues and schema defining erroneous model fix: max length issue on agent form instructions, limit conversation messages to sequential agents feat: add abort signal support to createRun function and AgentClient feat: PoC, hide prior sequential agent steps fix: update parameter naming from config to metadata in event handlers for clarity, add model to usage data refactor: use only last contentData, track model for usage data chore: bump agents package fix: content parts issue refactor: filter contentParts to include tool calls and relevant indices feat: show function calls refactor: filter context messages to exclude tool calls when no tools are available to the agent fix: ensure tool call content is not undefined in formatMessages feat: add agent_id field to conversationPreset schema feat: hide sequential agents feat: increase upload toast duration to 10 seconds * refactor: tool context handling & update Code API Key Dialog feat: toolContextMap chore: skipSpecs -> useSpecs ci: fix handleTools tests feat: API Key Dialog * feat: Agent Permissions Admin Controls feat: replace label with button for prompt permission toggle feat: update agent permissions feat: enable experimental agents and streamline capability configuration feat: implement access control for agents and enhance endpoint menu items feat: add welcome message for agent selection in localization feat: add agents permission to access control and update version to 0.7.57 * fix: update types in useAssistantListMap and useMentions hooks for better null handling * feat: mention agents * fix: agent tool resource race conditions when deleting agent tool resource files * feat: add error handling for code execution with user feedback * refactor: rename AdminControls to AdminSettings for clarity * style: add gap to button in AdminSettings for improved layout * refactor: separate agent query hooks and check access to enable fetching * fix: remove unused provider from agent initialization options, creates issue with custom endpoints * refactor: remove redundant/deprecated modelOptions from AgentClient processes * chore: update @librechat/agents to version 1.8.5 in package.json and package-lock.json * fix: minor styling issues + agent panel uniformity * fix: agent edge cases when set endpoint is no longer defined * refactor: remove unused cleanup function call from AppService * fix: update link in ApiKeyDialog to point to pricing page * fix: improve type handling and layout calculations in SidePanel component * fix: add missing localization string for agent selection in SidePanel * chore: form styling and localizations for upload filesearch/code interpreter * fix: model selection placeholder logic in AgentConfig component * style: agent capabilities * fix: add localization for provider selection and improve dropdown styling in ModelPanel * refactor: use gpt-4o-mini > gpt-3.5-turbo * fix: agents configuration for loadDefaultInterface and update related tests * feat: DALLE Agents support
317 lines
10 KiB
JavaScript
317 lines
10 KiB
JavaScript
const { z } = require('zod');
|
|
const Message = require('./schema/messageSchema');
|
|
const { logger } = require('~/config');
|
|
|
|
const idSchema = z.string().uuid();
|
|
|
|
/**
|
|
* Saves a message in the database.
|
|
*
|
|
* @async
|
|
* @function saveMessage
|
|
* @param {Express.Request} req - The request object containing user information.
|
|
* @param {Object} params - The message data object.
|
|
* @param {string} params.endpoint - The endpoint where the message originated.
|
|
* @param {string} params.iconURL - The URL of the sender's icon.
|
|
* @param {string} params.messageId - The unique identifier for the message.
|
|
* @param {string} params.newMessageId - The new unique identifier for the message (if applicable).
|
|
* @param {string} params.conversationId - The identifier of the conversation.
|
|
* @param {string} [params.parentMessageId] - The identifier of the parent message, if any.
|
|
* @param {string} params.sender - The identifier of the sender.
|
|
* @param {string} params.text - The text content of the message.
|
|
* @param {boolean} params.isCreatedByUser - Indicates if the message was created by the user.
|
|
* @param {string} [params.error] - Any error associated with the message.
|
|
* @param {boolean} [params.unfinished] - Indicates if the message is unfinished.
|
|
* @param {Object[]} [params.files] - An array of files associated with the message.
|
|
* @param {boolean} [params.isEdited] - Indicates if the message was edited.
|
|
* @param {string} [params.finish_reason] - Reason for finishing the message.
|
|
* @param {number} [params.tokenCount] - The number of tokens in the message.
|
|
* @param {string} [params.plugin] - Plugin associated with the message.
|
|
* @param {string[]} [params.plugins] - An array of plugins associated with the message.
|
|
* @param {string} [params.model] - The model used to generate the message.
|
|
* @param {Object} [metadata] - Additional metadata for this operation
|
|
* @param {string} [metadata.context] - The context of the operation
|
|
* @returns {Promise<TMessage>} The updated or newly inserted message document.
|
|
* @throws {Error} If there is an error in saving the message.
|
|
*/
|
|
async function saveMessage(req, params, metadata) {
|
|
if (!req?.user?.id) {
|
|
throw new Error('User not authenticated');
|
|
}
|
|
|
|
const validConvoId = idSchema.safeParse(params.conversationId);
|
|
if (!validConvoId.success) {
|
|
logger.warn(`Invalid conversation ID: ${params.conversationId}`);
|
|
logger.info(`---\`saveMessage\` context: ${metadata?.context}`);
|
|
logger.info(`---Invalid conversation ID Params: ${JSON.stringify(params, null, 2)}`);
|
|
return;
|
|
}
|
|
|
|
try {
|
|
const update = {
|
|
...params,
|
|
user: req.user.id,
|
|
messageId: params.newMessageId || params.messageId,
|
|
};
|
|
const message = await Message.findOneAndUpdate(
|
|
{ messageId: params.messageId, user: req.user.id },
|
|
update,
|
|
{ upsert: true, new: true },
|
|
);
|
|
|
|
return message.toObject();
|
|
} catch (err) {
|
|
logger.error('Error saving message:', err);
|
|
logger.info(`---\`saveMessage\` context: ${metadata?.context}`);
|
|
throw err;
|
|
}
|
|
}
|
|
|
|
/**
|
|
* Saves multiple messages in the database in bulk.
|
|
*
|
|
* @async
|
|
* @function bulkSaveMessages
|
|
* @param {Object[]} messages - An array of message objects to save.
|
|
* @param {boolean} [overrideTimestamp=false] - Indicates whether to override the timestamps of the messages. Defaults to false.
|
|
* @returns {Promise<Object>} The result of the bulk write operation.
|
|
* @throws {Error} If there is an error in saving messages in bulk.
|
|
*/
|
|
async function bulkSaveMessages(messages, overrideTimestamp=false) {
|
|
try {
|
|
const bulkOps = messages.map((message) => ({
|
|
updateOne: {
|
|
filter: { messageId: message.messageId },
|
|
update: message,
|
|
timestamps: !overrideTimestamp,
|
|
upsert: true,
|
|
},
|
|
}));
|
|
|
|
const result = await Message.bulkWrite(bulkOps);
|
|
return result;
|
|
} catch (err) {
|
|
logger.error('Error saving messages in bulk:', err);
|
|
throw err;
|
|
}
|
|
}
|
|
|
|
/**
|
|
* Records a message in the database.
|
|
*
|
|
* @async
|
|
* @function recordMessage
|
|
* @param {Object} params - The message data object.
|
|
* @param {string} params.user - The identifier of the user.
|
|
* @param {string} params.endpoint - The endpoint where the message originated.
|
|
* @param {string} params.messageId - The unique identifier for the message.
|
|
* @param {string} params.conversationId - The identifier of the conversation.
|
|
* @param {string} [params.parentMessageId] - The identifier of the parent message, if any.
|
|
* @param {Partial<TMessage>} rest - Any additional properties from the TMessage typedef not explicitly listed.
|
|
* @returns {Promise<Object>} The updated or newly inserted message document.
|
|
* @throws {Error} If there is an error in saving the message.
|
|
*/
|
|
async function recordMessage({
|
|
user,
|
|
endpoint,
|
|
messageId,
|
|
conversationId,
|
|
parentMessageId,
|
|
...rest
|
|
}) {
|
|
try {
|
|
// No parsing of convoId as may use threadId
|
|
const message = {
|
|
user,
|
|
endpoint,
|
|
messageId,
|
|
conversationId,
|
|
parentMessageId,
|
|
...rest,
|
|
};
|
|
|
|
return await Message.findOneAndUpdate({ user, messageId }, message, {
|
|
upsert: true,
|
|
new: true,
|
|
});
|
|
} catch (err) {
|
|
logger.error('Error recording message:', err);
|
|
throw err;
|
|
}
|
|
}
|
|
|
|
/**
|
|
* Updates the text of a message.
|
|
*
|
|
* @async
|
|
* @function updateMessageText
|
|
* @param {Object} params - The update data object.
|
|
* @param {Object} req - The request object.
|
|
* @param {string} params.messageId - The unique identifier for the message.
|
|
* @param {string} params.text - The new text content of the message.
|
|
* @returns {Promise<void>}
|
|
* @throws {Error} If there is an error in updating the message text.
|
|
*/
|
|
async function updateMessageText(req, { messageId, text }) {
|
|
try {
|
|
await Message.updateOne({ messageId, user: req.user.id }, { text });
|
|
} catch (err) {
|
|
logger.error('Error updating message text:', err);
|
|
throw err;
|
|
}
|
|
}
|
|
|
|
/**
|
|
* Updates a message.
|
|
*
|
|
* @async
|
|
* @function updateMessage
|
|
* @param {Object} req - The request object.
|
|
* @param {Object} message - The message object containing update data.
|
|
* @param {string} message.messageId - The unique identifier for the message.
|
|
* @param {string} [message.text] - The new text content of the message.
|
|
* @param {Object[]} [message.files] - The files associated with the message.
|
|
* @param {boolean} [message.isCreatedByUser] - Indicates if the message was created by the user.
|
|
* @param {string} [message.sender] - The identifier of the sender.
|
|
* @param {number} [message.tokenCount] - The number of tokens in the message.
|
|
* @param {Object} [metadata] - The operation metadata
|
|
* @param {string} [metadata.context] - The operation metadata
|
|
* @returns {Promise<TMessage>} The updated message document.
|
|
* @throws {Error} If there is an error in updating the message or if the message is not found.
|
|
*/
|
|
async function updateMessage(req, message, metadata) {
|
|
try {
|
|
const { messageId, ...update } = message;
|
|
update.isEdited = true;
|
|
const updatedMessage = await Message.findOneAndUpdate(
|
|
{ messageId, user: req.user.id },
|
|
update,
|
|
{
|
|
new: true,
|
|
},
|
|
);
|
|
|
|
if (!updatedMessage) {
|
|
throw new Error('Message not found or user not authorized.');
|
|
}
|
|
|
|
return {
|
|
messageId: updatedMessage.messageId,
|
|
conversationId: updatedMessage.conversationId,
|
|
parentMessageId: updatedMessage.parentMessageId,
|
|
sender: updatedMessage.sender,
|
|
text: updatedMessage.text,
|
|
isCreatedByUser: updatedMessage.isCreatedByUser,
|
|
tokenCount: updatedMessage.tokenCount,
|
|
isEdited: true,
|
|
};
|
|
} catch (err) {
|
|
logger.error('Error updating message:', err);
|
|
if (metadata && metadata?.context) {
|
|
logger.info(`---\`updateMessage\` context: ${metadata.context}`);
|
|
}
|
|
throw err;
|
|
}
|
|
}
|
|
|
|
/**
|
|
* Deletes messages in a conversation since a specific message.
|
|
*
|
|
* @async
|
|
* @function deleteMessagesSince
|
|
* @param {Object} params - The parameters object.
|
|
* @param {Object} req - The request object.
|
|
* @param {string} params.messageId - The unique identifier for the message.
|
|
* @param {string} params.conversationId - The identifier of the conversation.
|
|
* @returns {Promise<Number>} The number of deleted messages.
|
|
* @throws {Error} If there is an error in deleting messages.
|
|
*/
|
|
async function deleteMessagesSince(req, { messageId, conversationId }) {
|
|
try {
|
|
const message = await Message.findOne({ messageId, user: req.user.id }).lean();
|
|
|
|
if (message) {
|
|
const query = Message.find({ conversationId, user: req.user.id });
|
|
return await query.deleteMany({
|
|
createdAt: { $gt: message.createdAt },
|
|
});
|
|
}
|
|
return undefined;
|
|
} catch (err) {
|
|
logger.error('Error deleting messages:', err);
|
|
throw err;
|
|
}
|
|
}
|
|
|
|
/**
|
|
* Retrieves messages from the database.
|
|
* @async
|
|
* @function getMessages
|
|
* @param {Record<string, unknown>} filter - The filter criteria.
|
|
* @param {string | undefined} [select] - The fields to select.
|
|
* @returns {Promise<TMessage[]>} The messages that match the filter criteria.
|
|
* @throws {Error} If there is an error in retrieving messages.
|
|
*/
|
|
async function getMessages(filter, select) {
|
|
try {
|
|
if (select) {
|
|
return await Message.find(filter).select(select).sort({ createdAt: 1 }).lean();
|
|
}
|
|
|
|
return await Message.find(filter).sort({ createdAt: 1 }).lean();
|
|
} catch (err) {
|
|
logger.error('Error getting messages:', err);
|
|
throw err;
|
|
}
|
|
}
|
|
|
|
/**
|
|
* Retrieves a single message from the database.
|
|
* @async
|
|
* @function getMessage
|
|
* @param {{ user: string, messageId: string }} params - The search parameters
|
|
* @returns {Promise<TMessage | null>} The message that matches the criteria or null if not found
|
|
* @throws {Error} If there is an error in retrieving the message
|
|
*/
|
|
async function getMessage({ user, messageId }) {
|
|
try {
|
|
return await Message.findOne({
|
|
user,
|
|
messageId,
|
|
}).lean();
|
|
} catch (err) {
|
|
logger.error('Error getting message:', err);
|
|
throw err;
|
|
}
|
|
}
|
|
|
|
/**
|
|
* Deletes messages from the database.
|
|
*
|
|
* @async
|
|
* @function deleteMessages
|
|
* @param {Object} filter - The filter criteria to find messages to delete.
|
|
* @returns {Promise<Object>} The metadata with count of deleted messages.
|
|
* @throws {Error} If there is an error in deleting messages.
|
|
*/
|
|
async function deleteMessages(filter) {
|
|
try {
|
|
return await Message.deleteMany(filter);
|
|
} catch (err) {
|
|
logger.error('Error deleting messages:', err);
|
|
throw err;
|
|
}
|
|
}
|
|
|
|
module.exports = {
|
|
Message,
|
|
saveMessage,
|
|
bulkSaveMessages,
|
|
recordMessage,
|
|
updateMessageText,
|
|
updateMessage,
|
|
deleteMessagesSince,
|
|
getMessages,
|
|
getMessage,
|
|
deleteMessages,
|
|
};
|