mirror of
https://github.com/danny-avila/LibreChat.git
synced 2025-12-17 17:00:15 +01:00
* agents - phase 1 (#30) * chore: copy assistant files * feat: frontend and data-provider * feat: backend get endpoint test * fix(MessageEndpointIcon): switched to AgentName and AgentAvatar * fix: small fixes * fix: agent endpoint config * fix: show Agent Builder * chore: install agentus * chore: initial scaffolding for agents * fix: updated Assistant logic to Agent Logic for some Agent components * WIP first pass, demo of agent package * WIP: initial backend infra for agents * fix: agent list error * wip: agents routing * chore: Refactor useSSE hook to handle different data events * wip: correctly emit events * chore: Update @librechat/agentus npm dependency to version 1.0.9 * remove comment * first pass: streaming agent text * chore: Remove @librechat/agentus root-level workspace npm dependency * feat: Agent Schema and Model * fix: content handling fixes * fix: content message save * WIP: new content data * fix: run step issue with tool calls * chore: Update @librechat/agentus npm dependency to version 1.1.5 * feat: update controller and agent routes * wip: initial backend tool and tool error handling support * wip: tool chunks * chore: Update @librechat/agentus npm dependency to version 1.1.7 * chore: update tool_call typing, add test conditions and logs * fix: create agent * fix: create agent * first pass: render completed content parts * fix: remove logging, fix step handler typing * chore: Update @librechat/agentus npm dependency to version 1.1.9 * refactor: cleanup maps on unmount * chore: Update BaseClient.js to safely count tokens for string, number, and boolean values * fix: support subsequent messages with tool_calls * chore: export order * fix: select agent * fix: tool call types and handling * chore: switch to anthropic for testing * fix: AgentSelect * refactor: experimental: OpenAIClient to use array for intermediateReply * fix(useSSE): revert old condition for streaming legacy client tokens * fix: lint * revert `agent_id` to `id` * chore: update localization keys for agent-related components * feat: zod schema handling for actions * refactor(actions): if no params, no zodSchema * chore: Update @librechat/agentus npm dependency to version 1.2.1 * feat: first pass, actions * refactor: empty schema for actions without params * feat: Update createRun function to accept additional options * fix: message payload formatting; feat: add more client options * fix: ToolCall component rendering when action has no args but has output * refactor(ToolCall): allow non-stringy args * WIP: first pass, correctly formatted tool_calls between providers * refactor: Remove duplicate import of 'roles' module * refactor: Exclude 'vite.config.ts' from TypeScript compilation * refactor: fix agent related types > - no need to use endpoint/model fields for identifying agent metadata > - add `provider` distinction for agent-configured 'endpoint' - no need for agent-endpoint map - reduce complexity of tools as functions into tools as string[] - fix types related to above changes - reduce unnecessary variables for queries/mutations and corresponding react-query keys * refactor: Add tools and tool_kwargs fields to agent schema * refactor: Remove unused code and update dependencies * refactor: Update updateAgentHandler to use req.body directly * refactor: Update AgentSelect component to use localized hooks * refactor: Update agent schema to include tools and provider fields * refactor(AgentPanel): add scrollbar gutter, add provider field to form, fix agent schema required values * refactor: Update AgentSwitcher component to use selectedAgentId instead of selectedAgent * refactor: Update AgentPanel component to include alternateName import and defaultAgentFormValues * refactor(SelectDropDown): allow setting value as option while still supporting legacy usage (string values only) * refactor: SelectDropdown changes - Only necessary when the available values are objects with label/value fields and the selected value is expected to be a string. * refactor: TypeError issues and handle provider as option * feat: Add placeholder for provider selection in AgentPanel component * refactor: Update agent schema to include author and provider fields * fix: show expected 'create agent' placeholder when creating agent * chore: fix localization strings, hide capabilities form for now * chore: typing * refactor: import order and use compact agents schema for now * chore: typing * refactor: Update AgentForm type to use AgentCapabilities * fix agent form agent selection issues * feat: responsive agent selection * fix: Handle cancelled fetch in useSelectAgent hook * fix: reset agent form on accordion close/open * feat: Add agent_id to default conversation for agents endpoint * feat: agents endpoint request handling * refactor: reset conversation model on agent select * refactor: add `additional_instructions` to conversation schema, organize other fields * chore: casing * chore: types * refactor(loadAgentTools): explicitly pass agent_id, do not pass `model` to loadAgentTools for now, load action sets by agent_id * WIP: initial draft of real agent client initialization * WIP: first pass, anthropic agent requests * feat: remember last selected agent * feat: openai and azure connected * fix: prioritize agent model for runs unless an explicit override model is passed from client * feat: Agent Actions * fix: save agent id to convo * feat: model panel (#29) * feat: model panel * bring back comments * fix: method still null * fix: AgentPanel FormContext * feat: add more parameters * fix: style issues; refactor: Agent Controller * fix: cherry-pick * fix: Update AgentAvatar component to use AssistantIcon instead of BrainCircuit * feat: OGDialog for delete agent; feat(assistant): update Agent types, introduced `model_parameters` * feat: icon and general `model_parameters` update * feat: use react-hook-form better * fix: agent builder form reset issue when switching panels * refactor: modularize agent builder form --------- Co-authored-by: Danny Avila <danny@librechat.ai> * fix: AgentPanel and ModelPanel type issues and use `useFormContext` and `watch` instead of `methods` directly and `useWatch`. * fix: tool call issues due to invalid input (anthropic) of empty string * fix: handle empty text in Part component --------- Co-authored-by: Marco Beretta <81851188+berry-13@users.noreply.github.com> * refactor: remove form ModelPanel and fixed nested ternary expressions in AgentConfig * fix: Model Parameters not saved correctly * refactor: remove console log * feat: avatar upload and get for Agents (#36) Co-authored-by: Marco Beretta <81851188+berry-13@users.noreply.github.com> * chore: update to public package * fix: typing, optional chaining * fix: cursor not showing for content parts * chore: conditionally enable agents * ci: fix azure test * ci: fix frontend tests, fix eslint api * refactor: Remove unused errorContentPart variable * continue of the agent message PR (#40) * last fixes * fix: agentMap * pr merge test (#41) * fix: model icon not fetching correctly * remove console logs * feat: agent name * refactor: pass documentsMap as a prop to allow re-render of assistant form * refactor: pass documentsMap as a prop to allow re-render of assistant form * chore: Bump version to 0.7.419 * fix: TypeError: Cannot read properties of undefined (reading 'id') * refactor: update AgentSwitcher component to use ControlCombobox instead of Combobox --------- Co-authored-by: Marco Beretta <81851188+berry-13@users.noreply.github.com>
294 lines
9.7 KiB
JavaScript
294 lines
9.7 KiB
JavaScript
const { z } = require('zod');
|
|
const Message = require('./schema/messageSchema');
|
|
const { logger } = require('~/config');
|
|
|
|
const idSchema = z.string().uuid();
|
|
|
|
/**
|
|
* Saves a message in the database.
|
|
*
|
|
* @async
|
|
* @function saveMessage
|
|
* @param {Express.Request} req - The request object containing user information.
|
|
* @param {Object} params - The message data object.
|
|
* @param {string} params.endpoint - The endpoint where the message originated.
|
|
* @param {string} params.iconURL - The URL of the sender's icon.
|
|
* @param {string} params.messageId - The unique identifier for the message.
|
|
* @param {string} params.newMessageId - The new unique identifier for the message (if applicable).
|
|
* @param {string} params.conversationId - The identifier of the conversation.
|
|
* @param {string} [params.parentMessageId] - The identifier of the parent message, if any.
|
|
* @param {string} params.sender - The identifier of the sender.
|
|
* @param {string} params.text - The text content of the message.
|
|
* @param {boolean} params.isCreatedByUser - Indicates if the message was created by the user.
|
|
* @param {string} [params.error] - Any error associated with the message.
|
|
* @param {boolean} [params.unfinished] - Indicates if the message is unfinished.
|
|
* @param {Object[]} [params.files] - An array of files associated with the message.
|
|
* @param {boolean} [params.isEdited] - Indicates if the message was edited.
|
|
* @param {string} [params.finish_reason] - Reason for finishing the message.
|
|
* @param {number} [params.tokenCount] - The number of tokens in the message.
|
|
* @param {string} [params.plugin] - Plugin associated with the message.
|
|
* @param {string[]} [params.plugins] - An array of plugins associated with the message.
|
|
* @param {string} [params.model] - The model used to generate the message.
|
|
* @param {Object} [metadata] - Additional metadata for this operation
|
|
* @param {string} [metadata.context] - The context of the operation
|
|
* @returns {Promise<TMessage>} The updated or newly inserted message document.
|
|
* @throws {Error} If there is an error in saving the message.
|
|
*/
|
|
async function saveMessage(req, params, metadata) {
|
|
if (!req?.user?.id) {
|
|
throw new Error('User not authenticated');
|
|
}
|
|
|
|
const validConvoId = idSchema.safeParse(params.conversationId);
|
|
if (!validConvoId.success) {
|
|
logger.warn(`Invalid conversation ID: ${params.conversationId}`);
|
|
logger.info(`---\`saveMessage\` context: ${metadata?.context}`);
|
|
logger.info(`---Invalid conversation ID Params: ${JSON.stringify(params, null, 2)}`);
|
|
return;
|
|
}
|
|
|
|
try {
|
|
const update = {
|
|
...params,
|
|
user: req.user.id,
|
|
messageId: params.newMessageId || params.messageId,
|
|
};
|
|
const message = await Message.findOneAndUpdate(
|
|
{ messageId: params.messageId, user: req.user.id },
|
|
update,
|
|
{ upsert: true, new: true },
|
|
);
|
|
|
|
return message.toObject();
|
|
} catch (err) {
|
|
logger.error('Error saving message:', err);
|
|
logger.info(`---\`saveMessage\` context: ${metadata?.context}`);
|
|
throw err;
|
|
}
|
|
}
|
|
|
|
/**
|
|
* Saves multiple messages in the database in bulk.
|
|
*
|
|
* @async
|
|
* @function bulkSaveMessages
|
|
* @param {Object[]} messages - An array of message objects to save.
|
|
* @returns {Promise<Object>} The result of the bulk write operation.
|
|
* @throws {Error} If there is an error in saving messages in bulk.
|
|
*/
|
|
async function bulkSaveMessages(messages) {
|
|
try {
|
|
const bulkOps = messages.map((message) => ({
|
|
updateOne: {
|
|
filter: { messageId: message.messageId },
|
|
update: message,
|
|
upsert: true,
|
|
},
|
|
}));
|
|
|
|
const result = await Message.bulkWrite(bulkOps);
|
|
return result;
|
|
} catch (err) {
|
|
logger.error('Error saving messages in bulk:', err);
|
|
throw err;
|
|
}
|
|
}
|
|
|
|
/**
|
|
* Records a message in the database.
|
|
*
|
|
* @async
|
|
* @function recordMessage
|
|
* @param {Object} params - The message data object.
|
|
* @param {string} params.user - The identifier of the user.
|
|
* @param {string} params.endpoint - The endpoint where the message originated.
|
|
* @param {string} params.messageId - The unique identifier for the message.
|
|
* @param {string} params.conversationId - The identifier of the conversation.
|
|
* @param {string} [params.parentMessageId] - The identifier of the parent message, if any.
|
|
* @param {Partial<TMessage>} rest - Any additional properties from the TMessage typedef not explicitly listed.
|
|
* @returns {Promise<Object>} The updated or newly inserted message document.
|
|
* @throws {Error} If there is an error in saving the message.
|
|
*/
|
|
async function recordMessage({
|
|
user,
|
|
endpoint,
|
|
messageId,
|
|
conversationId,
|
|
parentMessageId,
|
|
...rest
|
|
}) {
|
|
try {
|
|
// No parsing of convoId as may use threadId
|
|
const message = {
|
|
user,
|
|
endpoint,
|
|
messageId,
|
|
conversationId,
|
|
parentMessageId,
|
|
...rest,
|
|
};
|
|
|
|
return await Message.findOneAndUpdate({ user, messageId }, message, {
|
|
upsert: true,
|
|
new: true,
|
|
});
|
|
} catch (err) {
|
|
logger.error('Error recording message:', err);
|
|
throw err;
|
|
}
|
|
}
|
|
|
|
/**
|
|
* Updates the text of a message.
|
|
*
|
|
* @async
|
|
* @function updateMessageText
|
|
* @param {Object} params - The update data object.
|
|
* @param {Object} req - The request object.
|
|
* @param {string} params.messageId - The unique identifier for the message.
|
|
* @param {string} params.text - The new text content of the message.
|
|
* @returns {Promise<void>}
|
|
* @throws {Error} If there is an error in updating the message text.
|
|
*/
|
|
async function updateMessageText(req, { messageId, text }) {
|
|
try {
|
|
await Message.updateOne({ messageId, user: req.user.id }, { text });
|
|
} catch (err) {
|
|
logger.error('Error updating message text:', err);
|
|
throw err;
|
|
}
|
|
}
|
|
|
|
/**
|
|
* Updates a message.
|
|
*
|
|
* @async
|
|
* @function updateMessage
|
|
* @param {Object} req - The request object.
|
|
* @param {Object} message - The message object containing update data.
|
|
* @param {string} message.messageId - The unique identifier for the message.
|
|
* @param {string} [message.text] - The new text content of the message.
|
|
* @param {Object[]} [message.files] - The files associated with the message.
|
|
* @param {boolean} [message.isCreatedByUser] - Indicates if the message was created by the user.
|
|
* @param {string} [message.sender] - The identifier of the sender.
|
|
* @param {number} [message.tokenCount] - The number of tokens in the message.
|
|
* @param {Object} [metadata] - The operation metadata
|
|
* @param {string} [metadata.context] - The operation metadata
|
|
* @returns {Promise<TMessage>} The updated message document.
|
|
* @throws {Error} If there is an error in updating the message or if the message is not found.
|
|
*/
|
|
async function updateMessage(req, message, metadata) {
|
|
try {
|
|
const { messageId, ...update } = message;
|
|
update.isEdited = true;
|
|
const updatedMessage = await Message.findOneAndUpdate(
|
|
{ messageId, user: req.user.id },
|
|
update,
|
|
{
|
|
new: true,
|
|
},
|
|
);
|
|
|
|
if (!updatedMessage) {
|
|
throw new Error('Message not found or user not authorized.');
|
|
}
|
|
|
|
return {
|
|
messageId: updatedMessage.messageId,
|
|
conversationId: updatedMessage.conversationId,
|
|
parentMessageId: updatedMessage.parentMessageId,
|
|
sender: updatedMessage.sender,
|
|
text: updatedMessage.text,
|
|
isCreatedByUser: updatedMessage.isCreatedByUser,
|
|
tokenCount: updatedMessage.tokenCount,
|
|
isEdited: true,
|
|
};
|
|
} catch (err) {
|
|
logger.error('Error updating message:', err);
|
|
if (metadata && metadata?.context) {
|
|
logger.info(`---\`updateMessage\` context: ${metadata.context}`);
|
|
}
|
|
throw err;
|
|
}
|
|
}
|
|
|
|
/**
|
|
* Deletes messages in a conversation since a specific message.
|
|
*
|
|
* @async
|
|
* @function deleteMessagesSince
|
|
* @param {Object} params - The parameters object.
|
|
* @param {Object} req - The request object.
|
|
* @param {string} params.messageId - The unique identifier for the message.
|
|
* @param {string} params.conversationId - The identifier of the conversation.
|
|
* @returns {Promise<Number>} The number of deleted messages.
|
|
* @throws {Error} If there is an error in deleting messages.
|
|
*/
|
|
async function deleteMessagesSince(req, { messageId, conversationId }) {
|
|
try {
|
|
const message = await Message.findOne({ messageId, user: req.user.id }).lean();
|
|
|
|
if (message) {
|
|
const query = Message.find({ conversationId, user: req.user.id });
|
|
return await query.deleteMany({
|
|
createdAt: { $gt: message.createdAt },
|
|
});
|
|
}
|
|
return undefined;
|
|
} catch (err) {
|
|
logger.error('Error deleting messages:', err);
|
|
throw err;
|
|
}
|
|
}
|
|
|
|
/**
|
|
* Retrieves messages from the database.
|
|
* @async
|
|
* @function getMessages
|
|
* @param {Record<string, unknown>} filter - The filter criteria.
|
|
* @param {string | undefined} [select] - The fields to select.
|
|
* @returns {Promise<TMessage[]>} The messages that match the filter criteria.
|
|
* @throws {Error} If there is an error in retrieving messages.
|
|
*/
|
|
async function getMessages(filter, select) {
|
|
try {
|
|
if (select) {
|
|
return await Message.find(filter).select(select).sort({ createdAt: 1 }).lean();
|
|
}
|
|
|
|
return await Message.find(filter).sort({ createdAt: 1 }).lean();
|
|
} catch (err) {
|
|
logger.error('Error getting messages:', err);
|
|
throw err;
|
|
}
|
|
}
|
|
|
|
/**
|
|
* Deletes messages from the database.
|
|
*
|
|
* @async
|
|
* @function deleteMessages
|
|
* @param {Object} filter - The filter criteria to find messages to delete.
|
|
* @returns {Promise<Object>} The metadata with count of deleted messages.
|
|
* @throws {Error} If there is an error in deleting messages.
|
|
*/
|
|
async function deleteMessages(filter) {
|
|
try {
|
|
return await Message.deleteMany(filter);
|
|
} catch (err) {
|
|
logger.error('Error deleting messages:', err);
|
|
throw err;
|
|
}
|
|
}
|
|
|
|
module.exports = {
|
|
Message,
|
|
saveMessage,
|
|
bulkSaveMessages,
|
|
recordMessage,
|
|
updateMessageText,
|
|
updateMessage,
|
|
deleteMessagesSince,
|
|
getMessages,
|
|
deleteMessages,
|
|
};
|