mirror of
https://github.com/danny-avila/LibreChat.git
synced 2025-12-17 08:50:15 +01:00
* feat: Code Interpreter API & File Search Agent Uploads chore: add back code files wip: first pass, abstract key dialog refactor: influence checkbox on key changes refactor: update localization keys for 'execute code' to 'run code' wip: run code button refactor: add throwError parameter to loadAuthValues and getUserPluginAuthValue functions feat: first pass, API tool calling fix: handle missing toolId in callTool function and return 404 for non-existent tools feat: show code outputs fix: improve error handling in callTool function and log errors fix: handle potential null value for filepath in attachment destructuring fix: normalize language before rendering and prevent null return fix: add loading indicator in RunCode component while executing code feat: add support for conditional code execution in Markdown components feat: attachments refactor: remove bash fix: pass abort signal to graph/run refactor: debounce and rate limit tool call refactor: increase debounce delay for execute function feat: set code output attachments feat: image attachments refactor: apply message context refactor: pass `partIndex` feat: toolCall schema/model/methods feat: block indexing feat: get tool calls chore: imports chore: typing chore: condense type imports feat: get tool calls fix: block indexing chore: typing refactor: update tool calls mapping to support multiple results fix: add unique key to nav link for rendering wip: first pass, tool call results refactor: update query cache from successful tool call mutation style: improve result switcher styling chore: note on using \`.toObject()\` feat: add agent_id field to conversation schema chore: typing refactor: rename agentMap to agentsMap for consistency feat: Agent Name as chat input placeholder chore: bump agents 📦 chore: update @langchain dependencies to latest versions to match agents package 📦 chore: update @librechat/agents dependency to version 1.8.0 fix: Aborting agent stream removes sender; fix(bedrock): completion removes preset name label refactor: remove direct file parameter to use req.file, add `processAgentFileUpload` for image uploads feat: upload menu feat: prime message_file resources feat: implement conversation access validation in chat route refactor: remove file parameter from processFileUpload and use req.file instead feat: add savedMessageIds set to track saved message IDs in BaseClient, to prevent unnecessary double-write to db feat: prevent duplicate message saves by checking savedMessageIds in AgentController refactor: skip legacy RAG API handling for agents feat: add files field to convoSchema refactor: update request type annotations from Express.Request to ServerRequest in file processing functions feat: track conversation files fix: resendFiles, addPreviousAttachments handling feat: add ID validation for session_id and file_id in download route feat: entity_id for code file uploads/downloads fix: code file edge cases feat: delete related tool calls feat: add stream rate handling for LLM configuration feat: enhance system content with attached file information fix: improve error logging in resource priming function * WIP: PoC, sequential agents WIP: PoC Sequential Agents, first pass content data + bump agents package fix: package-lock WIP: PoC, o1 support, refactor bufferString feat: convertJsonSchemaToZod fix: form issues and schema defining erroneous model fix: max length issue on agent form instructions, limit conversation messages to sequential agents feat: add abort signal support to createRun function and AgentClient feat: PoC, hide prior sequential agent steps fix: update parameter naming from config to metadata in event handlers for clarity, add model to usage data refactor: use only last contentData, track model for usage data chore: bump agents package fix: content parts issue refactor: filter contentParts to include tool calls and relevant indices feat: show function calls refactor: filter context messages to exclude tool calls when no tools are available to the agent fix: ensure tool call content is not undefined in formatMessages feat: add agent_id field to conversationPreset schema feat: hide sequential agents feat: increase upload toast duration to 10 seconds * refactor: tool context handling & update Code API Key Dialog feat: toolContextMap chore: skipSpecs -> useSpecs ci: fix handleTools tests feat: API Key Dialog * feat: Agent Permissions Admin Controls feat: replace label with button for prompt permission toggle feat: update agent permissions feat: enable experimental agents and streamline capability configuration feat: implement access control for agents and enhance endpoint menu items feat: add welcome message for agent selection in localization feat: add agents permission to access control and update version to 0.7.57 * fix: update types in useAssistantListMap and useMentions hooks for better null handling * feat: mention agents * fix: agent tool resource race conditions when deleting agent tool resource files * feat: add error handling for code execution with user feedback * refactor: rename AdminControls to AdminSettings for clarity * style: add gap to button in AdminSettings for improved layout * refactor: separate agent query hooks and check access to enable fetching * fix: remove unused provider from agent initialization options, creates issue with custom endpoints * refactor: remove redundant/deprecated modelOptions from AgentClient processes * chore: update @librechat/agents to version 1.8.5 in package.json and package-lock.json * fix: minor styling issues + agent panel uniformity * fix: agent edge cases when set endpoint is no longer defined * refactor: remove unused cleanup function call from AppService * fix: update link in ApiKeyDialog to point to pricing page * fix: improve type handling and layout calculations in SidePanel component * fix: add missing localization string for agent selection in SidePanel * chore: form styling and localizations for upload filesearch/code interpreter * fix: model selection placeholder logic in AgentConfig component * style: agent capabilities * fix: add localization for provider selection and improve dropdown styling in ModelPanel * refactor: use gpt-4o-mini > gpt-3.5-turbo * fix: agents configuration for loadDefaultInterface and update related tests * feat: DALLE Agents support
247 lines
8.6 KiB
JavaScript
247 lines
8.6 KiB
JavaScript
const Conversation = require('./schema/convoSchema');
|
|
const { getMessages, deleteMessages } = require('./Message');
|
|
const logger = require('~/config/winston');
|
|
|
|
/**
|
|
* Searches for a conversation by conversationId and returns a lean document with only conversationId and user.
|
|
* @param {string} conversationId - The conversation's ID.
|
|
* @returns {Promise<{conversationId: string, user: string} | null>} The conversation object with selected fields or null if not found.
|
|
*/
|
|
const searchConversation = async (conversationId) => {
|
|
try {
|
|
return await Conversation.findOne({ conversationId }, 'conversationId user').lean();
|
|
} catch (error) {
|
|
logger.error('[searchConversation] Error searching conversation', error);
|
|
throw new Error('Error searching conversation');
|
|
}
|
|
};
|
|
/**
|
|
* Searches for a conversation by conversationId and returns associated file ids.
|
|
* @param {string} conversationId - The conversation's ID.
|
|
* @returns {Promise<string[] | null>}
|
|
*/
|
|
const getConvoFiles = async (conversationId) => {
|
|
try {
|
|
return (await Conversation.findOne({ conversationId }, 'files').lean())?.files ?? [];
|
|
} catch (error) {
|
|
logger.error('[getConvoFiles] Error getting conversation files', error);
|
|
throw new Error('Error getting conversation files');
|
|
}
|
|
};
|
|
|
|
/**
|
|
* Retrieves a single conversation for a given user and conversation ID.
|
|
* @param {string} user - The user's ID.
|
|
* @param {string} conversationId - The conversation's ID.
|
|
* @returns {Promise<TConversation>} The conversation object.
|
|
*/
|
|
const getConvo = async (user, conversationId) => {
|
|
try {
|
|
return await Conversation.findOne({ user, conversationId }).lean();
|
|
} catch (error) {
|
|
logger.error('[getConvo] Error getting single conversation', error);
|
|
return { message: 'Error getting single conversation' };
|
|
}
|
|
};
|
|
|
|
const deleteNullOrEmptyConversations = async () => {
|
|
try {
|
|
const filter = {
|
|
$or: [
|
|
{ conversationId: null },
|
|
{ conversationId: '' },
|
|
{ conversationId: { $exists: false } },
|
|
],
|
|
};
|
|
|
|
const result = await Conversation.deleteMany(filter);
|
|
|
|
// Delete associated messages
|
|
const messageDeleteResult = await deleteMessages(filter);
|
|
|
|
logger.info(
|
|
`[deleteNullOrEmptyConversations] Deleted ${result.deletedCount} conversations and ${messageDeleteResult.deletedCount} messages`,
|
|
);
|
|
|
|
return {
|
|
conversations: result,
|
|
messages: messageDeleteResult,
|
|
};
|
|
} catch (error) {
|
|
logger.error('[deleteNullOrEmptyConversations] Error deleting conversations', error);
|
|
throw new Error('Error deleting conversations with null or empty conversationId');
|
|
}
|
|
};
|
|
|
|
module.exports = {
|
|
Conversation,
|
|
getConvoFiles,
|
|
searchConversation,
|
|
deleteNullOrEmptyConversations,
|
|
/**
|
|
* Saves a conversation to the database.
|
|
* @param {Object} req - The request object.
|
|
* @param {string} conversationId - The conversation's ID.
|
|
* @param {Object} metadata - Additional metadata to log for operation.
|
|
* @returns {Promise<TConversation>} The conversation object.
|
|
*/
|
|
saveConvo: async (req, { conversationId, newConversationId, ...convo }, metadata) => {
|
|
try {
|
|
if (metadata && metadata?.context) {
|
|
logger.debug(`[saveConvo] ${metadata.context}`);
|
|
}
|
|
const messages = await getMessages({ conversationId }, '_id');
|
|
const update = { ...convo, messages, user: req.user.id };
|
|
if (newConversationId) {
|
|
update.conversationId = newConversationId;
|
|
}
|
|
|
|
/** Note: the resulting Model object is necessary for Meilisearch operations */
|
|
const conversation = await Conversation.findOneAndUpdate(
|
|
{ conversationId, user: req.user.id },
|
|
update,
|
|
{
|
|
new: true,
|
|
upsert: true,
|
|
},
|
|
);
|
|
|
|
return conversation.toObject();
|
|
} catch (error) {
|
|
logger.error('[saveConvo] Error saving conversation', error);
|
|
if (metadata && metadata?.context) {
|
|
logger.info(`[saveConvo] ${metadata.context}`);
|
|
}
|
|
return { message: 'Error saving conversation' };
|
|
}
|
|
},
|
|
bulkSaveConvos: async (conversations) => {
|
|
try {
|
|
const bulkOps = conversations.map((convo) => ({
|
|
updateOne: {
|
|
filter: { conversationId: convo.conversationId, user: convo.user },
|
|
update: convo,
|
|
upsert: true,
|
|
timestamps: false,
|
|
},
|
|
}));
|
|
|
|
const result = await Conversation.bulkWrite(bulkOps);
|
|
return result;
|
|
} catch (error) {
|
|
logger.error('[saveBulkConversations] Error saving conversations in bulk', error);
|
|
throw new Error('Failed to save conversations in bulk.');
|
|
}
|
|
},
|
|
getConvosByPage: async (user, pageNumber = 1, pageSize = 25, isArchived = false, tags) => {
|
|
const query = { user };
|
|
if (isArchived) {
|
|
query.isArchived = true;
|
|
} else {
|
|
query.$or = [{ isArchived: false }, { isArchived: { $exists: false } }];
|
|
}
|
|
if (Array.isArray(tags) && tags.length > 0) {
|
|
query.tags = { $in: tags };
|
|
}
|
|
try {
|
|
const totalConvos = (await Conversation.countDocuments(query)) || 1;
|
|
const totalPages = Math.ceil(totalConvos / pageSize);
|
|
const convos = await Conversation.find(query)
|
|
.sort({ updatedAt: -1 })
|
|
.skip((pageNumber - 1) * pageSize)
|
|
.limit(pageSize)
|
|
.lean();
|
|
return { conversations: convos, pages: totalPages, pageNumber, pageSize };
|
|
} catch (error) {
|
|
logger.error('[getConvosByPage] Error getting conversations', error);
|
|
return { message: 'Error getting conversations' };
|
|
}
|
|
},
|
|
getConvosQueried: async (user, convoIds, pageNumber = 1, pageSize = 25) => {
|
|
try {
|
|
if (!convoIds || convoIds.length === 0) {
|
|
return { conversations: [], pages: 1, pageNumber, pageSize };
|
|
}
|
|
|
|
const cache = {};
|
|
const convoMap = {};
|
|
const promises = [];
|
|
|
|
convoIds.forEach((convo) =>
|
|
promises.push(
|
|
Conversation.findOne({
|
|
user,
|
|
conversationId: convo.conversationId,
|
|
}).lean(),
|
|
),
|
|
);
|
|
|
|
const results = (await Promise.all(promises)).filter(Boolean);
|
|
|
|
results.forEach((convo, i) => {
|
|
const page = Math.floor(i / pageSize) + 1;
|
|
if (!cache[page]) {
|
|
cache[page] = [];
|
|
}
|
|
cache[page].push(convo);
|
|
convoMap[convo.conversationId] = convo;
|
|
});
|
|
|
|
const totalPages = Math.ceil(results.length / pageSize);
|
|
cache.pages = totalPages;
|
|
cache.pageSize = pageSize;
|
|
return {
|
|
cache,
|
|
conversations: cache[pageNumber] || [],
|
|
pages: totalPages || 1,
|
|
pageNumber,
|
|
pageSize,
|
|
convoMap,
|
|
};
|
|
} catch (error) {
|
|
logger.error('[getConvosQueried] Error getting conversations', error);
|
|
return { message: 'Error fetching conversations' };
|
|
}
|
|
},
|
|
getConvo,
|
|
/* chore: this method is not properly error handled */
|
|
getConvoTitle: async (user, conversationId) => {
|
|
try {
|
|
const convo = await getConvo(user, conversationId);
|
|
/* ChatGPT Browser was triggering error here due to convo being saved later */
|
|
if (convo && !convo.title) {
|
|
return null;
|
|
} else {
|
|
// TypeError: Cannot read properties of null (reading 'title')
|
|
return convo?.title || 'New Chat';
|
|
}
|
|
} catch (error) {
|
|
logger.error('[getConvoTitle] Error getting conversation title', error);
|
|
return { message: 'Error getting conversation title' };
|
|
}
|
|
},
|
|
/**
|
|
* Asynchronously deletes conversations and associated messages for a given user and filter.
|
|
*
|
|
* @async
|
|
* @function
|
|
* @param {string|ObjectId} user - The user's ID.
|
|
* @param {Object} filter - Additional filter criteria for the conversations to be deleted.
|
|
* @returns {Promise<{ n: number, ok: number, deletedCount: number, messages: { n: number, ok: number, deletedCount: number } }>}
|
|
* An object containing the count of deleted conversations and associated messages.
|
|
* @throws {Error} Throws an error if there's an issue with the database operations.
|
|
*
|
|
* @example
|
|
* const user = 'someUserId';
|
|
* const filter = { someField: 'someValue' };
|
|
* const result = await deleteConvos(user, filter);
|
|
* logger.error(result); // { n: 5, ok: 1, deletedCount: 5, messages: { n: 10, ok: 1, deletedCount: 10 } }
|
|
*/
|
|
deleteConvos: async (user, filter) => {
|
|
let toRemove = await Conversation.find({ ...filter, user }).select('conversationId');
|
|
const ids = toRemove.map((instance) => instance.conversationId);
|
|
let deleteCount = await Conversation.deleteMany({ ...filter, user });
|
|
deleteCount.messages = await deleteMessages({ conversationId: { $in: ids } });
|
|
return deleteCount;
|
|
},
|
|
};
|