mirror of
https://github.com/danny-avila/LibreChat.git
synced 2025-12-16 16:30:15 +01:00
* WIP(backend/api): custom endpoint * WIP(frontend/client): custom endpoint * chore: adjust typedefs for configs * refactor: use data-provider for cache keys and rename enums and custom endpoint for better clarity and compatibility * feat: loadYaml utility * refactor: rename back to from and proof-of-concept for creating schemas from user-defined defaults * refactor: remove custom endpoint from default endpointsConfig as it will be exclusively managed by yaml config * refactor(EndpointController): rename variables for clarity * feat: initial load custom config * feat(server/utils): add simple `isUserProvided` helper * chore(types): update TConfig type * refactor: remove custom endpoint handling from model services as will be handled by config, modularize fetching of models * feat: loadCustomConfig, loadConfigEndpoints, loadConfigModels * chore: reorganize server init imports, invoke loadCustomConfig * refactor(loadConfigEndpoints/Models): return each custom endpoint as standalone endpoint * refactor(Endpoint/ModelController): spread config values after default (temporary) * chore(client): fix type issues * WIP: first pass for multiple custom endpoints - add endpointType to Conversation schema - add update zod schemas for both convo/presets to allow non-EModelEndpoint value as endpoint (also using type assertion) - use `endpointType` value as `endpoint` where mapping to type is necessary using this field - use custom defined `endpoint` value and not type for mapping to modelsConfig - misc: add return type to `getDefaultEndpoint` - in `useNewConvo`, add the endpointType if it wasn't already added to conversation - EndpointsMenu: use user-defined endpoint name as Title in menu - TODO: custom icon via custom config, change unknown to robot icon * refactor(parseConvo): pass args as an object and change where used accordingly; chore: comment out 'create schema' code * chore: remove unused availableModels field in TConfig type * refactor(parseCompactConvo): pass args as an object and change where used accordingly * feat: chat through custom endpoint * chore(message/convoSchemas): avoid saving empty arrays * fix(BaseClient/saveMessageToDatabase): save endpointType * refactor(ChatRoute): show Spinner if endpointsQuery or modelsQuery are still loading, which is apparent with slow fetching of models/remote config on first serve * fix(useConversation): assign endpointType if it's missing * fix(SaveAsPreset): pass real endpoint and endpointType when saving Preset) * chore: recorganize types order for TConfig, add `iconURL` * feat: custom endpoint icon support: - use UnknownIcon in all icon contexts - add mistral and openrouter as known endpoints, and add their icons - iconURL support * fix(presetSchema): move endpointType to default schema definitions shared between convoSchema and defaults * refactor(Settings/OpenAI): remove legacy `isOpenAI` flag * fix(OpenAIClient): do not invoke abortCompletion on completion error * feat: add responseSender/label support for custom endpoints: - use defaultModelLabel field in endpointOption - add model defaults for custom endpoints in `getResponseSender` - add `useGetSender` hook which uses EndpointsQuery to determine `defaultModelLabel` - include defaultModelLabel from endpointConfig in custom endpoint client options - pass `endpointType` to `getResponseSender` * feat(OpenAIClient): use custom options from config file * refactor: rename `defaultModelLabel` to `modelDisplayLabel` * refactor(data-provider): separate concerns from `schemas` into `parsers`, `config`, and fix imports elsewhere * feat: `iconURL` and extract environment variables from custom endpoint config values * feat: custom config validation via zod schema, rename and move to `./projectRoot/librechat.yaml` * docs: custom config docs and examples * fix(OpenAIClient/mistral): mistral does not allow singular system message, also add `useChatCompletion` flag to use openai-node for title completions * fix(custom/initializeClient): extract env var and use `isUserProvided` function * Update librechat.example.yaml * feat(InputWithLabel): add className props, and forwardRef * fix(streamResponse): handle error edge case where either messages or convos query throws an error * fix(useSSE): handle errorHandler edge cases where error response is and is not properly formatted from API, especially when a conversationId is not yet provided, which ensures stream is properly closed on error * feat: user_provided keys for custom endpoints * fix(config/endpointSchema): do not allow default endpoint values in custom endpoint `name` * feat(loadConfigModels): extract env variables and optimize fetching models * feat: support custom endpoint iconURL for messages and Nav * feat(OpenAIClient): add/dropParams support * docs: update docs with default params, add/dropParams, and notes to use config file instead of `OPENAI_REVERSE_PROXY` * docs: update docs with additional notes * feat(maxTokensMap): add mistral models (32k context) * docs: update openrouter notes * Update ai_setup.md * docs(custom_config): add table of contents and fix note about custom name * docs(custom_config): reorder ToC * Update custom_config.md * Add note about `max_tokens` field in custom_config.md
116 lines
4.6 KiB
TypeScript
116 lines
4.6 KiB
TypeScript
import { useRecoilState } from 'recoil';
|
||
import { useGetEndpointsQuery } from 'librechat-data-provider/react-query';
|
||
import { cn, defaultTextProps, removeFocusOutlines, mapEndpoints } from '~/utils';
|
||
import { Input, Label, Dropdown, Dialog, DialogClose, DialogButton } from '~/components/';
|
||
import PopoverButtons from '~/components/Chat/Input/PopoverButtons';
|
||
import DialogTemplate from '~/components/ui/DialogTemplate';
|
||
import { useSetIndexOptions, useLocalize } from '~/hooks';
|
||
import { EndpointSettings } from '~/components/Endpoints';
|
||
import { useChatContext } from '~/Providers';
|
||
import store from '~/store';
|
||
|
||
const EditPresetDialog = ({
|
||
exportPreset,
|
||
submitPreset,
|
||
}: {
|
||
exportPreset: () => void;
|
||
submitPreset: () => void;
|
||
}) => {
|
||
const localize = useLocalize();
|
||
const { preset } = useChatContext();
|
||
const { setOption } = useSetIndexOptions(preset);
|
||
const [presetModalVisible, setPresetModalVisible] = useRecoilState(store.presetModalVisible);
|
||
|
||
const { data: availableEndpoints = [] } = useGetEndpointsQuery({
|
||
select: mapEndpoints,
|
||
});
|
||
|
||
const { endpoint } = preset || {};
|
||
if (!endpoint) {
|
||
return null;
|
||
}
|
||
|
||
return (
|
||
<Dialog open={presetModalVisible} onOpenChange={setPresetModalVisible}>
|
||
<DialogTemplate
|
||
title={`${localize('com_ui_edit') + ' ' + localize('com_endpoint_preset')} - ${
|
||
preset?.title
|
||
}`}
|
||
className="h-full max-w-full overflow-y-auto pb-4 sm:w-[680px] sm:pb-0 md:h-[720px] md:w-[750px] md:overflow-y-hidden lg:w-[950px] xl:h-[720px]"
|
||
main={
|
||
<div className="flex w-full flex-col items-center gap-2 md:h-[530px]">
|
||
<div className="grid w-full grid-cols-5 gap-6">
|
||
<div className="col-span-4 flex items-start justify-start gap-4">
|
||
<div className="flex w-full flex-col">
|
||
<Label htmlFor="preset-name" className="mb-1 text-left text-sm font-medium">
|
||
{localize('com_endpoint_preset_name')}
|
||
</Label>
|
||
<Input
|
||
id="preset-name"
|
||
value={preset?.title || ''}
|
||
onChange={(e) => setOption('title')(e.target.value || '')}
|
||
placeholder={localize('com_endpoint_set_custom_name')}
|
||
className={cn(
|
||
defaultTextProps,
|
||
'flex h-10 max-h-10 w-full resize-none px-3 py-2',
|
||
removeFocusOutlines,
|
||
)}
|
||
/>
|
||
</div>
|
||
<div className="flex w-full flex-col">
|
||
<Label htmlFor="endpoint" className="mb-1 text-left text-sm font-medium">
|
||
{localize('com_endpoint')}
|
||
</Label>
|
||
<Dropdown
|
||
value={endpoint || ''}
|
||
onChange={(value) => setOption('endpoint')(value)}
|
||
options={availableEndpoints}
|
||
/>
|
||
</div>
|
||
</div>
|
||
<div className="col-span-2 flex items-start justify-start gap-4 sm:col-span-1">
|
||
<div className="flex w-full flex-col">
|
||
<Label
|
||
htmlFor="endpoint"
|
||
className="mb-1 hidden text-left text-sm font-medium sm:block"
|
||
>
|
||
{'ㅤ'}
|
||
</Label>
|
||
<PopoverButtons
|
||
buttonClass="ml-0 w-full dark:bg-gray-700 dark:hover:bg-gray-800 p-2 h-[40px] justify-center mt-0"
|
||
iconClass="hidden lg:block w-4"
|
||
/>
|
||
</div>
|
||
</div>
|
||
</div>
|
||
<div className="my-4 w-full border-t border-gray-300 dark:border-gray-500" />
|
||
<div className="w-full p-0">
|
||
<EndpointSettings
|
||
conversation={preset}
|
||
setOption={setOption}
|
||
isPreset={true}
|
||
isMultiChat={true}
|
||
className="h-full md:mb-4 md:h-[440px]"
|
||
/>
|
||
</div>
|
||
</div>
|
||
}
|
||
buttons={
|
||
<div className="mb-6 md:mb-2">
|
||
<DialogButton onClick={exportPreset} className="dark:hover:gray-400 border-gray-700">
|
||
{localize('com_endpoint_export')}
|
||
</DialogButton>
|
||
<DialogClose
|
||
onClick={submitPreset}
|
||
className="dark:hover:gray-400 ml-2 border-gray-700 bg-green-600 text-white hover:bg-green-700 dark:hover:bg-green-800"
|
||
>
|
||
{localize('com_endpoint_save')}
|
||
</DialogClose>
|
||
</div>
|
||
}
|
||
/>
|
||
</Dialog>
|
||
);
|
||
};
|
||
|
||
export default EditPresetDialog;
|