mirror of
https://github.com/danny-avila/LibreChat.git
synced 2025-12-16 16:30:15 +01:00
* WIP(backend/api): custom endpoint * WIP(frontend/client): custom endpoint * chore: adjust typedefs for configs * refactor: use data-provider for cache keys and rename enums and custom endpoint for better clarity and compatibility * feat: loadYaml utility * refactor: rename back to from and proof-of-concept for creating schemas from user-defined defaults * refactor: remove custom endpoint from default endpointsConfig as it will be exclusively managed by yaml config * refactor(EndpointController): rename variables for clarity * feat: initial load custom config * feat(server/utils): add simple `isUserProvided` helper * chore(types): update TConfig type * refactor: remove custom endpoint handling from model services as will be handled by config, modularize fetching of models * feat: loadCustomConfig, loadConfigEndpoints, loadConfigModels * chore: reorganize server init imports, invoke loadCustomConfig * refactor(loadConfigEndpoints/Models): return each custom endpoint as standalone endpoint * refactor(Endpoint/ModelController): spread config values after default (temporary) * chore(client): fix type issues * WIP: first pass for multiple custom endpoints - add endpointType to Conversation schema - add update zod schemas for both convo/presets to allow non-EModelEndpoint value as endpoint (also using type assertion) - use `endpointType` value as `endpoint` where mapping to type is necessary using this field - use custom defined `endpoint` value and not type for mapping to modelsConfig - misc: add return type to `getDefaultEndpoint` - in `useNewConvo`, add the endpointType if it wasn't already added to conversation - EndpointsMenu: use user-defined endpoint name as Title in menu - TODO: custom icon via custom config, change unknown to robot icon * refactor(parseConvo): pass args as an object and change where used accordingly; chore: comment out 'create schema' code * chore: remove unused availableModels field in TConfig type * refactor(parseCompactConvo): pass args as an object and change where used accordingly * feat: chat through custom endpoint * chore(message/convoSchemas): avoid saving empty arrays * fix(BaseClient/saveMessageToDatabase): save endpointType * refactor(ChatRoute): show Spinner if endpointsQuery or modelsQuery are still loading, which is apparent with slow fetching of models/remote config on first serve * fix(useConversation): assign endpointType if it's missing * fix(SaveAsPreset): pass real endpoint and endpointType when saving Preset) * chore: recorganize types order for TConfig, add `iconURL` * feat: custom endpoint icon support: - use UnknownIcon in all icon contexts - add mistral and openrouter as known endpoints, and add their icons - iconURL support * fix(presetSchema): move endpointType to default schema definitions shared between convoSchema and defaults * refactor(Settings/OpenAI): remove legacy `isOpenAI` flag * fix(OpenAIClient): do not invoke abortCompletion on completion error * feat: add responseSender/label support for custom endpoints: - use defaultModelLabel field in endpointOption - add model defaults for custom endpoints in `getResponseSender` - add `useGetSender` hook which uses EndpointsQuery to determine `defaultModelLabel` - include defaultModelLabel from endpointConfig in custom endpoint client options - pass `endpointType` to `getResponseSender` * feat(OpenAIClient): use custom options from config file * refactor: rename `defaultModelLabel` to `modelDisplayLabel` * refactor(data-provider): separate concerns from `schemas` into `parsers`, `config`, and fix imports elsewhere * feat: `iconURL` and extract environment variables from custom endpoint config values * feat: custom config validation via zod schema, rename and move to `./projectRoot/librechat.yaml` * docs: custom config docs and examples * fix(OpenAIClient/mistral): mistral does not allow singular system message, also add `useChatCompletion` flag to use openai-node for title completions * fix(custom/initializeClient): extract env var and use `isUserProvided` function * Update librechat.example.yaml * feat(InputWithLabel): add className props, and forwardRef * fix(streamResponse): handle error edge case where either messages or convos query throws an error * fix(useSSE): handle errorHandler edge cases where error response is and is not properly formatted from API, especially when a conversationId is not yet provided, which ensures stream is properly closed on error * feat: user_provided keys for custom endpoints * fix(config/endpointSchema): do not allow default endpoint values in custom endpoint `name` * feat(loadConfigModels): extract env variables and optimize fetching models * feat: support custom endpoint iconURL for messages and Nav * feat(OpenAIClient): add/dropParams support * docs: update docs with default params, add/dropParams, and notes to use config file instead of `OPENAI_REVERSE_PROXY` * docs: update docs with additional notes * feat(maxTokensMap): add mistral models (32k context) * docs: update openrouter notes * Update ai_setup.md * docs(custom_config): add table of contents and fix note about custom name * docs(custom_config): reorder ToC * Update custom_config.md * Add note about `max_tokens` field in custom_config.md
125 lines
4.3 KiB
TypeScript
125 lines
4.3 KiB
TypeScript
import { useRecoilState } from 'recoil';
|
|
import { Settings2 } from 'lucide-react';
|
|
import { Root, Anchor } from '@radix-ui/react-popover';
|
|
import { useState, useEffect, useMemo } from 'react';
|
|
import { tPresetUpdateSchema, EModelEndpoint } from 'librechat-data-provider';
|
|
import type { TPreset } from 'librechat-data-provider';
|
|
import { EndpointSettings, SaveAsPresetDialog } from '~/components/Endpoints';
|
|
import { ModelSelect } from '~/components/Input/ModelSelect';
|
|
import { PluginStoreDialog } from '~/components';
|
|
import OptionsPopover from './OptionsPopover';
|
|
import PopoverButtons from './PopoverButtons';
|
|
import { useSetIndexOptions } from '~/hooks';
|
|
import { useChatContext } from '~/Providers';
|
|
import { Button } from '~/components/ui';
|
|
import { cn, cardStyle } from '~/utils/';
|
|
import store from '~/store';
|
|
|
|
export default function OptionsBar() {
|
|
const [saveAsDialogShow, setSaveAsDialogShow] = useState<boolean>(false);
|
|
const [showPluginStoreDialog, setShowPluginStoreDialog] = useRecoilState(
|
|
store.showPluginStoreDialog,
|
|
);
|
|
|
|
const { showPopover, conversation, latestMessage, setShowPopover, setShowBingToneSetting } =
|
|
useChatContext();
|
|
const { setOption } = useSetIndexOptions();
|
|
|
|
const { endpoint, conversationId, jailbreak } = conversation ?? {};
|
|
|
|
const altConditions: { [key: string]: boolean } = {
|
|
bingAI: !!(latestMessage && conversation?.jailbreak && endpoint === 'bingAI'),
|
|
};
|
|
|
|
const altSettings: { [key: string]: () => void } = {
|
|
bingAI: () => setShowBingToneSetting((prev) => !prev),
|
|
};
|
|
|
|
const noSettings = useMemo<{ [key: string]: boolean }>(
|
|
() => ({
|
|
[EModelEndpoint.chatGPTBrowser]: true,
|
|
[EModelEndpoint.bingAI]: jailbreak ? false : conversationId !== 'new',
|
|
}),
|
|
[jailbreak, conversationId],
|
|
);
|
|
|
|
useEffect(() => {
|
|
if (endpoint && noSettings[endpoint]) {
|
|
setShowPopover(false);
|
|
}
|
|
// eslint-disable-next-line react-hooks/exhaustive-deps
|
|
}, [endpoint, noSettings]);
|
|
|
|
const saveAsPreset = () => {
|
|
setSaveAsDialogShow(true);
|
|
};
|
|
|
|
if (!endpoint) {
|
|
return null;
|
|
}
|
|
|
|
const triggerAdvancedMode = altConditions[endpoint]
|
|
? altSettings[endpoint]
|
|
: () => setShowPopover((prev) => !prev);
|
|
return (
|
|
<Root
|
|
open={showPopover}
|
|
// onOpenChange={} // called when the open state of the popover changes.
|
|
>
|
|
<Anchor>
|
|
<div className="my-auto lg:max-w-2xl xl:max-w-3xl">
|
|
<span className="flex w-full flex-col items-center justify-center gap-0 md:order-none md:m-auto md:gap-2">
|
|
<div className="z-[61] flex w-full items-center justify-center gap-2">
|
|
<ModelSelect
|
|
conversation={conversation}
|
|
setOption={setOption}
|
|
isMultiChat={true}
|
|
showAbove={false}
|
|
/>
|
|
{!noSettings[endpoint] && (
|
|
<Button
|
|
type="button"
|
|
className={cn(
|
|
cardStyle,
|
|
'min-w-4 z-50 flex h-[40px] flex-none items-center justify-center px-3 focus:ring-0 focus:ring-offset-0',
|
|
'hover:bg-gray-50 radix-state-open:bg-gray-50 dark:hover:bg-black/10 dark:radix-state-open:bg-black/20',
|
|
)}
|
|
onClick={triggerAdvancedMode}
|
|
>
|
|
<Settings2 className="w-4 text-gray-600 dark:text-white" />
|
|
</Button>
|
|
)}
|
|
</div>
|
|
<OptionsPopover
|
|
visible={showPopover}
|
|
saveAsPreset={saveAsPreset}
|
|
closePopover={() => setShowPopover(false)}
|
|
PopoverButtons={<PopoverButtons />}
|
|
>
|
|
<div className="px-4 py-4">
|
|
<EndpointSettings
|
|
conversation={conversation}
|
|
setOption={setOption}
|
|
isMultiChat={true}
|
|
/>
|
|
</div>
|
|
</OptionsPopover>
|
|
<SaveAsPresetDialog
|
|
open={saveAsDialogShow}
|
|
onOpenChange={setSaveAsDialogShow}
|
|
preset={
|
|
tPresetUpdateSchema.parse({
|
|
...conversation,
|
|
}) as TPreset
|
|
}
|
|
/>
|
|
<PluginStoreDialog
|
|
isOpen={showPluginStoreDialog}
|
|
setIsOpen={setShowPluginStoreDialog}
|
|
/>
|
|
</span>
|
|
</div>
|
|
</Anchor>
|
|
</Root>
|
|
);
|
|
}
|