mirror of
https://github.com/danny-avila/LibreChat.git
synced 2026-03-12 19:12:36 +01:00
* 🧪 test: Add reconnection storm regression tests for MCPConnection Introduced a comprehensive test suite for reconnection storm scenarios, validating circuit breaker, throttling, cooldown, and timeout fixes. The tests utilize real MCP SDK transports and a StreamableHTTP server to ensure accurate behavior under rapid connect/disconnect cycles and error handling for SSE 400/405 responses. This enhances the reliability of the MCPConnection by ensuring proper handling of reconnection logic and circuit breaker functionality. * 🔧 fix: Update createUnavailableToolStub to return structured response Modified the `createUnavailableToolStub` function to return an array containing the unavailable message and a null value, enhancing the response structure. Additionally, added a debug log to skip tool creation when the result is null, improving the handling of reconnection scenarios in the MCP service. * 🧪 test: Enhance MCP tool creation tests for cache and throttle interactions Added new test cases for the `createMCPTool` function to validate the caching behavior when tools are unavailable or throttled. The tests ensure that tools are correctly cached as missing and prevent unnecessary reconnects across different users, improving the reliability of the MCP service under concurrent usage scenarios. Additionally, introduced a test for the `createMCPTools` function to verify that it returns an empty array when reconnect is throttled, ensuring proper handling of throttling logic. * 📝 docs: Update AGENTS.md with testing philosophy and guidelines Expanded the testing section in AGENTS.md to emphasize the importance of using real logic over mocks, advocating for the use of spies and real dependencies in tests. Added specific recommendations for testing with MongoDB and MCP SDK, highlighting the need to mock only uncontrollable external services. This update aims to improve testing practices and encourage more robust test implementations. * 🧪 test: Enhance reconnection storm tests with socket tracking and SSE handling Updated the reconnection storm test suite to include a new socket tracking mechanism for better resource management during tests. Improved the handling of SSE 400/405 responses by ensuring they are processed in the same branch as 404 errors, preventing unhandled cases. This enhances the reliability of the MCPConnection under rapid reconnect scenarios and ensures proper error handling. * 🔧 fix: Implement cache eviction for stale reconnect attempts and missing tools Added an `evictStale` function to manage the size of the `lastReconnectAttempts` and `missingToolCache` maps, ensuring they do not exceed a maximum cache size. This enhancement improves resource management by removing outdated entries based on a specified time-to-live (TTL), thereby optimizing the MCP service's performance during reconnection scenarios.
166 lines
8.3 KiB
Markdown
166 lines
8.3 KiB
Markdown
# LibreChat
|
|
|
|
## Project Overview
|
|
|
|
LibreChat is a monorepo with the following key workspaces:
|
|
|
|
| Workspace | Language | Side | Dependency | Purpose |
|
|
|---|---|---|---|---|
|
|
| `/api` | JS (legacy) | Backend | `packages/api`, `packages/data-schemas`, `packages/data-provider`, `@librechat/agents` | Express server — minimize changes here |
|
|
| `/packages/api` | **TypeScript** | Backend | `packages/data-schemas`, `packages/data-provider` | New backend code lives here (TS only, consumed by `/api`) |
|
|
| `/packages/data-schemas` | TypeScript | Backend | `packages/data-provider` | Database models/schemas, shareable across backend projects |
|
|
| `/packages/data-provider` | TypeScript | Shared | — | Shared API types, endpoints, data-service — used by both frontend and backend |
|
|
| `/client` | TypeScript/React | Frontend | `packages/data-provider`, `packages/client` | Frontend SPA |
|
|
| `/packages/client` | TypeScript | Frontend | `packages/data-provider` | Shared frontend utilities |
|
|
|
|
The source code for `@librechat/agents` (major backend dependency, same team) is at `/home/danny/agentus`.
|
|
|
|
---
|
|
|
|
## Workspace Boundaries
|
|
|
|
- **All new backend code must be TypeScript** in `/packages/api`.
|
|
- Keep `/api` changes to the absolute minimum (thin JS wrappers calling into `/packages/api`).
|
|
- Database-specific shared logic goes in `/packages/data-schemas`.
|
|
- Frontend/backend shared API logic (endpoints, types, data-service) goes in `/packages/data-provider`.
|
|
- Build data-provider from project root: `npm run build:data-provider`.
|
|
|
|
---
|
|
|
|
## Code Style
|
|
|
|
### Structure and Clarity
|
|
|
|
- **Never-nesting**: early returns, flat code, minimal indentation. Break complex operations into well-named helpers.
|
|
- **Functional first**: pure functions, immutable data, `map`/`filter`/`reduce` over imperative loops. Only reach for OOP when it clearly improves domain modeling or state encapsulation.
|
|
- **No dynamic imports** unless absolutely necessary.
|
|
|
|
### DRY
|
|
|
|
- Extract repeated logic into utility functions.
|
|
- Reusable hooks / higher-order components for UI patterns.
|
|
- Parameterized helpers instead of near-duplicate functions.
|
|
- Constants for repeated values; configuration objects over duplicated init code.
|
|
- Shared validators, centralized error handling, single source of truth for business rules.
|
|
- Shared typing system with interfaces/types extending common base definitions.
|
|
- Abstraction layers for external API interactions.
|
|
|
|
### Iteration and Performance
|
|
|
|
- **Minimize looping** — especially over shared data structures like message arrays, which are iterated frequently throughout the codebase. Every additional pass adds up at scale.
|
|
- Consolidate sequential O(n) operations into a single pass whenever possible; never loop over the same collection twice if the work can be combined.
|
|
- Choose data structures that reduce the need to iterate (e.g., `Map`/`Set` for lookups instead of `Array.find`/`Array.includes`).
|
|
- Avoid unnecessary object creation; consider space-time tradeoffs.
|
|
- Prevent memory leaks: careful with closures, dispose resources/event listeners, no circular references.
|
|
|
|
### Type Safety
|
|
|
|
- **Never use `any`**. Explicit types for all parameters, return values, and variables.
|
|
- **Limit `unknown`** — avoid `unknown`, `Record<string, unknown>`, and `as unknown as T` assertions. A `Record<string, unknown>` almost always signals a missing explicit type definition.
|
|
- **Don't duplicate types** — before defining a new type, check whether it already exists in the project (especially `packages/data-provider`). Reuse and extend existing types rather than creating redundant definitions.
|
|
- Use union types, generics, and interfaces appropriately.
|
|
- All TypeScript and ESLint warnings/errors must be addressed — do not leave unresolved diagnostics.
|
|
|
|
### Comments and Documentation
|
|
|
|
- Write self-documenting code; no inline comments narrating what code does.
|
|
- JSDoc only for complex/non-obvious logic or intellisense on public APIs.
|
|
- Single-line JSDoc for brief docs, multi-line for complex cases.
|
|
- Avoid standalone `//` comments unless absolutely necessary.
|
|
|
|
### Import Order
|
|
|
|
Imports are organized into three sections:
|
|
|
|
1. **Package imports** — sorted shortest to longest line length (`react` always first).
|
|
2. **`import type` imports** — sorted longest to shortest (package types first, then local types; length resets between sub-groups).
|
|
3. **Local/project imports** — sorted longest to shortest.
|
|
|
|
Multi-line imports count total character length across all lines. Consolidate value imports from the same module. Always use standalone `import type { ... }` — never inline `type` inside value imports.
|
|
|
|
### JS/TS Loop Preferences
|
|
|
|
- **Limit looping as much as possible.** Prefer single-pass transformations and avoid re-iterating the same data.
|
|
- `for (let i = 0; ...)` for performance-critical or index-dependent operations.
|
|
- `for...of` for simple array iteration.
|
|
- `for...in` only for object property enumeration.
|
|
|
|
---
|
|
|
|
## Frontend Rules (`client/src/**/*`)
|
|
|
|
### Localization
|
|
|
|
- All user-facing text must use `useLocalize()`.
|
|
- Only update English keys in `client/src/locales/en/translation.json` (other languages are automated externally).
|
|
- Semantic key prefixes: `com_ui_`, `com_assistants_`, etc.
|
|
|
|
### Components
|
|
|
|
- TypeScript for all React components with proper type imports.
|
|
- Semantic HTML with ARIA labels (`role`, `aria-label`) for accessibility.
|
|
- Group related components in feature directories (e.g., `SidePanel/Memories/`).
|
|
- Use index files for clean exports.
|
|
|
|
### Data Management
|
|
|
|
- Feature hooks: `client/src/data-provider/[Feature]/queries.ts` → `[Feature]/index.ts` → `client/src/data-provider/index.ts`.
|
|
- React Query (`@tanstack/react-query`) for all API interactions; proper query invalidation on mutations.
|
|
- QueryKeys and MutationKeys in `packages/data-provider/src/keys.ts`.
|
|
|
|
### Data-Provider Integration
|
|
|
|
- Endpoints: `packages/data-provider/src/api-endpoints.ts`
|
|
- Data service: `packages/data-provider/src/data-service.ts`
|
|
- Types: `packages/data-provider/src/types/queries.ts`
|
|
- Use `encodeURIComponent` for dynamic URL parameters.
|
|
|
|
### Performance
|
|
|
|
- Prioritize memory and speed efficiency at scale.
|
|
- Cursor pagination for large datasets.
|
|
- Proper dependency arrays to avoid unnecessary re-renders.
|
|
- Leverage React Query caching and background refetching.
|
|
|
|
---
|
|
|
|
## Development Commands
|
|
|
|
| Command | Purpose |
|
|
|---|---|
|
|
| `npm run smart-reinstall` | Install deps (if lockfile changed) + build via Turborepo |
|
|
| `npm run reinstall` | Clean install — wipe `node_modules` and reinstall from scratch |
|
|
| `npm run backend` | Start the backend server |
|
|
| `npm run backend:dev` | Start backend with file watching (development) |
|
|
| `npm run build` | Build all compiled code via Turborepo (parallel, cached) |
|
|
| `npm run frontend` | Build all compiled code sequentially (legacy fallback) |
|
|
| `npm run frontend:dev` | Start frontend dev server with HMR (port 3090, requires backend running) |
|
|
| `npm run build:data-provider` | Rebuild `packages/data-provider` after changes |
|
|
|
|
- Node.js: v20.19.0+ or ^22.12.0 or >= 23.0.0
|
|
- Database: MongoDB
|
|
- Backend runs on `http://localhost:3080/`; frontend dev server on `http://localhost:3090/`
|
|
|
|
---
|
|
|
|
## Testing
|
|
|
|
- Framework: **Jest**, run per-workspace.
|
|
- Run tests from their workspace directory: `cd api && npx jest <pattern>`, `cd packages/api && npx jest <pattern>`, etc.
|
|
- Frontend tests: `__tests__` directories alongside components; use `test/layout-test-utils` for rendering.
|
|
- Cover loading, success, and error states for UI/data flows.
|
|
|
|
### Philosophy
|
|
|
|
- **Real logic over mocks.** Exercise actual code paths with real dependencies. Mocking is a last resort.
|
|
- **Spies over mocks.** Assert that real functions are called with expected arguments and frequency without replacing underlying logic.
|
|
- **MongoDB**: use `mongodb-memory-server` for a real in-memory MongoDB instance. Test actual queries and schema validation, not mocked DB calls.
|
|
- **MCP**: use real `@modelcontextprotocol/sdk` exports for servers, transports, and tool definitions. Mirror real scenarios, don't stub SDK internals.
|
|
- Only mock what you cannot control: external HTTP APIs, rate-limited services, non-deterministic system calls.
|
|
- Heavy mocking is a code smell, not a testing strategy.
|
|
|
|
---
|
|
|
|
## Formatting
|
|
|
|
Fix all formatting lint errors (trailing spaces, tabs, newlines, indentation) using auto-fix when available. All TypeScript/ESLint warnings and errors **must** be resolved.
|