LibreChat/docs/deployment
Denis Palnitsky ab6fbe48f1
📥 feat: Import Conversations from LibreChat, ChatGPT, Chatbot UI (#2355)
* Basic implementation of ChatGPT conversation import

* remove debug code

* Handle citations

* Fix updatedAt in import

* update default model

* Use job scheduler to handle import requests

* import job status endpoint

* Add wrapper around Agenda

* Rate limits for import endpoint

* rename import api path

* Batch save import to mongo

* Improve naming

* Add documenting comments

* Test for importers

* Change button for importing conversations

* Frontend changes

* Import job status endpoint

* Import endpoint response

* Add translations to new phrases

* Fix conversations refreshing

* cleanup unused functions

* set timeout for import job status polling

* Add documentation

* get extra spaces back

* Improve error message

* Fix translation files after merge

* fix translation files 2

* Add zh translation for import functionality

* Sync mailisearch index after import

* chore: add dummy uri for jest tests, as MONGO_URI should only be real for E2E tests

* docs: fix links

* docs: fix conversationsImport section

* fix: user role issue for librechat imports

* refactor: import conversations from json
- organize imports
- add additional jsdocs
- use multer with diskStorage to avoid loading file into memory outside of job
- use filepath instead of loading data string for imports
- replace console logs and some logger.info() with logger.debug
- only use multer for import route

* fix: undefined metadata edge case and replace ChatGtp -> ChatGpt

* Refactor importChatGptConvo function to handle undefined metadata edge case and replace ChatGtp with ChatGpt

* fix: chatgpt importer

* feat: maintain tree relationship for librechat messages

* chore: use enum

* refactor: saveMessage to use single object arg, replace console logs, add userId to log message

* chore: additional comment

* chore: multer edge case

* feat: first pass, maintain tree relationship

* chore: organize

* chore: remove log

* ci: add heirarchy test for chatgpt

* ci: test maintaining of heirarchy for librechat

* wip: allow non-text content type messages

* refactor: import content part object json string

* refactor: more content types to format

* chore: consolidate messageText formatting

* docs: update on changes, bump data-provider/config versions, update readme

* refactor(indexSync): singleton pattern for MeiliSearchClient

* refactor: debug log after batch is done

* chore: add back indexSync error handling

---------

Co-authored-by: jakubmieszczak <jakub.mieszczak@zendesk.com>
Co-authored-by: Danny Avila <danny@librechat.ai>
2024-05-02 02:48:26 -04:00
..
azure-terraform.md 🪪mkdocs: social cards (#1428) 2023-12-28 17:10:06 -05:00
cloudflare.md 📝 docs: Remove Google Domains Reference (#2267) 2024-04-02 03:26:35 -04:00
digitalocean.md 📥 feat: Import Conversations from LibreChat, ChatGPT, Chatbot UI (#2355) 2024-05-02 02:48:26 -04:00
docker_ubuntu_deploy.md ⚠️ docs: Default Value Warnings & Docker Docs Update (#2343) 2024-04-06 18:20:48 -04:00
heroku.md 🔗 chore: Add Stable Discord and Homepage Links (#1835) 2024-02-19 09:42:57 -05:00
hetzner_ubuntu.md 🔗 chore: Add Stable Discord and Homepage Links (#1835) 2024-02-19 09:42:57 -05:00
huggingface.md 🪪mkdocs: social cards (#1428) 2023-12-28 17:10:06 -05:00
index.md ✏️ docs: Railway, Traefik, and Improvements (#2060) 2024-03-11 09:06:27 -04:00
introduction.md ✏️ docs: Railway, Traefik, and Improvements (#2060) 2024-03-11 09:06:27 -04:00
linode.md 🔍 chore: Clean Up Documentation (#2217) 2024-03-26 13:40:00 -04:00
meilisearch_in_render.md 🔗 chore: Add Stable Discord and Homepage Links (#1835) 2024-02-19 09:42:57 -05:00
nginx.md 📥 feat: Import Conversations from LibreChat, ChatGPT, Chatbot UI (#2355) 2024-05-02 02:48:26 -04:00
ngrok.md 🖊️chore: fix deployment guides (#2021) 2024-03-08 08:52:26 -05:00
railway.md 🖥️ docs: env changes v0.6.10→v0.7.0+ (#2442) 2024-04-18 08:27:52 -04:00
render.md 🔗 chore: Add Stable Discord and Homepage Links (#1835) 2024-02-19 09:42:57 -05:00
traefik.md 🚦 docs: Update traefik.md - Documentation Fix for edge case race condition (#2322) 2024-04-05 19:32:51 -04:00
zeabur.md 📝 docs: add env changes to breaking_changes.md and minor fixes (#1812) 2024-02-19 09:41:07 -05:00