LibreChat/api/server/utils/import/__data__/librechat-tree.json
Denis Palnitsky ab6fbe48f1
📥 feat: Import Conversations from LibreChat, ChatGPT, Chatbot UI (#2355)
* Basic implementation of ChatGPT conversation import

* remove debug code

* Handle citations

* Fix updatedAt in import

* update default model

* Use job scheduler to handle import requests

* import job status endpoint

* Add wrapper around Agenda

* Rate limits for import endpoint

* rename import api path

* Batch save import to mongo

* Improve naming

* Add documenting comments

* Test for importers

* Change button for importing conversations

* Frontend changes

* Import job status endpoint

* Import endpoint response

* Add translations to new phrases

* Fix conversations refreshing

* cleanup unused functions

* set timeout for import job status polling

* Add documentation

* get extra spaces back

* Improve error message

* Fix translation files after merge

* fix translation files 2

* Add zh translation for import functionality

* Sync mailisearch index after import

* chore: add dummy uri for jest tests, as MONGO_URI should only be real for E2E tests

* docs: fix links

* docs: fix conversationsImport section

* fix: user role issue for librechat imports

* refactor: import conversations from json
- organize imports
- add additional jsdocs
- use multer with diskStorage to avoid loading file into memory outside of job
- use filepath instead of loading data string for imports
- replace console logs and some logger.info() with logger.debug
- only use multer for import route

* fix: undefined metadata edge case and replace ChatGtp -> ChatGpt

* Refactor importChatGptConvo function to handle undefined metadata edge case and replace ChatGtp with ChatGpt

* fix: chatgpt importer

* feat: maintain tree relationship for librechat messages

* chore: use enum

* refactor: saveMessage to use single object arg, replace console logs, add userId to log message

* chore: additional comment

* chore: multer edge case

* feat: first pass, maintain tree relationship

* chore: organize

* chore: remove log

* ci: add heirarchy test for chatgpt

* ci: test maintaining of heirarchy for librechat

* wip: allow non-text content type messages

* refactor: import content part object json string

* refactor: more content types to format

* chore: consolidate messageText formatting

* docs: update on changes, bump data-provider/config versions, update readme

* refactor(indexSync): singleton pattern for MeiliSearchClient

* refactor: debug log after batch is done

* chore: add back indexSync error handling

---------

Co-authored-by: jakubmieszczak <jakub.mieszczak@zendesk.com>
Co-authored-by: Danny Avila <danny@librechat.ai>
2024-05-02 02:48:26 -04:00

153 lines
10 KiB
JSON
Raw Blame History

This file contains ambiguous Unicode characters

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

{
"conversationId": "4a86c40e-e627-4454-b158-889680e23ad3",
"endpoint": "openAI",
"title": "Troubleshooting Python Virtual Environment Activation Issue",
"exportAt": "13:18:04 GMT-0400 (Eastern Daylight Time)",
"branches": true,
"recursive": true,
"options": {
"presetId": null,
"model": "gpt-4-turbo",
"chatGptLabel": "Software Engineer",
"promptPrefix": "You are an expert software engineer.",
"temperature": 0.8,
"top_p": 1,
"presence_penalty": 0,
"frequency_penalty": 0,
"resendFiles": true,
"imageDetail": "auto",
"endpoint": "openAI",
"title": "Troubleshooting Python Virtual Environment Activation Issue"
},
"messagesTree": [
{
"_id": "66326f3f04bed94b7f5be68d",
"messageId": "9501f99d-9bbb-40cb-bbb2-16d79aeceb72",
"__v": 0,
"conversationId": "4a86c40e-e627-4454-b158-889680e23ad3",
"createdAt": "2024-05-01T16:35:11.530Z",
"endpoint": "openAI",
"error": false,
"isCreatedByUser": true,
"isEdited": false,
"model": null,
"parentMessageId": "00000000-0000-0000-0000-000000000000",
"sender": "User",
"text": "How do I use source venv/bin/activate?\nbash: venv/bin/activate: No such file or directory",
"tokenCount": 59,
"unfinished": false,
"updatedAt": "2024-05-01T16:35:39.114Z",
"user": "64d4f005d73ef522e1f48818",
"children": [
{
"_id": "66326f4004bed94b7f5be699",
"messageId": "4c395510-fdfd-4556-b034-f9440f025e91",
"__v": 0,
"conversationId": "4a86c40e-e627-4454-b158-889680e23ad3",
"createdAt": "2024-05-01T16:35:12.604Z",
"error": false,
"isCreatedByUser": false,
"isEdited": false,
"model": "gpt-4-turbo",
"parentMessageId": "9501f99d-9bbb-40cb-bbb2-16d79aeceb72",
"sender": "Software Engineer",
"text": "It looks like you're trying to activate a Python virtual environment but encountering an issue because the system cannot find the `activate` script in the `venv/bin/` directory. This typically happens if the virtual environment has not been created yet or if the path specified is incorrect. Here are a few steps to troubleshoot and resolve this issue:\n\n1. **Check if the Virtual Environment Exists**:\n Ensure that the virtual environment directory (`venv`) exists in your current directory (`~/denis-libre`). You can check this by listing the directories:\n\n ```bash\n ls -l\n ```\n\n Look for `venv` in the output. If it's not there, you'll need to create it.\n\n2. **Create the Virtual Environment**:\n If the virtual environment does not exist, you can create one by using the following command:\n\n ```bash\n python3 -m venv venv\n ```\n\n This command creates a new virtual environment named `venv` in your current directory.\n\n3. **Activate the Virtual Environment**:\n Once you have confirmed that the `venv` directory exists, try activating the virtual environment again:\n\n ```bash\n source venv/bin/activate\n ```\n\n If you still receive an error, double-check the path. If you are on a Windows system using Git Bash or similar, the path might be `venv\\Scripts\\activate` instead.\n\n4. **Check for Environment Specific Issues**:\n - If you are using a different shell (like `csh` or `fish`), the activation script could be different (e.g., `activate.csh` or `activate.fish`).\n - Ensure theres no typo in your command or path misconfiguration.\n\n5. **Permissions Issue**:\n Make sure you have the necessary permissions to access the `venv` directory and its contents. If not, you might need to modify the permissions:\n\n ```bash\n chmod -R 755 venv\n ```\n\n6. **Using the Correct Python Version**:\n Confirm that you are using the correct version of Python for which the virtual environment is supposed to be set up. Sometimes, using a different version might cause issues.\n\nBy following these steps, you should be able to resolve the issue with activating your Python virtual environment. If the problem persists, there might be a more specific issue with your Python installation or system configuration.",
"unfinished": false,
"updatedAt": "2024-05-01T16:35:39.104Z",
"user": "64d4f005d73ef522e1f48818",
"endpoint": "openAI",
"finish_reason": "stop",
"tokenCount": 504,
"children": [
{
"messageId": "6e4c95ca-fcb1-4869-adc3-b4bcec83a270",
"parentMessageId": "4c395510-fdfd-4556-b034-f9440f025e91",
"conversationId": "4a86c40e-e627-4454-b158-889680e23ad3",
"sender": "User",
"text": "thanks",
"isCreatedByUser": true,
"tokenCount": 5,
"children": [
{
"messageId": "5da2cdce-87f7-46b4-87c5-e8224e5d5125",
"conversationId": "4a86c40e-e627-4454-b158-889680e23ad3",
"parentMessageId": "6e4c95ca-fcb1-4869-adc3-b4bcec83a270",
"isCreatedByUser": false,
"model": "gpt-4-turbo",
"sender": "Software Engineer",
"text": "You're welcome! If you have any more questions or need further assistance, feel free to ask. Good luck with your project!",
"promptTokens": 586,
"endpoint": "openAI",
"finish_reason": "stop",
"children": []
},
{
"messageId": "64ed7568-bdcf-42a9-b34a-73386d4d99dc",
"conversationId": "4a86c40e-e627-4454-b158-889680e23ad3",
"parentMessageId": "6e4c95ca-fcb1-4869-adc3-b4bcec83a270",
"isCreatedByUser": false,
"model": "gpt-4-turbo",
"sender": "Software Engineer",
"text": "You're welcome! If you have any more questions or need further assistance, feel free to ask. Happy coding!",
"promptTokens": 586,
"endpoint": "openAI",
"finish_reason": "stop",
"children": [
{
"messageId": "f82cca6f-7d2b-4fc1-9d5a-636acc137368",
"parentMessageId": "64ed7568-bdcf-42a9-b34a-73386d4d99dc",
"conversationId": "4a86c40e-e627-4454-b158-889680e23ad3",
"sender": "User",
"text": "does coding make you happy",
"isCreatedByUser": true,
"tokenCount": 9,
"children": [
{
"messageId": "ad7b6ec6-aaa4-434c-9188-def6aadbb2bf",
"conversationId": "4a86c40e-e627-4454-b158-889680e23ad3",
"parentMessageId": "f82cca6f-7d2b-4fc1-9d5a-636acc137368",
"isCreatedByUser": false,
"model": "gpt-4-turbo",
"sender": "Software Engineer",
"text": "As a software engineer, coding can indeed be a source of happiness and satisfaction for many professionals in the field. Heres why coding might make someone happy:\n\n1. **Problem Solving**: Coding offers a constant stream of challenges that require problem-solving skills. Solving these problems can be immensely gratifying and can provide a sense of accomplishment.\n\n2. **Creativity**: Writing software is often a creative process, similar to composing music or painting. Developers can express themselves through their code, which can be a fulfilling experience.\n\n3. **Continuous Learning**: The tech field is always evolving, offering endless opportunities to learn new languages, tools, and techniques. For many, this continuous learning keeps the job exciting and engaging.\n\n4. **Impact**: Software engineers often work on applications that impact the lives of millions of people. Knowing that your work is helping others can be a powerful source of happiness.\n\n5. **Community**: The coding community is known for its collaboration and sharing of knowledge through platforms like GitHub, Stack Overflow, and various forums. Being a part of this community can provide a sense of belonging and support.\n\n6. **Career Opportunities**: Coding skills are in high demand, which can lead to job security, good salaries, and the opportunity to work in a variety of industries. This can contribute to overall life satisfaction and stability.\n\nHowever, like any job, coding can also be stressful at times. Deadlines, bugs, difficult problems, and other challenges can cause frustration. The key is to find a balance, continue learning, and choose projects that align with your interests and values. If these elements are in place, coding can indeed be a very happy career choice.",
"promptTokens": 622,
"endpoint": "openAI",
"finish_reason": "stop",
"children": []
}
]
}
]
}
]
},
{
"messageId": "d3e12088-962e-42ce-900d-edd6816acae5",
"parentMessageId": "4c395510-fdfd-4556-b034-f9440f025e91",
"conversationId": "4a86c40e-e627-4454-b158-889680e23ad3",
"sender": "User",
"text": "lol",
"isCreatedByUser": true,
"tokenCount": 5,
"children": [
{
"messageId": "1f062c99-ff0a-4cf4-a1cf-7150261a24e2",
"conversationId": "4a86c40e-e627-4454-b158-889680e23ad3",
"parentMessageId": "d3e12088-962e-42ce-900d-edd6816acae5",
"isCreatedByUser": false,
"model": "gpt-4-turbo",
"sender": "Software Engineer",
"text": "It looks like you might have been amused or found something funny about the situation! If you have any specific questions or need further help with your virtual environment setup or anything else related to software engineering, feel free to ask!",
"promptTokens": 586,
"endpoint": "openAI",
"finish_reason": "stop",
"children": []
}
]
}
]
}
]
}
]
}