Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Deduplicate memories existing by external sources #1297

Merged
merged 5 commits into from
Dec 14, 2024
Merged

Deduplicate memories existing by external sources #1297

merged 5 commits into from
Dec 14, 2024

Conversation

Josh-XT
Copy link
Owner

@Josh-XT Josh-XT commented Dec 14, 2024

This pull request includes a significant update to the agixt/Memories.py file, specifically enhancing the write_text_to_memory function to handle duplicate content from external sources. The most important changes are:

Enhancements to duplicate content handling:

  • Added logic to check for duplicates from external sources such as files or URLs. If a duplicate is found, the existing content from that source is deleted before writing the new content. This ensures that the memory does not contain redundant information.

@Josh-XT Josh-XT changed the title Implement File Existence Check and Automatic Overwrite in Memory Deduplicate memories existing by external sources Dec 14, 2024
@Josh-XT Josh-XT marked this pull request as ready for review December 14, 2024 21:53
@Josh-XT Josh-XT merged commit e3b5eca into main Dec 14, 2024
7 checks passed
@Josh-XT Josh-XT deleted the issue-1296 branch December 14, 2024 22:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant