Deduplicate Lines
AI / AgentRemove duplicate lines from text — exact, case-insensitive, trimmed, or normalized matching. Useful for RAG dedup.
deduplicatededuplinesuniqueragchunks
Related tools
Rerank ChunksScore and rerank text chunks by relevance to a query using TF-IDF. Drop irrelevant chunks before LLM context.AI / AgentChunk TextSplit documents into overlapping chunks for RAG pipelines — by sentence, paragraph, or fixed size with configurable overlap.AI / AgentKeyword ExtractorExtract top keywords and phrases from text using TF-IDF scoring — useful for tagging, indexing, and RAG metadata.AI / Agent