llm-distillery
Use LLMs to distill large texts down to a manageable size by utilizing a map-reduce approach. This ensures that the text fits within a specified token limit,...
Related \\
-
extract-topics
Use LDA (Latent Dirichlet Allocation) to extract topics from text
-
fast-topic-analysis
A tool for analyzing text against predefined topics using average weight embeddings and cosine similarity.
-
k-batch
K-Batch is an intelligent text batching library that uses k-means clustering to group sentences by length for optimal processing. It's particularly useful fo...