DEV: Cache summarization strategy results. (#22230)

Updates the interface for implementing summarization strategies and adds a cache layer to summarize topics once.

The cache stores the final summary and each chunk used to build it, which will be useful when we have to extend or rebuild it.
This commit is contained in:
Roman Rizzi
2023-06-27 11:44:34 -03:00
committed by GitHub
parent a909dffe8f
commit f4e7a80600
13 changed files with 332 additions and 41 deletions

View File

@ -27,7 +27,7 @@ class Chat::Api::SummariesController < Chat::ApiController
.map { "#{_1}: #{_2}" }
.join("\n")
render json: { summary: strategy.summarize(content) }
render json: { summary: strategy.summarize(content).dig(:summary) }
end
end
end