Date
Publisher
arXiv
Large language models show promise for embodying historical characters in dialogue systems, but existing approaches face a critical trade-off: simple retrieval-augmented generation produces shallow responses, while multi-stage reflection achieves depth at prohibitive latency. We present an architecture that resolves this tension through offline data augmentation and efficient parallel retrieval from structured episodic memory. Our system transforms biographical data into 1,774 enriched first-person memories with affective-semantic metadata, then employs two-stage retrieval achieving 0.52s prompt generation. Evaluation using LLM-as-judge and RAGAs metrics shows our approach achieves parity with traditional RAG on GPT-4 while significantly outperforming it on smaller models (GPT-3.5, GPT-3), suggesting particular value for resource-constrained deployments. Beyond dialogue, the structured memory enables novel visualization tools: spatiotemporal heatmaps, emotional trajectory analysis, and interactive path tracking, positioning the system as both a dialogue interface and research tool for biographical analysis. We use Van Gogh as a test case, but the architecture is generalizable to any historical figure with substantial textual records, offering a practical framework for educational, museum, and research applications requiring both accuracy and efficiency
Study at a glance
- Question: Can offline memory augmentation and parallel retrieval create fast, accurate historical AI characters on smaller models?
- Setting and data: 1,774 biographical memories of Vincent van Gogh (1853-1890) from a 976-page biography and 863 letters; 93 test questions.
- Method: System development and model benchmarking using LLM-as-a-judge and automated retrieval-augmented generation evaluation metrics (RAGAs).
Why it matters
AI character systems for historical figures struggle with a trade-off between shallow responses from simple retrieval and slow, expensive responses from multi-stage reflection, limiting real-time educational and museum deployment.
Key findings
- The system achieved an average prompt generation time of 0.52 seconds while operating within a strict 2,000-token budget.
- The structured episodic architecture matched traditional retrieval on GPT-4 but significantly outperformed it on smaller models such as GPT-3.5 and GPT-3.
- The architecture produced superior faithfulness scores across all tested models, including an advantage of +0.15 on GPT-4 and +0.17 on GPT-3 over standard retrieval.
Summary drafted with AI from the full paper and may contain errors. See the full paper for details.
What is the application?
Who age?
Why use AI?
Study design
