How Prompt Size Directly Impacts LLM Response Latency
Understanding the mechanics of Time to First Token (TTFT) and why those extra tokens may lead to poor user experience (UX).
Understanding the mechanics of Time to First Token (TTFT) and why those extra tokens may lead to poor user experience (UX).
Our inboxes contain dozens (if not hundreds) of newsletters we subscribed to during moments of curiosity, but we seldom read most of them. Manually unsubscribing is tedious: open each email, scroll to the bottom, click unsubscribe, confirm … repeat 50+ times.
This post covers a personal project developing an AI agent using the ReAct pattern to analyse newsletters I have subscribed to and recommend the ones to unsubscribe based on my reading behaviour.