Thread Reader
Amit Shekhar

Amit Shekhar
@amitiitbhu

Sep 18
2 tweets
Tweet

9 use cases for Jev (System 1 Model): - Re-ranking: Score and reorder retrieved results by relevance. - Tool pruning: Drop unused tools during context compaction. - Model routing: Route tasks to small, medium, or large LLMs. - Query routing: Decide between SQL, Vector DB, or Graph DB. - Cache admission: Filter which responses are worth caching. - Cache TTL prediction: Estimate how long cached results stay valid. - RAG retrieval control: Gate irrelevant retrieved documents. - Human escalation: Know when to hand off from AI to a human. - Action selection: Score and pick the best next agent action.

9 use cases for Jev (System 1 Model) in Real-Time Voice AI Agent: x.com/amitiitbhu/sta
9 use cases for Jev (System 1 Model) in Real-Time Voice AI Agent: - Turn detection: Decide whether the user has finished speaking. - Barge-in detection: Detect whether incoming speech is a real interruption or just a backchannel. - Intent classification: Identify the user's intent from the conversation. - Agent routing: Route the conversation to the right specialized agent. - Human escalation: Decide when the conversation should be handed off to a human. - Confirmation detection: Decide whether a sensitive or ambiguous action needs confirmation. - Tool selection: Decide which tool or API should be invoked next. - Response verification: Check whether an LLM response is safe and appropriate to speak. - Conversation state: Determine the next state or action in a voice conversation.
Amit Shekhar

Amit Shekhar

@amitiitbhu
Founder @ Outcome School | Teaching AI, ML & Software Engineering | Open Source | IIT 2010-14 | @outcome_school
Follow on 𝕏
Missing some tweets in this thread? Or failed to load images or videos? You can try to .