Autonomous Intelligence

Tau - The Autonomous, Understanding robot

This is Tau! Tau is inspired by Pi.AI and if you havent tried Pi yet, I strongly encourage you to try. Like Pi, Tau's conversation is on continual conversation, unlike Chat based bots which feature many conversations and threads. This is by design - Tau has a single conversation, like speaking to a human. This is reflected by consulting Tau in decisions made along development: Order of features, voice type, etc.

Tau is a personal fun project. I opened it as an open source for anyone to experiment with (fork), or just follow. (A star is appreciated!) If you fork - delete history and facts to reset their knowledge and embark the journey anew!

Update status

• System Prompt: Speech-actions speak conversation structure.
• Conversation loop: A continueous conversation with ongoing context.
• Immediate memory: Reduce context by summarizing it to key points. Inject memory to System prompt.
• Long term memory: Save the running memory to vector database.
• Speech: Voice based conversation with hearing and speaking. (Whisper and OpenAI TTS)
• Vision infra: Set up Hailo-8L as an internal vision webservice.
  • Setup Hailo-8L on Raspberry Pi, validate examples work.
  • Look for best practices and options for integrating Hailo in your application.
  • Find a suitable, working architecture to wrap hailo as a service
  • Implement and improve the wrapper
  • Pending Hailo review (update, will be integrates as community-examples, confirmed by Hailo)
  • Integrate in the system, allow Tau to recognize faces
  • add more-than-one models to be used serially, or use different devices (Coral, Sony AI Camera x2, Jetson)
• Long term fetching: Pull from long term memory into context.
• Auto-start on device startup.
• Long term memory archiving support.
• Entity based memory: Add GraphRAG based memory.
  • Learn about GraphRAG, how to implement, et