AI in a Box

Your own offline, private, open source LLM for conversations and more

Oct 16, 2023

Project update 2 of 5

Real-Time Natural Language Translation Demo

by Laura Jefferson

Greetings backers and subscribers,

I’m very excited to share a video of real-time, on-device translation as mentioned in our last update.

It’s not yet the universal translators in Star Trek, but we’re ecstatic to have achieved this milestone. While quality will vary depending on the robustness of the language’s model, we’ll support on-device translation for the following languages:

I can’t wait to see what interactions this technology will unlock!

On the hardware side, we’ve finished the layout of the expansion board with all the circuitry for the LCD screen, microphone, speaker, and USB emulation. It should be assembled and delivered next week, at which point we’ll start end-to-end testing to work out all the bugs, chief among them, cooling, and microphone interference.

Can’t wait to share more next week. Thanks again for all your support!

Live long and prosper,

Sign up to receive future updates for AI in a Box.

Subscribe to the Crowd Supply newsletter, highlighting the latest creators and projects