“I just wanted to share my joy really—and offer thanks for the information available on this and some similar Reddits.” - This is a sign of how reciprocation may occur between the community’s repositories of information and those who take it to build something.
While the OP initially limits what they share to the implementation details of their local home voice assistant, comments encouraged OP to share the scripts they wrote, which led to the GitHub link being updated in the original post.
Bro, link the source! Seriously though, a lot of us have been working, or wanting to work on, something similar. I have a Lenovo Bluetooth speakers sitting right next to me for this very purpose, but I’ve been a little stymied by all the layers of glue code needed; partially because my environment is ubuntu inside proxmox, so the bluetooth device needs to be exposed to the VM, and then recognized by linux. I’ve had whisper running, text-generation-webui, etc, but getting it all glued together has proven a challenge. A guide or a repo or even a bulletted list would be a great gift to the community and could make for a great weekend project for many of us!
In fact, OP updates the post three times, the first being the GitHub repository link, the second adding Oobabooga API support, and the third update that the repository is “reasonably usable”.
One comment is on another commenter’s experiment that is similar to OP’s and shares one function that they added, which is letting the LLM use tools to look up things online. Another comment is similar, but they actually share their repository of the work, asking OP to try it and report bugs if they find any. Third similar example is whether OP has tried saving past conversations as memories as embeddings, and the OP replies that they indeed have. They share the way they implemented this, which seems to have been helpful to the person who asked the question.
Others ask specific details like what TTS model OP used, what the “cheap teleconferencing device that has a bluetooth speaker” is… etc.