Fast, local, open-source alternative to Perplexity AI in Rust. Mainly to receive feedback.
Some suggestions from the commenters:
- Provide a docker container
- Adjust the number of search results that the application takes
- OP is praised for making the search depth customizable so that the output does not rest upon only the first few hits, and suggested to have the LLM prioritize results and increase search depth when it is needed
- Support for search engines that aren’t Bing
- Using Python
- Interesting comment sharing their own Perplexity clone, asking to see if performance differs a lot from OP’s Rust implementation.
- Add ability to review the 5-10 generated queries (search-oriented, based on user query) sent to search engine
- This kind of reminds me that sometimes, the whole point of these projects is the ability to get access to more information and more granular control over behavior.
- What if instead of vector search, you just let the LLM context handle it?
- Add UI for less techy people using Tauri, a UI library for Rust
Again, this is very much something that could go under spc.