Wed Jan 10 19:36:32 2024
(*75de6f1e*):: https://cdn.discordapp.com/attachments/997271766302982234/1194540130908766278/korndogo[…]0ad8cc5ad15ef1bf6eb56c27d088478422ced7634002673ac707bdf0e2&
(*6952cd93*):: +public!
(*75de6f1e*):: It really likes the long-haired dudes.. Only Joe was supposed to have long-hair… I can’t really make fun of long-haired dudes and bitcoin but I have my theories.. lolol
(*6952cd93*):: I gotta get a white cowboy hat and that jacket lmaoo
(*71144c1d*):: So I switched from a tiny ancient SATA SSD in my 4060 Ti 16GB box (mostly made up of spare parts I had previously upgraded from on my main system) to a cheapo $31 512GB NVMe. Installed Debian 12, Nvidia drivers, and https://github.com/oobabooga/text-generation-webui on it last night.
That textgen web ui was a PITA, not at all as painless as it was made out to be on that configuration, but holy cow, this is such a huge leap forward from ollama.
*** GitHub – oobabooga/text-generation-webui: A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
*** A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models. – GitHub – oobabooga/text-generation-webui: A Gradio web UI for Large Language Mod…
*** GitHub
(*71144c1d*):: Would anyone be interested in an detailed step-by-step guide that covers this entire setup process, for OS+drivers+webui? Or is everyone here pretty technically comfortable with that kind of stuff?
(*6952cd93*):: I think it would be useful if you felt like writing it up
(*4297a328*):: https://www.getleo.ai/ you think cody has something like this?
*** Leo™ – Generative AI Engineering CAD Design Copilot
*** Leo is the world’s first engineering design copilot, empowering engineers to turn ideas into products in seconds. Leo’s generative AI platform transforms text, sketches, specs, and CAD constraints into DFMA-optimized, full-assembly 3D CAD models.
*** getleo.ai