 |
ClassicConnect
"640k ought to be enough for everybody."
|
| View previous topic :: View next topic |
| Author |
Message |
PatoFlamejanteTV
New Member
Joined: 08 May 2026
Posts: 1
|
 Posted: Fri May 08, 2026 1:36 pm Post subject: Can i run an LLM from my Windows 7 Win-To-Go setup? |
 |
|
Currently i want to test Ollama on it, but its installed on a SD Card, its velocity is around ~20MB/s (tested by transferring an large file from my Linux setup to it).
It has 32 GB of storage, but windows only used ~7GB, so there's a plenty of storage yet.
Is possible to use Ollama on it? Or i may need to use an software to path the executable before using? |
|
| Back to top |
|
 |
claraberry
New Member
Joined: 19 Jan 2026
Age: 19
Posts: 6
|
| Posted: Fri May 08, 2026 1:45 pm Post subject: Re: Can i run an LLM from my Windows 7 Win-To-Go setup? |
|
|
| PatoFlamejanteTV wrote: | Currently i want to test Ollama on it, but its installed on a SD Card, its velocity is around ~20MB/s (tested by transferring an large file from my Linux setup to it).
It has 32 GB of storage, but windows only used ~7GB, so there's a plenty of storage yet.
Is possible to use Ollama on it? Or i may need to use an software to path the executable before using? |
You'll probably get abysmal loading times, but there's nothing inherently stopping you if you have the hardware.
_________________
All operating systems suck equally, it is up to you to decide which you get along with the most |
|
| Back to top |
|
|
LyraNovaHeart
Gorts
Joined: 15 Apr 2025
Age: 27
Posts: 50
Location: Los Angeles, California
|
| Posted: Fri May 08, 2026 3:34 pm Post subject: |
|
|
Main limits here would be software support. Barely any LLM software supports Windows 7, only one I know would be Kobold CPP in the old cpu mode. Not to mention, you need a fairly good CPU to get any usable T/s out of it. An i7-3612QM for example, that will run LLama 3.2 3b @ Q4, around 8T/s. MoEs will certainly be helpful, but I wouldn't expect too much out of this. If you do however have something workable, it'll take a long time to load, once it's in RAM though it should be somewhat faster.
_________________
I'm one day closer to being who I wanna be~ |
|
| Back to top |
|
|
|
|
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
|
smartDark Style by Smartor
Powered by phpBB 2.0.25 CC Mod © 2001, 2002 phpBB Group
|
