llmfit-advisor28 installs
Detects your RAM, CPU and GPU, then recommends local LLM models with quantization and speed estimates.
Finds which local LLM models and quantizations actually run well on your hardware.
Detects your RAM, CPU and GPU, then recommends local LLM models with quantization and speed estimates.