All skills
llmfit-advisor
Detects your RAM, CPU and GPU, then recommends local LLM models with quantization and speed estimates.
- Part of AlexsJones/llmfit
- 28 installs
- Machine Learning · Local inference
More Local inference skills
See all- llama-cpp86Runs local GGUF models with llama.cpp and finds models on Hugging Face.
- kermt-infer12Runs predictions on a SMILES CSV using a fine-tuned KERMT checkpoint.
- ollama2Deploys and serves local models with Ollama and exposes an OpenAI-compatible endpoint to apps and agents.
- llamafile1Guides you through building, running, testing and debugging llamafile, including its patch workflow and llama.cpp updates.