Flexible framework for heterogeneous LLM inference
Open Sourceaillminferenceframework
Free
Search AI Tools
#inference
2 results
Run LLMs, vision, voice, image & video models locally
Open Sourceaillminferencelocal
Free