LLMR
From MaRDI portal
Description
One interface to many large language model providers: a single configuration object and a single calling function serve chat and embedding models alike, so research code does not change when the provider does. The same calls scale to multi-model and multi-condition studies. Small open models can also run on the user's computer through 'llama.cpp', downloaded only on request, with access to next-token probabilities.
This page was built for software: LLMR