rtemis.llm
From MaRDI portal
Rtemis.llm
Description
Unified interface for creating LLM and Agent objects, generating responses and performing batch inference based on a type-checked and validated 'S7' backend. Features reasoning, structured output, memory management, and tool use. Supports 'Ollama' <https://docs.ollama.com/api>, 'OpenAI'-compatible <https://developers.openai.com/api/reference/overview>, and 'Anthropic'-compatible <https://platform.claude.com/docs/en/api/getting-started> endpoints. Runs Apple's on-device 'Foundation Models' through the 'rtemis-afm' bridge <https://github.com/rtemis-org/rtemis-afm>.
This page was built for software: rtemis.llm
