Skip to content

LLM Engine

What is LLM Engine?

LLM Engine is an extensible service for deploying and developing assistive interactive agents in multi-modal, intentional conversations, both online and hybrid.

✅ LLM Engine intentionally supports events and educational settings

✅ LLM Engine connects to a variety of familiar and novel conversational frontend clients.

✅ LLM Engine can be used as a backend for production agent deployments or for the development and evaluation of new agents.

✅ LLM Engine support deploying LLMs in multi-user, multi-turn environments. To our knowledge, it is the only extensible service that does so!

✅ LLM Engine is at its heart a flexible conversational messaging platform with easy integration of LLM agents to evaluate, respond and contribute.

🚀 Watch this demo video to see it in action!

Who is LLM Engine for?

👤 Teachers and online or hybrid event hosts who want to enhance their events with LLM agents to better achieve their goals.

🛠️ Developers and evaluators of LLM agents for online and hybrid events and conversations.

Production Agents

LLM Engine comes with three tested agents that are ready for use in your events or classrooms*.

✅ Back Channel Insights Agent - Synthesizes private messages sent by event participants into actionable insights for a moderator

✅ Back Channel Metrics Agent -Aggregates quick event participant reactions into metrics sent to a moderator

✅ Event Assistant - Answers questions related to an event in real-time or asynchronously, using the event transcript and/or conversation history

Supported Clients

While any front end client could use our APIs, we specifically support the following:

✅ Nextspace

✅ Zoom (audio and chat, including DMs)

Supported LLM Platforms and Models

LLM Engine works with a variety of LLM platforms and models:

✅ OpenAI - any model

✅ Claude - any model

✅ AWS Bedrock - any model

✅ Open Source Models - most models

See our installation guide for more information.

Installing

To install and try out LLM Engine please see our installation guide and usage guide.

Development

Developers can find additional technical documentation in our guide for developers.

Code repository

LLM Engine is open source! You can find our Github repository at https://github.com/berkmancenter/llm_engine.

Credits

LLM Engine is a project of the Applied Social Media Lab at Harvard University.