Designing chat experiences
An LLM-powered chat experience comes in a few flavors: a straight chat-only experience, such as OpenAI’s chat UI, or a chat window that is part of a more extensive GUI experience. Each has unique issues, and both have a collection of issues to address. A traditional chat-only experience is an excellent place to start.
Chat-only experiences
Many, if not most, readers will have this use case: a conversational experience backed with a ChatGPT solution. It might support a traditional conversational AI platform (Salesforce, Oracle’s Digital Assistant, Alexa, Google Assistant, or one of the dozens of other vendors) or eventually replace them. However, the primary interaction is via a chat window with chat responses. This means the channel SMS (text messaging), WhatsApp, WeChat, Facebook, LinkedIn, a web experience, Slack, Teams, or other services depend on the technology those channels support for integrations, backend services, security, and...