LLM-powered chatbots, like OpenAI’s ChatGPT, have not gained widespread popularity yet due to several challenges. These challenges include the lack of an AI strategy, limited data, privacy/security concerns, the context window, prompt engineering, and prompt injections. Businesses are interested in training LLMs with their own data to develop domain-specific chatbots.

source update: Building LLM Products is Hard – These are the 6 Key Challenges