"Symbolic knowledge distillation" that automates common sense acquisition for AI.

LLMs have some serious limitations that constrain their usefulness for real-world applications. To overcome these limitations, AI researchers have proposed a new type of AI system architecture called Modular Reasoning, Knowledge and Language (MRKL).

Researchers are exploring how to combine LLMs with neurosymbolic methods that incorporate logical reasoning and structure.