Blog

LLMs have some serious limitations that constrain their usefulness for real-world applications. To overcome these limitations, AI researchers have proposed a new type of AI system architecture called Modular Reasoning, Knowledge and Language (MRKL).

Researchers are exploring how to combine LLMs with neurosymbolic methods that incorporate logical reasoning and structure.

When designing BloombergGPT, a new large language model optimized for financial data, the researchers at Bloomberg made an important decision around tokenization.

When designing BloombergGPT, a new large language model optimized for financial data, the researchers at Bloomberg made an important decision around tokenization.

What is Tokenization? Let's Explore, Using Novel AI's New Tokenizer as a Use Case

Researchers have developed a benchmark called the LAMBADA dataset to rigorously test how well AI models can leverage broader discourse context when predicting an upcoming word.

AI research from 2019 explored how to automatically generate reasonable suggestions for missing sections of text.

In 2019, researchers explored how artificial intelligence could use hierarchical models to improve computer-generated stories.

Books may seem like straightforward stories, but researchers are finding fascinating mathematical patterns hidden in the text.

Researchers developed a tool called Storywrangler that leveraged Twitter data to create an "instrument for understanding our world through the lens of social media."

A 2016 study analyzed over a thousand stories to uncover the basic emotional arcs that form the building blocks of narratives.

New research explores how integrating structured knowledge into AI systems can enhance storytelling abilities.

New research from Stanford University demonstrates how "emotion maps" could improve story generation.

While machine translation has improved dramatically for major languages, quality translation still lags for thousands of smaller languages.

Data analysis often involves exploring data to unearth insights, then crafting stories to communicate those findings. But converting discoveries into coherent narratives poses challenges. Researchers have developed an AI assistant called Notable that streamlines data storytelling.

Back in 2018, researchers from Facebook AI developed a new method to improve story generation through hierarchical modeling. Their approach mimics how people plan out narratives.

New research from the University of California, Berkeley sheds light on one slice of these models' knowledge: which books they have "read" and memorized. The study uncovers systematic biases in what texts AI systems know most about.

Retrieval-augmented generation (RAG) systems learn to retrieve and incorporate external knowledge when generating text.

The researchers found that optimizing the AI for direct human preferences significantly boosted performance compared to just training it to mimic reference summaries.

LLMs struggle with logical reasoning and decision-making when tackling complex real-world problems. Researchers propose an approach called ReAct that interleaves reasoning steps with actions to address this accuracy problem.