MIT software shows how NLP systems are snookered by simple synonyms

Here’s an example of how artificial intelligence can still seriously lack behind some human attributes: tests have shown how natural language processing (NLP) systems can be tricked into misunderstanding text by merely swapping one word for a synonym.

A research team at MIT developed software, called TextFooler, which looked for words which were most crucial to an NLP classifier and replaced them. The team offered an example:

“The characters, cast in impossibly...

Esteemed consortium launch AI natural language processing benchmark

facebook google deepmind nlp consortium ai artificial intelligence natural language processing

A research consortium featuring some of the greatest minds in AI are launching a benchmark to measure natural language processing (NLP) abilities.

The consortium includes Google DeepMind, Facebook AI, New York University, and the University of Washington. Each of the consortium’s members believe a more comprehensive benchmark is needed for NLP than current solutions.

The result is a benchmarking platform called SuperGLUE which replaces an older platform called GLUE...