bAbI

bAbI Console for Developers

What are the Facebook bAbI AI Tests?

Facebook AI Researchers (FAIR) proposed 20 tasks required to progress the goal of an intelligent dialog agent. Pat has analysed these and applied our Natural Language Understanding (NLU) to an initial four tasks to show progress of a linguistic based approach for intelligent dialog.

Our success in passing these initial four bAbI tests was through the application of our ‘Conversation’ engine which leverages NLU and Patom theory. Patom theory says the smallest unit is a “Patom”. As patterns are bidirectionally linked, the entire pattern including its associations are activated by its parts, and in reverse, the entire pattern activates its parts.

We invite select developers to play in our sandpit here with “Conversation” and “Matching Meaning” to see the results of the content for these successful four tests. We will also share plans for Pat’s language acquisition relating to bAbI content and “real world” knowledge.

How do I use the console?

1. Click below and you will be redirected to the Pat login screen.
Access bAbI Console for Developers

What you’ll find:

Two applications based on Question Answering from the content of the bAbi Tasks 1,6, 9 and 12.

1. Pat Converse


• This allows users to type in any bAbI conversation such as ‘Mary moved to the bathroom. John went to the hallway’ and then ask Pat the question, ‘Where is Mary?’.

• To try question answer, enter sentences from a set from the Tasks 1,6,9,12, hit enter or send and then ask the appropriate bAbI question. After a ‘set’ has been entered, hit ‘New Conversation’ to clear previous content stored by Pat and start with new content of another set.


2. Pat Matching Meaning
• This application shows the the technology behind Pat. It allows users to see how Pat breaks down language by meaning. Pat defines meaning as the dictionary definitions of the words in the sentence, plus other linguistic information defined by RRG such as operators and attributes. It effectively treats sentences as sets of information in which the words in the sentence determine the meaning of the other words in the sentence.

• Under “Enter text to Match”, type a sentence from bAbI content Tasks 1, 6, 9 or 12. Then click ‘Go’ to show results. To see the meaning, hover or drill down on the match results and links as displayed in the screen.

• When using “Sentence” setting versus “Clause”, be sure to use proper punctuation such as periods or question marks.

• By default, Pat uses “Simple” and “Clause” settings to process and display the result. You can change and play around with these settings via Pat Settings.