Neural network multiple choice exams

Question

How likely is it to succeed in training neural network (e.g. simple feedforward/backprop multilayer perceptron) to solve multiple choice (text based) questions - and if low likelihood - what would be smarter ways to go (or don't go) about this problem?

Here's more information on the multiple choice exam structure:

• 5 lines of text
• 1/5 answers (1-2 lines of text each) are correct

also some more assumptions:

• results/feedback immediately displayed
• the training data is over 5'000 questions

Answer 1

In my opinion this problem is extremely difficult to solve. Basically, you are trying to teach a neural network to understand a natural language. Obviously, there were many attempts to solve this task but no significant success yet.

This may be possible (but still unlikely) only if exam questions are very simple, highly specialized and have some special common structure.

Also, 5000 questions sample seems pretty small for this task.