Prompting: Better Ways of Using Language Models for NLP Tasks

A review of recent advances in prompting in large language models.

Prompting: Better Ways of Using Language Models for NLP Tasks

A prompt is a piece of text inserted in the input examples, so that the original task can be formulated as a (masked) language modeling problem. For example, say we want to classify the sentiment of the movie review "No reason to watch", we can append a prompt "It was" to the sentence, getting No reason to watch. It was ____". It is natural to expect a higher probability from the language model to generate "terrible" than “great”. This piece reviews of recent advances in prompts in large language models.

Continue Reading ->