"OpenAI rival Cohere launches language model API". Apparently this company was started by the original inventors of the "transformer" neural network model. The "transformer" is the neural network that has the "attention" mechanism, which is used by neural networks to do translation between languages. The "attention" mechanism enables the neural network to pay "attention" to words somewhere else in the input sequence, for example paying "attention" to the antecedent of a pronoun when encountering a pronoun so it gets translated correctly. The "attention" system enables transformers to translate between languages that have different word order. Now, transformers are used for a lot more including outside natural language processing, for example vision transformers. But the original creators are still focused on natural language.

"Unlike some of its competitors, Cohere offers two types of English natural language processing models, generation and representation, in languages that include Large, Medium, Small. The generation models can complete tasks involving generating text -- for example, writing product descriptions or extracting document metadata. By contrast, the representational models are about understanding language, driving apps like semantic search, chatbots, and sentiment analysis."

OpenAI rival Cohere launches language model API

#solidstatelife #ai #nlp