moinsen / Software historyDE ↗
← 2018

Event

BERT untersucht Sprachkontext

Context and research status
  • Kennung: 2018-bert
  • Zeitraum: Oktober–November 2018
  • Datumsgenauigkeit: Monat / month
  • Art: Forschung und Softwarefreigabe / research and software release
  • Kategorien: Sprachen und Techniken, Ereignisse
  • Akteure und Rollen: Jacob Devlin, Ming-Wei Chang, Kenton Lee und Kristina Toutanova: Forschung; Google: Forschungsorganisation
  • Region: International

In 2018 a research team introduced BERT, a pretrained model based on the Transformer architecture for language-understanding tasks. Its word representations use context from both directions. One pretraining task predicted masked text from its surrounding context; the model could then be fine-tuned for specific tasks. Google announced the release of code and pretrained models in November. Source

According to Google, the models initially released in November 2018 were English-only. In October 2019 the company described a separate application of BERT models in its search engine: for ranking, it expected improved understanding of about one in ten English-language searches in the US. This was a company claim at the time, not a worldwide success rate. Research release and Search announcement

Sources

Offen

Unabhängige Untersuchungen zur tatsächlichen Wirkung auf Suchergebnisse und zu weiteren Sprachen prüfen. / Investigate independent evidence about actual effects on search results and additional languages.