Bağlamsal kelime gömmelerinin karakter bilgisi ile zenginleştirilmesi
نام عام مواد
[Thesis]
نام نخستين پديدآور
Polatbilek, Ozan
نام ساير پديدآوران
Tekir, Selma
وضعیت نشر و پخش و غیره
نام ناشر، پخش کننده و غيره
Izmir Institute of Technology (Turkey)
تاریخ نشرو بخش و غیره
2020
يادداشت کلی
متن يادداشت
90 p.
یادداشتهای مربوط به پایان نامه ها
جزئيات پايان نامه و نوع درجه آن
Master's
کسي که مدرک را اعطا کرده
Izmir Institute of Technology (Turkey)
امتياز متن
2020
یادداشتهای مربوط به خلاصه یا چکیده
متن يادداشت
Natural Language Processing has become more and more popular with the recent advances in Artificial Intelligence. Fundamental improvements have been introduced in word representations to store semantic and/or syntactic features. With the recently published language model BERT, contextual word vectors could be generated. This model do not process character level information. In morphologically rich languages such as Turkish, this model's perception of syntax could be improved. In this thesis, a new model, called BERT-ELMo, which is a combination of BERT and ELMo, is proposed to enrich BERT with character level information. This model combines character level processing part of ELMo and contextual word representation part of the BERT model. To show the effectiveness of the proposed model, both quantitative (question answering) and qualitative (word analogy, word contextualization, morphological meaning, out of vocabulary word capturing) analyses are performed and it is compared with BERT on Turkish language. Thanks to character level addition, proposed model is able get trained in any language without any pre-analysis.To the best of our knowledge, this is the first study which uses morphological analysis to train the BERT model in Turkish, and the first model to integrate a character level module to BERT.
اصطلاحهای موضوعی کنترل نشده
اصطلاح موضوعی
Artificial intelligence
اصطلاح موضوعی
Computer engineering
اصطلاح موضوعی
Natural language processing
اصطلاح موضوعی
Neural networks
نام شخص به منزله سر شناسه - (مسئولیت معنوی درجه اول )