Tags: Bert MethodMultilingual vs. Monolingual BERTDevlin et al. (2019) produced 2 BERT models, for English and Chinese. To support other languages, they trained a multilingual BERT (mBERT)8months ago (04-10)View 33commentMethodBERT Benchmarks in Large Pre-trained Language ModelsAn integral part involved in developing various PLMs is providing NLU multitask benchmarks used to demonstrate the linguistic abilities of new models and approaches8months ago (04-10)View 37commentBlogAn Introduction to Mask Bert Inputs for Text ClassificationIn NLP, we do not mask any input embeddings for Bert in text classifcation task. However, in paper: Spelling Error Correction with Soft-Masked BERT proposed...2years ago (2022-06-07)View 37commentBlogIncorporating Extra Features for Bert Inputs in NLPIn this article, we will introduce a method to incorporate extra featrues into bert inputs to improve the performance of NLP task.2years ago (2022-04-24)View 25commentBlogEvaluating Sentence Similarity Using BertScoreIn this article, we will introduce a new metric for sentence similarity - BertScore, which has better performance than cosine similarity.2years ago (2022-04-12)View 28commentBlogAn Introduction to Fine-tune Bert to Create Specific Vector in Few-Shot LearningIn this article, we will introduce how to generate specific vector by fine-tuning bert in few-shot learning.2years ago (2022-03-14)View 32commentBlogConcentrate Target and Text for Text Classification in BertWe can input a text sequence to bert model for classification. However, if this text sequence has a target text or object, how to use...2years ago (2022-03-03)View 31commentBlogDoes Bert or ELMo Representation Encode Syntax Information?In this article, we can find representation generated from Bert or ELMo can encode syntax information.2years ago (2022-03-02)View 44commentBlogBeginner Guide to Use Bert for Multi-task LearningThis tutorial will discuss how to use bert model for multi-task learning. You can build your custom model from this post.2years ago (2021-12-29)View 22commentBlogAn Introduction to Bert Combine Multiple Features to ClassificationBert is widely used in text classification, However, Bert only can extract text feature from a text sequence. If you have other features, how to...2years ago (2021-12-02)View 28comment Load More
