In this article, we can find representation generated from Bert or ELMo can encode syntax information.