The Impact Of New Language Model Architectures