This course aims to explore cutting-edge research topics surrounding pre-trained language models, covering their technical foundations, pre-training and post-training techniques, efficiency, fine-tuning and adaptation, etc.