This course focuses on computational modeling of linguistic structures, primarily with respect to LLMs and other language models.
LIN 205C this quarter will cover things related to finite state machines (FSM), finite state transducers (FST), and general theories of computation as it relates to language input and output. There is a heavy focus on the development and training of LLMs both in practice and 'under the hood' with emphasis on certain probabilistic and weighted connections between states. Other topics include classification, naive Bayes, and neural language models.