UT Austin LIN 313:
Language and Computers
Fall 2025

A humanist introduction to computational linguistics and natural language processing

Instructor: Gabriella Chronis (she/her)
Email: gsc685@my.utexas.edu
Meeting times: MWF 12:00pm-1:00pm
Location: RLP 1.104
Office hours: Wednesday, 2-3pm
Office: RLP 4th floor - East Cubicles

TA: Sooji Lee
TA Email: sl55878@my.utexas.edu
TA Office Hours: Tuesday 9:30-10:30am, Thursday 2-3pm
TA Office: RLP 4th floor - East Cubicles

Course Summary

What is ChatGPT doing under the hood? How do Large Language Models work? What are they capable of? What are their potential pitfalls and even dangers? In this course, Our goal will be to gain a high-level understanding of contemporary language technologies. Through critical inquiry, example-based learning, and hands-on investigation, we will find insight into the fundamentals of how computers are used to represent, process, and produce natural language text and speech. We will cover the theory and practice of human language technology. Topics include statistical (pre neural networks) language models, vector semantics, machine learning for classification, AI and education, and other topics determined by student interest. By the second half of the semester, armed with the basic principles of text processing, we will be ready to tackle LLMs. Class Project: Throughout the semester, we will work towards building our own classification dataset and use this dataset to train and evaluate a model for a task we design together.

This is NOT a coding course. There are NO math pre-requisites; we will cover the basics in probability and linear algebra that the course requires. (Linear algebra is just arithmetic with batches of numbers at a time). We will pay special attention to the human side of language technologies: the pragmatics of interaction, the relation between culture and language.

However, the course goes beyond merely using AI systems. It emphasizes analysis and reasoning to draw and argue for valid conclusions about the design, capabilities and behavior of natural language systems. A foundation of computational and logical thinking skills is invaluable for understanding the human side of technologies. Demystifying AI is the first step in understanding ourselves to be subjects capable of transforming a world increasingly saturated with AI, rather than just consumers of AI. Therefore, assignments and assessments are designed to build basic skills in formal and computational analysis. The course philosophy is to ground abstract concepts in real world examples. Evaluation will be based on the midterm, homeworks, participation, and discussion questions.

Before the flag system was abolished, this class had a quantitative reasoning flag. However, this is no longer a strict requirement. If you want to read ten books and write a research paper about the environmental and economic impacts of building AI data centers in Texas, (or build a program to rewrite song lyrics based on craigslist ads), go for it! I will support self-guided projects as best I can. Together, we can figure out a plan to measure progress towards a goal you want to work towards.

Learning Outcomes

By the end of this course, students will be able to:

  • You will be able to explain what kinds of problems have to be solved in order for computers to do useful things with language. In order to train a computer to perform a human language task, we first have to understand something about how human language works and what kinds of problems need to be solved.
  • You will learn how to approach tasks from a computational perspective. This is not a programming class, but through class exercises and homework, you will gain experience thinking like a computer scientist and about how a computer scientist would go about solving problems in human language.
  • You will gain insight into the technology that underlies a wide variety of human language technologies, from spell checkers to search engines to dialogue systems.
  • You will gain experience thinking about data. Data science is one of the fastest growing fields for graduating college students. Throughout this class, we will think about the nature of experiments and data.
  • You will gain a better understanding of the ethical considerations around work in computational linguistics. We will spend time not just on the primary research, but on thinking about the higher-order ethical and practical considerations that impact computational linguistics as a field.

Important Links

Readings

Readings will draw from various sources. Everything will be digitally available through Canvas, the UT library, or this website. We will draw pretty heavily from two books in particular.

  • Artificial Intelligence: A Guide for Humans (Farrar Girou, & Strauss 2019) by cognitive scientist Melanie Mitchell (Santa Fe Institute). A very accessible, math-free introduction to AI that doesn't shy away from the details. Published just shy of the LLM era, it's a prescient foretelling of what was to come. It grounds the discourse around the present 'AI Spring' in a century of boom and bust cycles and connects today's questions to long-running debates about the nature of human intelligence.
  • Speech and Language Processing By Dan Jurafsky and James Martin (UC Boulder). The current gold standard NLP textbook. This text is written for computer science students. It is dense, and gets technical at times. Therefore, where Mitchell covers a topic I will assign that chapter instead, (but I'll still link you to J&M for optional further reading. Note: Make sure you use the copy I link you to which is the most up to date draft of 3rd edition.

The 'math free' Mitchell isn't dumbed down–it's deeper. Mitchell's ability to explain technical topics without resorting to esoteric symbols and formalisms is rare and invaluable. The more you (as a student) are able to explain technical topics in terms of concrete examples and experience, the stronger the foundation of intuition you build, and the better you are set up for creative reasoning about those topics. Use the mitchell to understand what is happening. Use J&M for nuts and bolts.

Course Schedule

***The schedule changes frequently. Check this page regularly for updates.***

Unit 1: Language as Information

Date Before Class Topic
Week 1: Math, grammar, and dramatic social transformation walk into a bar
Mon 8/25 Naive Bayes for sentiment classification (slides) (handout)
Wed 8/27 Syllabus
Golden Gate Claude (3 mins)
Video: How do you like them owls? Subliminal Messaging LLMs (15 mins)
Optional: original blog post
Optional: take the owl quiz!
Course introduction & developing a thematics (handout)
Fri 8/29 Crash Blossoms (5 mins)
Elaine Rich, Alan Kaylor Cline Reasoning: an introduction to Logic, Sets, Functions: Chapter 7.2 (specifically 7.2.2, 7.2.3, 7.2.5, 7.2.7, 7.2.8)
Syntax, semantics, and ambiguity (slides)
Week 2: Linguistic Fundamentals
Mon 9/1 Labor Day - No Class
Wed 9/3 Mitchell, Prologue & Ch. 1 "The Roots of Information" (focus on Ch. 1) (on Canvas) Why is AI so obsessed with language? (slides)
Fri 9/5 Limits of the symbolic approach (slides)
Week 3: What the #%!@& is a language model anyway
Mon 9/8 Video: probability (Day 1 review)
Conditional probability
(Same notebook with prompt questions answered)
Introduction to N-gram Language Models (slides) (dice roller) (handout)
Wed 9/10 Reading from Jurafsky & Martin: pp. 1-10
Optional: Finish Jurafsky Chapter. Note that it gets technical!
Optional video: Anna Potapenko, Undersanding N-gram models
N-gram models continued (slides) (conditional dice)
Fri 9/12 Homework 1 Due
Jurafsky & Martin 2.3 "Corpora" (pp. 16-17)
Optional video: The Strange Math that Predicts (almost) anything
Building and testing our own N-Gram Model (N-gram Generator) (slides)

Unit 2: Meaning & Classification

Date Before Class Topic
Week 4: Signs & Society
Mon 9/15 Courtney Handman, 2025. "The Chatbot's True Self"
Social Annotations in Canvas with Perusall
Paper Discussion (handout)
Wed 9/17 Video: Tom Scott, The Hidden Rules of Conversation
Elaine Rich and Alan Kline. Reasoning. Chapter 7.3 (pp. 31-37, 40-41)
Semiotics & Discourse: The features of conversation (slides)
Fri 9/19 Anthropic Blog. "Mapping the Mind of a Large Large Language Model" (10 mins)
Optional: Interactive LLM Feature Browser
Optional: Visual Feature Activation Atlas (for an image classifier)
Semiotics & Discourse II: The unwritten rules of conversation (slides)
Week 5: Text Classification
Mon 9/22 DBM Ch. 5.1-5.5 Classifying documents (pp. 127-140) Features and Machine Learning Classification (slides)
Wed 9/24 Submit your text for the class corpus
DBM 5.5 (pp. (140-145) Especially Under the hood 9
Naive Bayes Again (and/or: classification in the wild) (slides)
Fri 9/26 Bring your ideas to class!
Video: Precision & Recall (5mins)
Optional: A Visual Introduction to Machine Learning (Part 1)
Optional: A Visual Introduction to Machine Learning (Part 2)
Optional Video: The Geometry of Changing Beliefs (15 mins)
Machine Learning Evaluation; Brainstorming class classification project (slides)
Week 6: Data
Mon 9/29 Homework 2 due
Inter-annotator agreement (slides) (handout) (classifier ideas)
Wed 10/1 Round 1 Data annotation for class project (slides) (handout [same as Mon])
Fri 10/3 Kate Crawford and Trevor Paglen. 2019. "Excavating AI"
Social Annotations in Canvas with Perusall
Discussion: Excavating AI

Unit 3: Neural Networks & Deep Learning

Date Before Class Topic
Week 7: Neural Networks
Mon 10/6 Workshop on class project; Submit Round 1 Annotations
(handout) (classifier ideas)
Wed 10/8 Mitchell, Ch. 1 pp 24-32 (Perceptrons) (on Canvas)
J&M 5.0-5.2 (please do look at this, but don't worry about understanding the details!)
Vectors; The Perceptron/Logistic Regression (slides) (slides-annotated)
Fri 10/10 Video: ChatGPT is made from 100 milion of these [The Perceptron](25 minutes) How Neural Networks Learn; The Perceptron Trick (slides) (slides-annotated)
Week 8: Deep Learning
Mon 10/13 Video: The Curly Fry Conundrum (10 mins) Training a Neural Network (slides)
Wed 10/15 Mitchell Ch. 2: Neural Networks and the Ascent of Machine Learning (on Canvas)
Homework 3 Due
Multi-layer Perceptrons; Backpropagation intuition (slides)
Fri 10/17 In Class: Round 2 Annotations
Week 9: Midterm
Mon 10/20 Review (practice)
Wed 10/22 Studyyy Midterm
Fri 10/24 In Class: More Round 2 Annotations

Unit 4: Large Language Models & Society

Date Before Class Topic
Week 10: Word Embeddings
Mon 10/27 Mitchell Ch. 11: Words, and the company they keep (through 'The semantic space of words')
J&M 6.0-6.3 (pp. 101-110)
Word Vectors, a.k.a Distributional Semantic Space (slides)
Jupyter notebook: "Distributional Semantics"
Wed 10/29 J&M 6.4 (optionally, through the end of the chapter)
Complete Round 2 Annotations on Label Studio
Word Vectors II - Distance, Near Neighbors, Word2Vec (slides)
Fri 10/31 Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings Exploring Semantic Space (slides) (handout) (Colab Notebook)
Week 11: Transformers and Large Language Models
Mon 11/3 Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings
Social Annotations in Canvas with Perusall
Discussion: Bias in Word Embeddings (exploring implicit associations)
Wed 11/5 Video: Transformers, the tech behind LLMs (25 mins) From BERT to GPT-3: The Transformer Revolution (slides)
Fri 11/7
Attention Part 2: Polysemy and Contextual Embeddings (slides)
Week 12: "Strong AI": Sentience, Intention, and other definitions
Mon 11/10 Optional: Mitchell, Ch. 8, "Rewards for Robots" (on Canvas) The 'Chat' in ChatGPT: Reinforcement learning with human feedback (slides)
Wed 11/12 Mitchell, Ch. 3 "AI Spring" (on Canvas) The Turing Test, The Chinese Room Argument (slides)
Fri 11/14 Mitchell, Ch. 14 "On Understanding" (on Canvas) Do LLMs understand language? (slides)
Week 13: TBD by student interest
Mon 11/17 Optional: Mitchell, Ch. 15 "Knowledge, Abstraction, and Analogy in Artificial Intelligence" (on Canvas) Testing for generalization, programming generalization: embers of autoregression, RAG and Chain of Thought (slides)
Wed 11/19 Lab: probing LLMs for symbolic reasoning (handout)
Thurs 11/20 Homework 4 Due at noon
Fri 11/21 Interpretability Part 1: Feature Theory and Structuralism (slides)
Week 14: Fall Break - No Class
Tues 11/25 Complete Round 3 Annotations in Google Sheets (Instructions) Fall Break - No Class
Week 15: Looking Forward
Mon 12/1 Optional Video: The Dark Matter of AI [Mechanistic Interpretability] (strongly encouraged but you don't need to understand the technical details) Annotation Results; Intepretability Part 2: Sparse Autoencoders (slides)
Wed 12/3 Sherry Turkle, 2024. "Who Do We Become When We Talk to Machines?"
Social Annotations in Canvas with Perusall
Discussion: Human-AI Interaction
Fri 12/5 Lab: Final evaluations for classifier
(Exam Practice Questions)

Finals Week

Date Before Class Topic
Week 16: Finals Week
Mon 12/8 Final evaluations for classifier due in Canvas Final Reflections & Course Wrap-up
Wed 12/10 No class: optional Review session / office hourse (in classroom)
Thurs 12/11 Final Exam 1pm-3pm RLP 1.104

Grading Breakdown

Your final grade will be based on the following components. There will be ample opportunity throughout the semester to get extra credit in different ways: adding to the online discussion, attending some of the many AI talks that happen on campus, or working on an independent project.

Assessment Points Description
Assignments 180 Assignments synthesize quantitative topics with critical reflection.
Class Project 50 Help build our state-of-the-art [?]-classifier
Midterm Exam 100 In-class exam over Units 1-3
Final Exam 100 Cumulative exam focusing on Unit 4 and synthesis
Participation & Quizzes 70 Class participation, attendance, discussion posts, quizzes
Total 500

University Policies

Academic Integrity

Each student in the course is expected to abide by the University of Texas Honor Code: "As a student of The University of Texas at Austin, I shall abide by the core values of the University and uphold academic integrity." Plagiarism is taken very seriously at UT. Therefore, if you use words or ideas that are not your own (or that you have used in previous class), you must cite your sources. Otherwise you will be guilty of plagiarism and subject to academic disciplinary action, including failure of the course. You are responsible for understanding UT's Academic Honesty and the University Honor Code which can be found at the following web address: https://deanofstudents.utexas.edu/conduct/standardsofconduct.php

Sharing of Course Materials is Prohibited

No materials used in this class, including, but not limited to, lecture hand-outs, videos, assessments (quizzes, exams, papers, projects, homework assignments), in-class materials, review sheets, and additional problem sets, may be shared online or with anyone outside of the class unless you have my explicit, written permission. Unauthorized sharing of materials promotes cheating. It is a violation of the University's Student Honor Code and an act of academic dishonesty. I am well aware of the sites used for sharing materials, and any materials found online that are associated with you, or any suspected unauthorized sharing of materials, will be reported to Student Conduct and Academic Integrity in the Office of the Dean of Students. These reports can result in sanctions, including failure in the course.

Notice about missed work due to religious holy days

A student who misses an examination, work assignment, or other project due to the observance of a religious holy day will be given an opportunity to complete the work missed within a reasonable time after the absence, provided that he or she has properly notified the instructor. It is the policy of the University of Texas at Austin that the student must notify the instructor at least fourteen days prior to the classes scheduled on dates he or she will be absent to observe a religious holy day. For religious holy days that fall within the first two weeks of the semester, the notice should be given on the first day of the semester. The student will not be penalized for these excused absences, but the instructor may appropriately respond if the student fails to complete satisfactorily the missed assignment or examination within a reasonable time after the excused absence.

FERPA and Class Recordings

Class recordings are reserved only for students in this class for educational purposes and are protected under FERPA. The recordings should not be shared outside the class in any form. Violation of this restriction by a student could lead to Student Misconduct proceedings.

Academic dishonesty policy

You are encouraged to discuss assignments with classmates. But all written work must be your own. Students caught cheating will automatically fail the course. If in doubt, ask the instructor.

Student Support Services

Services for Students with Disabilities

The university is committed to creating an accessible and inclusive learning environment consistent with university policy and federal and state law. Please let me know if you experience any barriers to learning so I can work with you to ensure you have equal opportunity to participate fully in this course. If you are a student with a disability, or think you may have a disability, and need accommodations please contact Services for Students with Disabilities (SSD). Please refer to SSD's website for contact and more information: http://diversity.utexas.edu/disability/. If you are already registered with SSD, please deliver your Accommodation Letter to me as early as possible in the semester so we can discuss your approved accommodations and needs in this course.

Counseling and Mental Health Center

The Counseling and Mental Health Center serves UT's diverse campus community by providing high quality, innovative and culturally informed mental health programs and services that enhance and support students' well-being, academic and life goals. To learn more about your counseling and mental health options, call CMHC at (512) 471-3515.

If you are experiencing a mental health crisis, call the CMHC Crisis Line 24/7 at (512) 471-2255.

The Sanger Learning Center

Did you know that more than one-third of UT undergraduate students use the Sanger Learning Center each year to improve their academic performance? All students are welcome to take advantage of Sanger Center's classes and workshops, private learning specialist appointments, peer academic coaching, and tutoring for more than 70 courses in 15 different subject areas. For more information, please visit http://www.utexas.edu/ugs/slc or call 512-471-3614 (JES A332).

Additional Resources