UT Austin LIN 313:
Language and Computers
Fall 2025
A humanist introduction to computational linguistics and natural language processing
Instructor: Gabriella Chronis (she/her)
Email: gsc685@my.utexas.edu
Meeting times: MWF 12:00pm-1:00pm
Location: RLP 1.104
Office hours: Wednesday, 2-3pm
Office: RLP 4th floor - East Cubicles
TA: Sooji Lee
TA Email: sl55878@my.utexas.edu
TA Office Hours: Tuesday 9:30-10:30am, Thursday 2-3pm
TA Office: RLP 4th floor - East Cubicles
Course Summary
What is ChatGPT doing under the hood? How do Large Language Models work? What are they capable of? What are their potential pitfalls and even dangers? In this course, Our goal will be to gain a high-level understanding of contemporary language technologies. Through critical inquiry, example-based learning, and hands-on investigation, we will find insight into the fundamentals of how computers are used to represent, process, and produce natural language text and speech. We will cover the theory and practice of human language technology. Topics include statistical (pre neural networks) language models, vector semantics, machine learning for classification, AI and education, and other topics determined by student interest. By the second half of the semester, armed with the basic principles of text processing, we will be ready to tackle LLMs. Class Project: Throughout the semester, we will work towards building our own classification dataset and use this dataset to train and evaluate a model for a task we design together.
This is NOT a coding course. There are NO math pre-requisites; we will cover the basics in probability and linear algebra that the course requires. (Linear algebra is just arithmetic with batches of numbers at a time). We will pay special attention to the human side of language technologies: the pragmatics of interaction, the relation between culture and language.
However, the course goes beyond merely using AI systems. It emphasizes analysis and reasoning to draw and argue for valid conclusions about the design, capabilities and behavior of natural language systems. A foundation of computational and logical thinking skills is invaluable for understanding the human side of technologies. Demystifying AI is the first step in understanding ourselves to be subjects capable of transforming a world increasingly saturated with AI, rather than just consumers of AI. Therefore, assignments and assessments are designed to build basic skills in formal and computational analysis. The course philosophy is to ground abstract concepts in real world examples. Evaluation will be based on the midterm, homeworks, participation, and discussion questions.
Before the flag system was abolished, this class had a quantitative reasoning flag. However, this is no longer a strict requirement. If you want to read ten books and write a research paper about the environmental and economic impacts of building AI data centers in Texas, (or build a program to rewrite song lyrics based on craigslist ads), go for it! I will support self-guided projects as best I can. Together, we can figure out a plan to measure progress towards a goal you want to work towards.
Learning Outcomes
By the end of this course, students will be able to:
- You will be able to explain what kinds of problems have to be solved in order for computers to do useful things with language. In order to train a computer to perform a human language task, we first have to understand something about how human language works and what kinds of problems need to be solved.
- You will learn how to approach tasks from a computational perspective. This is not a programming class, but through class exercises and homework, you will gain experience thinking like a computer scientist and about how a computer scientist would go about solving problems in human language.
- You will gain insight into the technology that underlies a wide variety of human language technologies, from spell checkers to search engines to dialogue systems.
- You will gain experience thinking about data. Data science is one of the fastest growing fields for graduating college students. Throughout this class, we will think about the nature of experiments and data.
- You will gain a better understanding of the ethical considerations around work in computational linguistics. We will spend time not just on the primary research, but on thinking about the higher-order ethical and practical considerations that impact computational linguistics as a field.
Important Links
Readings
Readings will draw from various sources. Everything will be digitally available through Canvas, the UT library, or this website. We will draw pretty heavily from two books in particular.
- Artificial Intelligence: A Guide for Humans (Farrar Girou, & Strauss 2019) by cognitive scientist Melanie Mitchell (Santa Fe Institute). A very accessible, math-free introduction to AI that doesn't shy away from the details. Published just shy of the LLM era, it's a prescient foretelling of what was to come. It grounds the discourse around the present 'AI Spring' in a century of boom and bust cycles and connects today's questions to long-running debates about the nature of human intelligence.
- Speech and Language Processing By Dan Jurafsky and James Martin (UC Boulder). The current gold standard NLP textbook. This text is written for computer science students. It is dense, and gets technical at times. Therefore, where Mitchell covers a topic I will assign that chapter instead, (but I'll still link you to J&M for optional further reading. Note: Make sure you use the copy I link you to which is the most up to date draft of 3rd edition.
The 'math free' Mitchell isn't dumbed down–it's deeper. Mitchell's ability to explain technical topics without resorting to esoteric symbols and formalisms is rare and invaluable. The more you (as a student) are able to explain technical topics in terms of concrete examples and experience, the stronger the foundation of intuition you build, and the better you are set up for creative reasoning about those topics. Use the mitchell to understand what is happening. Use J&M for nuts and bolts.
Course Schedule
***The schedule changes frequently. Check this page regularly for updates.***
Unit 1: Language as Information
| Date | Before Class | Topic |
|---|---|---|
| Week 1: Math, grammar, and dramatic social transformation walk into a bar | ||
| Mon 8/25 | Naive Bayes for sentiment classification (slides) (handout) | |
| Wed 8/27 |
Syllabus Golden Gate Claude (3 mins) Video: How do you like them owls? Subliminal Messaging LLMs (15 mins) Optional: original blog post Optional: take the owl quiz! |
Course introduction & developing a thematics (handout) |
| Fri 8/29 | Crash Blossoms (5 mins) Elaine Rich, Alan Kaylor Cline Reasoning: an introduction to Logic, Sets, Functions: Chapter 7.2 (specifically 7.2.2, 7.2.3, 7.2.5, 7.2.7, 7.2.8) |
Syntax, semantics, and ambiguity (slides) |
| Week 2: Linguistic Fundamentals | ||
| Mon 9/1 | Labor Day - No Class | |
| Wed 9/3 | Mitchell, Prologue & Ch. 1 "The Roots of Information" (focus on Ch. 1) (on Canvas) | Why is AI so obsessed with language? (slides) |
| Fri 9/5 | Limits of the symbolic approach (slides) | |
| Week 3: What the #%!@& is a language model anyway | ||
| Mon 9/8 | Video: probability (Day 1 review) Conditional probability (Same notebook with prompt questions answered) | Introduction to N-gram Language Models (slides) (dice roller) (handout) |
| Wed 9/10 | Reading from Jurafsky & Martin: pp. 1-10 Optional: Finish Jurafsky Chapter. Note that it gets technical! Optional video: Anna Potapenko, Undersanding N-gram models | N-gram models continued (slides) (conditional dice) |
| Fri 9/12 |
Homework 1 Due Jurafsky & Martin 2.3 "Corpora" (pp. 16-17) Optional video: The Strange Math that Predicts (almost) anything |
Building and testing our own N-Gram Model (N-gram Generator) (slides) |
Unit 2: Meaning & Classification
Unit 3: Neural Networks & Deep Learning
| Date | Before Class | Topic |
|---|---|---|
| Week 7: Neural Networks | ||
| Mon 10/6 |
Workshop on class project; Submit Round 1 Annotations (handout) (classifier ideas) |
|
| Wed 10/8 | Mitchell, Ch. 1 pp 24-32 (Perceptrons) (on Canvas) J&M 5.0-5.2 (please do look at this, but don't worry about understanding the details!) |
Vectors; The Perceptron/Logistic Regression (slides) (slides-annotated) |
| Fri 10/10 | Video: ChatGPT is made from 100 milion of these [The Perceptron](25 minutes) | How Neural Networks Learn; The Perceptron Trick (slides) (slides-annotated) |
| Week 8: Deep Learning | ||
| Mon 10/13 | Video: The Curly Fry Conundrum (10 mins) | Training a Neural Network (slides) |
| Wed 10/15 |
Mitchell Ch. 2: Neural Networks and the Ascent of Machine Learning (on Canvas) Homework 3 Due |
Multi-layer Perceptrons; Backpropagation intuition (slides) |
| Fri 10/17 | In Class: Round 2 Annotations | |
| Week 9: Midterm | ||
| Mon 10/20 | Review (practice) | |
| Wed 10/22 | Studyyy | Midterm |
| Fri 10/24 | In Class: More Round 2 Annotations | |
Unit 4: Large Language Models & Society
| Date | Before Class | Topic | |
|---|---|---|---|
| Week 10: Word Embeddings | |||
| Mon 10/27 |
Mitchell Ch. 11: Words, and the company they keep (through 'The semantic space of words') J&M 6.0-6.3 (pp. 101-110) |
Word Vectors, a.k.a Distributional Semantic Space (slides) Jupyter notebook: "Distributional Semantics" |
|
| Wed 10/29 |
J&M 6.4 (optionally, through the end of the chapter) Complete Round 2 Annotations on Label Studio |
Word Vectors II - Distance, Near Neighbors, Word2Vec (slides) | |
| Fri 10/31 | Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings | Exploring Semantic Space (slides) (handout) (Colab Notebook) | |
| Week 11: Transformers and Large Language Models | |||
| Mon 11/3 | Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings Social Annotations in Canvas with Perusall |
Discussion: Bias in Word Embeddings (exploring implicit associations) | |
| Wed 11/5 | Video: Transformers, the tech behind LLMs (25 mins) | From BERT to GPT-3: The Transformer Revolution (slides) | |
| Fri 11/7 |
Attention Part 2: Polysemy and Contextual Embeddings (slides) |
||
| Week 12: "Strong AI": Sentience, Intention, and other definitions | |||
| Mon 11/10 | Optional: Mitchell, Ch. 8, "Rewards for Robots" (on Canvas) | The 'Chat' in ChatGPT: Reinforcement learning with human feedback (slides) | |
| Wed 11/12 | Mitchell, Ch. 3 "AI Spring" (on Canvas) | The Turing Test, The Chinese Room Argument (slides) | |
| Fri 11/14 | Mitchell, Ch. 14 "On Understanding" (on Canvas) | Do LLMs understand language? (slides) | |
| Week 13: TBD by student interest | |||
| Mon 11/17 | Optional: Mitchell, Ch. 15 "Knowledge, Abstraction, and Analogy in Artificial Intelligence" (on Canvas) | Testing for generalization, programming generalization: embers of autoregression, RAG and Chain of Thought (slides) | |
| Wed 11/19 | Lab: probing LLMs for symbolic reasoning (handout) | Thurs 11/20 | Homework 4 Due at noon |
| Fri 11/21 | Interpretability Part 1: Feature Theory and Structuralism (slides) | ||
| Week 14: Fall Break - No Class | |||
| Tues 11/25 | Complete Round 3 Annotations in Google Sheets (Instructions) | Fall Break - No Class | |
| Week 15: Looking Forward | |||
| Mon 12/1 | Optional Video: The Dark Matter of AI [Mechanistic Interpretability] (strongly encouraged but you don't need to understand the technical details) | Annotation Results; Intepretability Part 2: Sparse Autoencoders (slides) | |
| Wed 12/3 | Sherry Turkle, 2024. "Who Do We Become When We Talk to Machines?" Social Annotations in Canvas with Perusall |
Discussion: Human-AI Interaction | |
| Fri 12/5 | Lab: Final evaluations for classifier (Exam Practice Questions) |
||
Finals Week
| Date | Before Class | Topic |
|---|---|---|
| Week 16: Finals Week | ||
| Mon 12/8 | Final evaluations for classifier due in Canvas | Final Reflections & Course Wrap-up |
| Wed 12/10 | No class: optional Review session / office hourse (in classroom) | |
| Thurs 12/11 | Final Exam 1pm-3pm RLP 1.104 | |
Grading Breakdown
Your final grade will be based on the following components. There will be ample opportunity throughout the semester to get extra credit in different ways: adding to the online discussion, attending some of the many AI talks that happen on campus, or working on an independent project.
| Assessment | Points | Description |
|---|---|---|
| Assignments | 180 | Assignments synthesize quantitative topics with critical reflection. |
| Class Project | 50 | Help build our state-of-the-art [?]-classifier |
| Midterm Exam | 100 | In-class exam over Units 1-3 |
| Final Exam | 100 | Cumulative exam focusing on Unit 4 and synthesis |
| Participation & Quizzes | 70 | Class participation, attendance, discussion posts, quizzes |
| Total | 500 |
University Policies
Academic Integrity
Each student in the course is expected to abide by the University of Texas Honor Code: "As a student of The University of Texas at Austin, I shall abide by the core values of the University and uphold academic integrity." Plagiarism is taken very seriously at UT. Therefore, if you use words or ideas that are not your own (or that you have used in previous class), you must cite your sources. Otherwise you will be guilty of plagiarism and subject to academic disciplinary action, including failure of the course. You are responsible for understanding UT's Academic Honesty and the University Honor Code which can be found at the following web address: https://deanofstudents.utexas.edu/conduct/standardsofconduct.php
Sharing of Course Materials is Prohibited
No materials used in this class, including, but not limited to, lecture hand-outs, videos, assessments (quizzes, exams, papers, projects, homework assignments), in-class materials, review sheets, and additional problem sets, may be shared online or with anyone outside of the class unless you have my explicit, written permission. Unauthorized sharing of materials promotes cheating. It is a violation of the University's Student Honor Code and an act of academic dishonesty. I am well aware of the sites used for sharing materials, and any materials found online that are associated with you, or any suspected unauthorized sharing of materials, will be reported to Student Conduct and Academic Integrity in the Office of the Dean of Students. These reports can result in sanctions, including failure in the course.
Notice about missed work due to religious holy days
A student who misses an examination, work assignment, or other project due to the observance of a religious holy day will be given an opportunity to complete the work missed within a reasonable time after the absence, provided that he or she has properly notified the instructor. It is the policy of the University of Texas at Austin that the student must notify the instructor at least fourteen days prior to the classes scheduled on dates he or she will be absent to observe a religious holy day. For religious holy days that fall within the first two weeks of the semester, the notice should be given on the first day of the semester. The student will not be penalized for these excused absences, but the instructor may appropriately respond if the student fails to complete satisfactorily the missed assignment or examination within a reasonable time after the excused absence.
FERPA and Class Recordings
Class recordings are reserved only for students in this class for educational purposes and are protected under FERPA. The recordings should not be shared outside the class in any form. Violation of this restriction by a student could lead to Student Misconduct proceedings.
Academic dishonesty policy
You are encouraged to discuss assignments with classmates. But all written work must be your own. Students caught cheating will automatically fail the course. If in doubt, ask the instructor.
Student Support Services
Services for Students with Disabilities
The university is committed to creating an accessible and inclusive learning environment consistent with university policy and federal and state law. Please let me know if you experience any barriers to learning so I can work with you to ensure you have equal opportunity to participate fully in this course. If you are a student with a disability, or think you may have a disability, and need accommodations please contact Services for Students with Disabilities (SSD). Please refer to SSD's website for contact and more information: http://diversity.utexas.edu/disability/. If you are already registered with SSD, please deliver your Accommodation Letter to me as early as possible in the semester so we can discuss your approved accommodations and needs in this course.
Counseling and Mental Health Center
The Counseling and Mental Health Center serves UT's diverse campus community by providing high quality, innovative and culturally informed mental health programs and services that enhance and support students' well-being, academic and life goals. To learn more about your counseling and mental health options, call CMHC at (512) 471-3515.
If you are experiencing a mental health crisis, call the CMHC Crisis Line 24/7 at (512) 471-2255.
The Sanger Learning Center
Did you know that more than one-third of UT undergraduate students use the Sanger Learning Center each year to improve their academic performance? All students are welcome to take advantage of Sanger Center's classes and workshops, private learning specialist appointments, peer academic coaching, and tutoring for more than 70 courses in 15 different subject areas. For more information, please visit http://www.utexas.edu/ugs/slc or call 512-471-3614 (JES A332).
Additional Resources
- Undergraduate Writing Center: http://uwc.utexas.edu/
- Libraries: http://www.lib.utexas.edu/
- ITS: http://www.utexas.edu/its/
- Emergency Services: http://deanofstudents.utexas.edu/emergency/