# CS388

https://www.cs.utexas.edu/~gdurrett/courses/sp2024/cs388.shtml

# CS388: Natural Language Processing (Spring 2024)
Instructor: [Greg Durrett](http://cs.utexas.edu/~gdurrett), gdurrett@cs.utexas.edu   
Lecture: Tuesday and Thursday 12:30pm - 1:45pm, GDC 4.302   
Instructor Office Hours: Wednesdays 1:15pm-2:15pm (starting 1/24), Thursdays at 10am (starting 1/18), on Zoom and in GDC 3.812 (hybrid)   
TA: Anisha Gunjal   
TA Office Hours: 
  * Tuesday 3pm, GDC 1st floor TA Desk 4 + on Zoom
  * Wednesday 3pm, on Zoom only


## Description
This class is a graduate-level introduction to Natural Language Processing (NLP), the study of computing systems that can process, understand, or communicate in human language. The course covers fundamental approaches, particularly deep learning and language model pre-training, used across the field of NLP, as well as a comprehensive set of NLP tasks both historical and contemporary. Techniques studied include basic classification techniques, feedforward neural networks, attention mechanisms, pre-trained large language models (BERT-style encoders and GPT-style LLMs), and structured models (sequences, trees, etc.). Problems range from syntax (part-of-speech tagging, parsing) to semantics (lexical semantics, question answering, grounding) and include various applications such as summarization, machine translation, information extraction, and dialogue systems. Programming assignments throughout the semester involve building scalable machine learning systems for various of these NLP tasks. 
**Requirements**
  * 391L - Machine Learning, 343 - Artificial Intelligence, or equivalent AI/ML course experience
  * Familiarity with Python for programming assignments
  * Additional prior exposure to discrete math, probability, linear algebra, optimization, linguistics, and NLP useful but not required 


# [Syllabus [Clickable link with important information about the course policies. The current page you are on is NOT the complete syllabus]](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/syllabus.shtml)
**Assignments:** See syllabus for more details about these. 
**[Project 1: Linear and Neural Sentiment Classification](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/p1.pdf)** [[code and dataset download]](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/p1-distrib.tgz)
**[Project 2: Transformer Language Modeling](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/p2.pdf)** [[code and dataset download]](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/p2-distrib.tgz)
**[Project 3: Dataset Biases](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/p3.pdf)**
**[Final Project](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/fp.pdf)** [[sample 1 (reproduction study by 2 students)]](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/sample-repro-pair.pdf); [[sample 2 (original research by 1 student)]](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/sample-research.pdf)
**Readings:** Textbook readings are assigned to complement the material discussed in lecture. You may find it useful to do these readings before lecture as preparation or after lecture to review, but you are not expected to know everything discussed in the textbook if it isn't covered in lecture. Paper readings are intended to supplement the course material if you are interested in diving deeper on particular topics. **Bold readings and videos** are most central to the course content; it's recommended that you look at these. 
The chief text in this course is [Eisenstein: Natural Language Processing](https://github.com/jacobeisenstein/gt-nlp-class/blob/master/notes/eisenstein-nlp-notes.pdf), available as a free PDF online. For deep learning techniques, this text will be supplemented with selections from [Goldberg: A Primer on Neural Network Models for Natural Language Processing](https://arxiv.org/pdf/1510.00726.pdf). (Another generally useful NLP book is [Jurafsky and Martin: Speech and Language Processing (3rd ed. draft)](https://web.stanford.edu/~jurafsky/slp3/), with many draft chapters available for free online; however, we will not be using it much for this course.)   
  
  
| **Date**  | **Topics**  | **Readings**  | **Assignments**  |  
| --- | --- | --- | --- |  
| Jan 16  |  [Introduction](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec1-1pp.pdf) [[4pp]](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec1-4pp.pdf)  |   | P1 out  |  
| Jan 18  |  [Binary Classification](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec2-1pp.pdf) [[4pp]](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec2-4pp.pdf)  |  [Eisenstein 2.0-2.5, 4.2-4.4.1](https://github.com/jacobeisenstein/gt-nlp-class/blob/master/notes/eisenstein-nlp-notes.pdf)  
[Perceptron and logistic regression](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/perc-lr-connections.pdf)  |   |  
| Jan 23  |  [Multiclass Classification](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec3-1pp.pdf) [[4pp]](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec3-4pp.pdf)  |  [Eisenstein 4.2](https://github.com/jacobeisenstein/gt-nlp-class/blob/master/notes/eisenstein-nlp-notes.pdf)  
[Multiclass lecture note](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/multiclass.pdf)  |   |  
| Jan 25  |  [Neural 1: Feedforward](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec4-1pp.pdf) [[4pp]](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec4-4pp.pdf)  |  [Eisenstein 3.0-3.3](https://github.com/jacobeisenstein/gt-nlp-class/blob/master/notes/eisenstein-nlp-notes.pdf)  
[Botha+17 FFNNs](https://arxiv.org/pdf/1708.00214.pdf)  
[Iyyer+15 DANs](http://cs.umd.edu/~miyyer/pubs/2015_acl_dan.pdf)  
[ffnn_example.py](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/ffnn_example.py)  |   |  
| Jan 30  |  [Neural 2: Word Embeddings, Bias in Embeddings](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec5-1pp.pdf) [[4pp]](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec5-4pp.pdf)  |  [Eisenstein 3.3.4, 14.5-14.6](https://github.com/jacobeisenstein/gt-nlp-class/blob/master/notes/eisenstein-nlp-notes.pdf)  
[Goldberg 5](http://u.cs.biu.ac.il/~yogo/nnlp.pdf)  
[Mikolov+13 word2vec](https://arxiv.org/pdf/1301.3781.pdf)  
[Pennington+14 GloVe](https://nlp.stanford.edu/pubs/glove.pdf)  
[Levy+14 Matrix Factorization](https://levyomer.files.wordpress.com/2014/09/neural-word-embeddings-as-implicit-matrix-factorization.pdf)  
[Grave+17 fastText](https://aclweb.org/anthology/Q17-1010)  
[Burdick+18 Instability](https://aclanthology.org/N18-1190.pdf)  
[Bolukbasi+16 Gender](https://arxiv.org/pdf/1607.06520.pdf)  
[Gonen+19 Debiasing](https://arxiv.org/pdf/1903.03862.pdf)  | P1 due / P2 out  |  
| Feb 1  |  [Neural 3: Language Modeling, Attention](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec6-1pp.pdf) [[4pp]](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec6-4pp.pdf)  |  [Bengio+03 NPLM](https://www.jmlr.org/papers/volume3/bengio03a/bengio03a.pdf)  
[Luong+15 Attention](https://arxiv.org/pdf/1508.04025.pdf)  
[Vaswani+17 Transformers](https://arxiv.org/pdf/1706.03762.pdf)  
[Alammar Illustrated Transformer](https://jalammar.github.io/illustrated-transformer/)  
[PhuongHutter Transformers](https://arxiv.org/pdf/2207.09238.pdf)  |   |  
| Feb 6  |  [Neural 4: Transformers](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec7-1pp.pdf) [[4pp]](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec7-4pp.pdf)  |  [Vaswani+17 Transformers](https://arxiv.org/pdf/1706.03762.pdf)  
[Alammar Illustrated Transformer](https://jalammar.github.io/illustrated-transformer/)  
[Kaplan+20 Scaling Laws](https://arxiv.org/pdf/2001.08361.pdf)  
[Beltagy+20 Longformer](https://arxiv.org/pdf/2004.05150.pdf)  
[Choromanski+21 Performer](https://arxiv.org/pdf/2009.14794.pdf)  
[Tay+20 Efficient Transformers](https://arxiv.org/pdf/2009.06732.pdf)  |   |  
| Feb 8  |  [Pre-training 1: Encoders (BERT), Tokenization](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec8-1pp.pdf) [[4pp]](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec8-4pp.pdf)  |  [Peters+18 ELMo](https://arxiv.org/pdf/1802.05365.pdf)  
[Devlin+19 BERT](https://arxiv.org/abs/1810.04805)  
[Alammar Illustrated BERT](https://jalammar.github.io/illustrated-bert/)  
[Liu+19 RoBERTa](https://arxiv.org/pdf/1907.11692.pdf)  
[Clark+20 ELECTRA](https://arxiv.org/pdf/2003.10555.pdf)  
[He+21 DeBERTa](https://arxiv.org/pdf/2006.03654.pdf)  
[BostromDurrett20 Tokenizers](https://arxiv.org/pdf/2004.03720.pdf)  | FP proposals out  |  
| Feb 13  |  [Pre-training 2: Decoders (GPT/T5), Decoding Methods](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec9-1pp.pdf) [[4pp]](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec9-4pp.pdf)  |  [Raffel+19 T5](https://arxiv.org/pdf/1910.10683.pdf)  
[Lewis+19 BART](https://arxiv.org/pdf/1910.13461.pdf)  
[Radford+19 GPT2](https://cdn.openai.com/better-language-models/language_models_are_unsupervised_multitask_learners.pdf)  
[Brown+20 GPT3](https://arxiv.org/pdf/2005.14165.pdf)  
[Chowdhery+21 PaLM](https://arxiv.org/pdf/2204.02311.pdf)  
[Holtzman+19 Nucleus Sampling](https://arxiv.org/pdf/1904.09751.pdf)  | P2 due  |  
| Feb 15  |  [Evaluation in NLP, Datasets, Dataset Bias, Statistical Significance](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec10-1pp.pdf) [[4pp]](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec10-4pp.pdf)  |  [Wang+19 SuperGLUE](https://arxiv.org/pdf/1905.00537.pdf)  
[BIGBench](https://arxiv.org/pdf/2206.04615.pdf)  
[Gururangan+18 Artifacts](https://arxiv.org/pdf/1803.02324.pdf)  
[McCoy+19 Right](https://arxiv.org/pdf/1902.01007.pdf)  
[Gardner+20 Contrast](https://arxiv.org/pdf/2004.02709.pdf)  
[Swayamdipta+20 Cartography](https://arxiv.org/pdf/2009.10795.pdf)  
[Utama+20 Debiasing](https://arxiv.org/pdf/2009.12303.pdf)  |   |  
| Feb 20  |  [Understanding GPT3 1: Prompting, Interpreting GPT-3](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec11-1pp.pdf) [[4pp]](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec11-4pp.pdf)  |  [Zhao+21 Calibrate Before Use](https://arxiv.org/pdf/2102.09690.pdf)  
[Min+22 Rethinking Demonstrations](https://arxiv.org/pdf/2202.12837.pdf)  
[Gonen+22 Demystifying Prompts](https://arxiv.org/pdf/2212.04037.pdf)  
[Xie+21 ICL as Implicit Bayesian Inference](https://arxiv.org/pdf/2111.02080.pdf)  
[Akyurek+22 ICL regression](https://arxiv.org/pdf/2211.15661.pdf)  
[Olson+22 Induction Heads](https://transformer-circuits.pub/2022/in-context-learning-and-induction-heads/index.html)  | FP proposals due / P3 out  |  
| Feb 22  |  [Understanding GPT3 2: Rationales, Chain-of-thought](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec12-1pp.pdf) [[4pp]](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec12-4pp.pdf)  |  [Camburu+18 e-SNLI](https://arxiv.org/pdf/1812.01193.pdf)  
[Wei+22 CoT](https://arxiv.org/pdf/2201.11903.pdf)  
[YeDurrett22 Unreliability](https://arxiv.org/pdf/2205.03401.pdf)  
[Kojima+22 Step-by-step](https://arxiv.org/pdf/2205.11916.pdf)  
[Gao+22 Program-aided](https://arxiv.org/pdf/2211.10435.pdf)  
[Ye+22 Complementary](https://arxiv.org/pdf/2211.13892.pdf)  
[Ye+23 SatLM](https://arxiv.org/pdf/2305.09656.pdf)  |   |  
| Feb 27  |  [Understanding GPT3 3: Instruction tuning, RL in NLP](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec13-1pp.pdf) [[4pp]](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec13-4pp.pdf)  |  [Sanh+21 T0](https://arxiv.org/pdf/2110.08207.pdf)  
[Liu+21 Prompting](https://arxiv.org/pdf/2107.13586.pdf)  
[Chung+22 Flan-PaLM](https://arxiv.org/pdf/2210.11416.pdf)  
[Ouyang+22 Human Feedback](https://arxiv.org/pdf/2203.02155.pdf)  
[Ramamurthy+22 RL for NLP](https://arxiv.org/pdf/2210.01241.pdf)  
[Rafailov+23 DPO](https://arxiv.org/pdf/2305.18290.pdf)  
[Singhal+23 Length](https://arxiv.org/pdf/2310.03716.pdf)  |   |  
| Feb 29  |  [Interpretability](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec14-1pp.pdf) [[4pp]](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec14-4pp.pdf)  |  [Lipton+16 Mythos](https://arxiv.org/pdf/1606.03490.pdf)  
[Ribeiro+16 LIME](https://arxiv.org/pdf/1602.04938.pdf)  
[Simonyan+13 Visualizing](https://arxiv.org/pdf/1312.6034.pdf)  
[Sundararajan+17 Int Grad](https://arxiv.org/pdf/1703.01365.pdf)  
[Interpretation Tutorial](https://github.com/Eric-Wallace/interpretability-tutorial-emnlp2020)  |   |  
| Mar 5  |  [Sequence Tagging](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec15-1pp.pdf) [[4pp]](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec15-4pp.pdf)  |  [Eisenstein 7, 8](https://github.com/jacobeisenstein/gt-nlp-class/blob/master/notes/eisenstein-nlp-notes.pdf)  
[Manning+11 POS](https://nlp.stanford.edu/~manning/papers/CICLing2011-manning-tagging.pdf)  
[Sutton CRFs 2.3, 2.6.1](http://homepages.inf.ed.ac.uk/csutton/publications/crftut-fnt.pdf)  
[Wallach CRFs](http://www.inference.org.uk/hmw26/papers/crf_intro.pdf)  |   |  
| Mar 7  | No class (Greg traveling)  |   | P3 due  |  
| Mar 12  | NO CLASS  |   |   |  
| Mar 14  | NO CLASS  |   |   |  
| Mar 19  |  [Trees 1: Constituency, PCFGs](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec16-1pp.pdf) [[4pp]](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec16-4pp.pdf)  |  [Eisenstein 10.0-10.5](https://github.com/jacobeisenstein/gt-nlp-class/blob/master/notes/eisenstein-nlp-notes.pdf)  
[JM 12.1-12.6, 12.8](https://web.stanford.edu/~jurafsky/slp3/12.pdf)  
[KleinManning13 Structural](https://people.eecs.berkeley.edu/~klein/papers/unlexicalized-parsing.pdf)  
[Collins97 Lexicalized](http://aclweb.org/anthology/P/P97/P97-1003.pdf)  |   |  
| Mar 21  |  [Trees 2: Dependency, Shift-reduce, State-of-the-art Parsers](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec17-1pp.pdf) [[4pp]](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec17-4pp.pdf)  |  [Eisenstein 11.1-11.3](https://github.com/jacobeisenstein/gt-nlp-class/blob/master/notes/eisenstein-nlp-notes.pdf)  
[JM 13.1-13.3, 13.5](https://web.stanford.edu/~jurafsky/slp3/13.pdf)  
[Dozat+17 Dependency](https://arxiv.org/pdf/1611.01734.pdf)  
[JM 13.4](https://web.stanford.edu/~jurafsky/slp3/13.pdf)  
[Andor+16 Parsey](https://arxiv.org/pdf/1603.06042.pdf)  
[KitaevKlein18](https://www.aclweb.org/anthology/P18-1249.pdf)  
[KitaevKlein20 Linear-time](https://www.aclweb.org/anthology/2020.acl-main.557.pdf)  |   |  
| Mar 26  |  [Apps 1: Question Answering](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec18-1pp.pdf) [[4pp]](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec18-4pp.pdf)  |  [Eisenstein 12](https://github.com/jacobeisenstein/gt-nlp-class/blob/master/notes/eisenstein-nlp-notes.pdf)  
[Chen+17 DrQA](https://arxiv.org/pdf/1704.00051.pdf)  
[Lee+19 Latent Retrieval](https://arxiv.org/pdf/1906.00300.pdf)  
[Guu+20 REALM](https://arxiv.org/pdf/2002.08909.pdf)  
[Kwiatkowski+19 NQ](https://ai.google.com/research/NaturalQuestions)  
[Dua+19 DROP](https://arxiv.org/pdf/1903.00161.pdf)  
[Nakano+21 WebGPT](https://arxiv.org/pdf/2112.09332.pdf)  
[Choi+18 QuAC](https://arxiv.org/pdf/1808.07036.pdf)  |   |  
| Mar 28  |  [Apps 2: Machine Translation](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec19-1pp.pdf) [[4pp]](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec19-4pp.pdf)  |  [Eisenstein 18.1-18.2, 18.4](https://github.com/jacobeisenstein/gt-nlp-class/blob/master/notes/eisenstein-nlp-notes.pdf)  
[Michael Collins IBM Models 1+2](http://www.cs.columbia.edu/~mcollins/courses/nlp2011/notes/ibm12.pdf)  
[JHU slides](http://mt-class.org/jhu/slides/lecture-ibm-model1.pdf)  
[History of MT](https://medium.com/huggingface/a-brief-history-of-machine-translation-paradigms-d5c09d8a5b7e)  
[SennrichZhang19 Low-resource](https://www.aclweb.org/anthology/P19-1021.pdf)  
[Aji+20 Transfer](https://aclanthology.org/2020.acl-main.688.pdf)  
[Liu+20 mBART](https://arxiv.org/pdf/2001.08210.pdf)  
[Kocmi+23 LLMs for Eval](https://arxiv.org/pdf/2302.14520.pdf)  |   |  
| April 2  |  [Apps 3: Language and Code](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec20-1pp.pdf) [[4pp]](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec20-4pp.pdf)  |  [ZettlemoyerCollins05](https://homes.cs.washington.edu/~lsz/papers/zc-uai05.pdf)  
[Berant+13](http://www.aclweb.org/anthology/D13-1160)  
[JiaLiang16 Recomb](https://arxiv.org/pdf/1606.03622.pdf)  
[Wei+20 Type Inference](https://arxiv.org/pdf/2005.02161.pdf)  
[Wang+21 CodeT5](https://arxiv.org/pdf/2109.00859.pdf)  
[Chen+21 Codex](https://arxiv.org/pdf/2107.03374.pdf)  |   |  
| April 4  |  [Efficiency in LLMs: Decoding, Pruning, Training](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec21-1pp.pdf) [[4pp]](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec21-4pp.pdf)  |  [Levaiathan+23 Speculative](https://arxiv.org/pdf/2211.17192.pdf)  
[Medusa Heads (blog)](https://www.together.ai/blog/medusa)  
[Dao+23 Flash Attention](https://arxiv.org/abs/2205.14135)  
[Xia+23 Sheared Llama](https://arxiv.org/abs/2310.06694)  
[Sanh+19 DistilBERT](https://arxiv.org/abs/1910.01108)  
[Hsieh+23 Distill Step-by-Step](https://arxiv.org/abs/2305.02301)  
[Zakan+22 BitFit](https://arxiv.org/abs/2106.10199)  
[Hu+21 LoRA](https://arxiv.org/abs/2106.09685)  
[Dettmers+22 LLM.int8()](https://arxiv.org/abs/2208.07339)  
[Dettmers+23 QLoRA](https://arxiv.org/abs/2305.14314)  | Check-ins due  |  
| April 9  |  [Language grounding](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec22-1pp.pdf) [[4pp]](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec22-4pp.pdf)  |  [Radford+21 CLIP](https://arxiv.org/pdf/2103.00020.pdf)  
[Ahn+22 SayCan](https://arxiv.org/pdf/2204.01691.pdf)  
[Driess+23 PaLM-E](https://arxiv.org/pdf/2303.03378.pdf)  |   |  
| April 11  |  [Morphology / LLM Safety](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec23-1pp.pdf) [[4pp]](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec23-4pp.pdf)  |  [Shen+23 Jailbreaking](https://arxiv.org/abs/2308.03825)  
[Zou+23 Attacks on LLMs](https://arxiv.org/abs/2307.15043)  
[EldanRussinovich23 Unlearning](https://arxiv.org/abs/2310.02238)  
[Mitchell+22 Model Editing](https://arxiv.org/abs/2110.11309)  
[Onoe+23 Challenges in Propagating](https://arxiv.org/abs/2305.01651)  |   |  
| April 16  |  [LLMs, Society, and Ethics of NLP](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec24-1pp.pdf) [[4pp]](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec24-4pp.pdf)  |  [HovySpruit16 Social Impact of NLP](https://www.aclweb.org/anthology/P16-2096.pdf)  
[Zhao+17 Bias Amplification](https://arxiv.org/pdf/1707.09457.pdf)  
[Rudinger+18 Gender Bias in Coref](https://arxiv.org/pdf/1804.09301.pdf)  
[BenderGebru+21 Stochastic Parrots](http://faculty.washington.edu/ebender/papers/Stochastic_Parrots.pdf)  
[Gebru+18 Datasheets for Datasets](https://arxiv.org/pdf/1803.09010.pdf)  
[Raji+20 Auditing](https://dl.acm.org/doi/pdf/10.1145/3351095.3372873)  |   |  
| April 18  | No class (MLL Symposium)  |   |   |  
| April 23  |  [FP presentations 1](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec27-1pp.pdf) [[4pp]](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec27-4pp.pdf)  |   |   |  
| April 25  |  [FP presentations 2](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec28-1pp.pdf) [[4pp]](https://www.cs.utexas.edu/~gdurrett/courses/sp2024/lectures/lec28-4pp.pdf)  |   | FP due May 3  |
