{"id":144,"date":"2020-10-28T07:46:11","date_gmt":"2020-10-28T06:46:11","guid":{"rendered":"https:\/\/user.phil.hhu.de\/ehren\/?page_id=144"},"modified":"2021-04-20T09:15:53","modified_gmt":"2021-04-20T07:15:53","slug":"vector-semantics-winter-2020-21","status":"publish","type":"page","link":"https:\/\/user.phil.hhu.de\/ehren\/vector-semantics-winter-2020-21\/","title":{"rendered":"Vector Semantics &#8211; Winter 2020\/21"},"content":{"rendered":"\n<h3>Course Material<\/h3>\n<ol>\n<li>Course Info: <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/6cugJYwfYTTNanU\" target=\"_blank\" rel=\"noopener noreferrer\">Screencast<\/a>, <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/hOvP6w5sgxcLvon\" target=\"_blank\" rel=\"noopener noreferrer\">Slides<\/a><\/li>\n<li>Basics: <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/gfv0NsMz6ymwLYy\" target=\"_blank\" rel=\"noopener noreferrer\">Screencast<\/a>, <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/k8F14J8ib0jPeYj\" target=\"_blank\" rel=\"noopener noreferrer\">Slides<\/a><\/li>\n<li>Linear Algebra I: <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/h101cghOb4NoCca\" target=\"_blank\" rel=\"noopener noreferrer\">Screencast<\/a>, <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/PqyQPqk9aBHxWb8\" target=\"_blank\" rel=\"noopener noreferrer\">Slides<\/a>, <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/azkhBT5q4E4k6gp\" target=\"_blank\" rel=\"noopener noreferrer\">Homework 1<\/a><\/li>\n<li>Linear Algebra II: <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/WPSSRHeIhmOWXkx\" target=\"_blank\" rel=\"noopener noreferrer\">Screencast<\/a>, <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/yfZ4fpoZ3IPvhzK\" target=\"_blank\" rel=\"noopener noreferrer\">Slides<\/a>, <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/sJHkxFcLrnUlbmw\" target=\"_blank\" rel=\"noopener noreferrer\">Homework 2<\/a> , <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/TICaOQrqUcNv3hR\" target=\"_blank\" rel=\"noopener noreferrer\">Solutions to homework 1 (as a notebook)<\/a>, <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/MNtuRtCaIeUeAIl\" target=\"_blank\" rel=\"noopener noreferrer\">Notebook on linear transformations<\/a>, <a href=\"https:\/\/www.youtube.com\/watch?v=U93RImC-by4\" target=\"_blank\" rel=\"noopener noreferrer\">Linear Transformations and Video Games<\/a><\/li>\n<li>Building Distributional Models: <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/QtlEmMi3aqwfiLi\" target=\"_blank\" rel=\"noopener noreferrer\">Screencast<\/a>, <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/4rNuR0BUWtsw7md\" target=\"_blank\" rel=\"noopener noreferrer\">Slides<\/a>, <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/4W0PNg8vOFzaBVl\" target=\"_blank\" rel=\"noopener noreferrer\">Homework 3<\/a>, <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/DtqUAL8N2FkAzIF\" target=\"_blank\" rel=\"noopener noreferrer\">Solutions to homework 2 (as a notebook)<\/a><\/li>\n<li>SVD: <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/fFbJYlZ77sgl1ce\" target=\"_blank\" rel=\"noopener noreferrer\">Screencast<\/a>, <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/2Ma4Nvfeu7HpYzA\" target=\"_blank\" rel=\"noopener noreferrer\">Slides<\/a>, Notebooks: <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/whcoHrZHPid9A2u\" target=\"_blank\" rel=\"noopener noreferrer\">Numpy<\/a>, <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/nLuPblQUxjNx7Un\" target=\"_blank\" rel=\"noopener noreferrer\">PCA<\/a>, <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/mW3Jzwa4iPwtveU\" target=\"_blank\" rel=\"noopener noreferrer\">SVD and LSI<\/a><\/li>\n<li>Distributional Memory: <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/rJSgTBvCE2MaceU\" target=\"_blank\" rel=\"noopener noreferrer\">Screencast<\/a>, <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/Jp9geqsiREh9oO1\" target=\"_blank\" rel=\"noopener noreferrer\">Slides<\/a>, <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/JUP3aDMcu5kYSEk\" target=\"_blank\" rel=\"noopener noreferrer\">Homework 4<\/a><\/li>\n<li>Building a Distributional Model (Demo): <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/0mqNRGKBOPPWsl5\" target=\"_blank\" rel=\"noopener noreferrer\">Screencast<\/a>, <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/1sUaRCg2mDeKmKD\" target=\"_blank\" rel=\"noopener noreferrer\">Notebook<\/a>, <a href=\"https:\/\/github.com\/AlexGrinch\/ro_sgns\/blob\/master\/datasets\/rg65.csv\" target=\"_blank\" rel=\"noopener noreferrer\">RG-65 Dataset<\/a>, <a href=\"https:\/\/nlp.stanford.edu\/projects\/glove\/\" target=\"_blank\" rel=\"noopener noreferrer\">Glove Vectors<\/a><\/li>\n<li>Linear Regression: <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/sRK9QllqPqtTUsW\" target=\"_blank\" rel=\"noopener noreferrer\">Screencast I (Theory)<\/a>, <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/mLGA4JLozo1v38R\" target=\"_blank\" rel=\"noopener noreferrer\">Screencast II (Praxis)<\/a>, <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/p5mM3MsUFkbwPLc\" target=\"_blank\" rel=\"noopener noreferrer\">Slides<\/a>, <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/zx3AkGCG8jGSmYl\" target=\"_blank\" rel=\"noopener noreferrer\">Notebook<\/a>, <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/5F2uL3wh1T3WOJp\" target=\"_blank\" rel=\"noopener noreferrer\">Example dataset<\/a>, <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/7l0xh4npOj0vb4x\" target=\"_blank\" rel=\"noopener noreferrer\">Homework 5<\/a><\/li>\n<li>Multivariate Linear Regression\/Logistic Regression: <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/3V8KHHqPOvS8DsD\" target=\"_blank\" rel=\"noopener noreferrer\">Screencast<\/a>, <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/1kFhvMjIPa5v3Ax\" target=\"_blank\" rel=\"noopener noreferrer\">Slides<\/a>, <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/OGrT138KCpLi1Vl\" target=\"_blank\" rel=\"noopener noreferrer\">Homework 6<\/a>, <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/jdFwiWymPLwPK6y\" target=\"_blank\" rel=\"noopener noreferrer\">Solution to ex. 1 of Homework 5<\/a><\/li>\n<li>Neural Nets: <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/tCQf6roc91Ng7XT\" target=\"_blank\" rel=\"noopener noreferrer\">Screencast<\/a>, <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/LykCaNcJPLctJc0\" target=\"_blank\" rel=\"noopener noreferrer\">Slides<\/a>, <a href=\"https:\/\/www.youtube.com\/watch?v=aircAruvnKk\" target=\"_blank\" rel=\"noopener noreferrer\">Video on Neural Nets by 3Blue1Brown<\/a>, <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/QO9Tj6CPdkUafAk\" target=\"_blank\" rel=\"noopener noreferrer\">Homework 7<\/a>, <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/f6h1kTJt8OIBSL6\" target=\"_blank\" rel=\"noopener noreferrer\">Solution to ex. 1 and 4 of Homework 6<\/a>, <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/RRf89i4C5BdJthw\" target=\"_blank\" rel=\"noopener noreferrer\">Notebook on Logistic Regression<\/a>, <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/Vi1znMy5cQE4EoQ\" target=\"_blank\" rel=\"noopener noreferrer\">Screencast on Logistic Regression Notebook<\/a><\/li>\n<li>Word2vec: <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/aUhhw6ShCO4Omj1\" target=\"_blank\" rel=\"noopener noreferrer\">Screencast<\/a>, <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/qpHhvWY6ctDFn99\" target=\"_blank\" rel=\"noopener noreferrer\">Slides<\/a>, <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/TPZIoc9zSdwOrCe\" target=\"_blank\" rel=\"noopener noreferrer\">Solution to ex. 1 of Homework 7<\/a>, <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/LzfYpHtQI9bgIKt\" target=\"_blank\" rel=\"noopener noreferrer\">Homework 8<\/a><\/li>\n<li>Backpropagation: <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/9JNx3ZHNhyQSCPp\" target=\"_blank\" rel=\"noopener noreferrer\">Screencast<\/a>, <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/kJ5CMw7vg3DW0vl\" target=\"_blank\" rel=\"noopener noreferrer\">Slides<\/a> (6 &#8211; 43), <a href=\"https:\/\/www.youtube.com\/watch?v=ANyVpMS3HL4&amp;feature=youtu.be\" target=\"_blank\" rel=\"noopener noreferrer\">Video on derivatives (Khan academy)<\/a>, <a href=\"https:\/\/www.youtube.com\/watch?v=0T0QrHO56qg&amp;feature=youtu.be\" target=\"_blank\" rel=\"noopener noreferrer\">Video on chain rule (Khan academy)<\/a>, <a href=\"https:\/\/www.youtube.com\/watch?v=i94OvYb6noo\" target=\"_blank\" rel=\"noopener noreferrer\">Original Video on Backpropagation<\/a> (Andrej Kaparthy, 1:35 &#8211; 29:00 min), <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/p6taVj1G9yB4Dos\" target=\"_blank\" rel=\"noopener noreferrer\">Homework 9<\/a>, <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/jXjew3O0XCS63kc\" target=\"_blank\" rel=\"noopener noreferrer\">Solution to Homework 8<\/a>, <a href=\"https:\/\/uni-duesseldorf.sciebo.de\/s\/7GlhslxLMieALGf\" target=\"_blank\" rel=\"noopener noreferrer\">Solution to Homework 9<\/a><\/li>\n<\/ol>\n<h3>Errata<\/h3>\n<ul>\n<li>On slides 39 and 40 on Linear Algebra II (lesson 4) it should be <sup>1<\/sup>\u2044<sub>m<\/sub>M<sup>T<\/sup>M and not just M<sup>T<\/sup>M<\/li>\n<li>On slides 16 and 17 on SVD (lesson 6) the calculation of MM<sup>T<\/sup> and M<sup>T<\/sup>M is wrong. The results should be [[3, 2, 2],[2, 3, 1],[2, 1, 2]] and [[3, 2, 2, 1],[2, 2, 1, 1],[2, 1, 2, 0],[1, 1, 0, 1]] respectively.<\/li>\n<\/ul>\n<h3>Communication<\/h3>\n<ul>\n<li><a href=\"https:\/\/rocketchat.hhu.de\/group\/vector_semantics_ws_20-21\" target=\"_blank\" rel=\"noopener noreferrer\">Rocket.Chat-channel<\/a><\/li>\n<li><a href=\"https:\/\/hhu.webex.com\/hhu\/j.php?MTID=mef0d424c07be6f22eee1f33aec89c8e9\" target=\"_blank\" rel=\"noopener noreferrer\">Webex meeting<\/a> (Always Wednesdays 13:30 &#8211; 14:30; the password is the same as for the download of the course materials)<\/li>\n<\/ul>\n<h3>Reading Suggestions<\/h3>\n<ul>\n<li>Jurafsky, Dan &amp; James H Martin. 2017. Speech and language processing. an introduction to natural language processing, computational linguistics and speech recognition. Draft of 3rd edition. (Chapter on Vector Semantics) <a href=\"https:\/\/web.stanford.edu\/~jurafsky\/slp3\/6.pdf\" target=\"_blank\" rel=\"noopener\">[PDF]<\/a><\/li>\n<li>Manning, C., Raghavan, P., &amp; Sch\u00fctze, H. (2010). Introduction to information retrieval. Natural Language Engineering, 16(1), 100-103. (Chapter 6, 14 and 18) <a href=\"https:\/\/nlp.stanford.edu\/IR-book\/pdf\/irbookonlinereading.pdf\" target=\"_blank\" rel=\"noopener\">[PDF]<\/a><\/li>\n<li>Sahlgren, M. (2006). The Word-Space Model: Using distributional analysis to represent syntagmatic and paradigmatic relations between words in high-dimensional vector spaces (Doctoral dissertation). <a href=\"http:\/\/www.diva-portal.org\/smash\/get\/diva2:1041204\/FULLTEXT01.pdf\" target=\"_blank\" rel=\"noopener\">[PDF]<\/a><\/li>\n<li>Turney, P. D., &amp; Pantel, P. (2010). From frequency to meaning: Vector space models of semantics. Journal of artificial intelligence research, 37, 141-188. <a href=\"https:\/\/www.jair.org\/index.php\/jair\/article\/view\/10640\" target=\"_blank\" rel=\"noopener\">[PDF]<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Course Material Course Info: Screencast, Slides Basics: Screencast, Slides Linear Algebra I: Screencast, Slides, Homework 1 Linear Algebra II: Screencast, Slides, Homework 2 , Solutions to homework 1 (as a notebook), Notebook on linear transformations, Linear Transformations and Video Games Building Distributional Models: Screencast, Slides, Homework 3, Solutions to homework 2 (as a notebook) SVD: &hellip; <a href=\"https:\/\/user.phil.hhu.de\/ehren\/vector-semantics-winter-2020-21\/\">Weiterlesen <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":59,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"ngg_post_thumbnail":0},"_links":{"self":[{"href":"https:\/\/user.phil.hhu.de\/ehren\/wp-json\/wp\/v2\/pages\/144"}],"collection":[{"href":"https:\/\/user.phil.hhu.de\/ehren\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/user.phil.hhu.de\/ehren\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/user.phil.hhu.de\/ehren\/wp-json\/wp\/v2\/users\/59"}],"replies":[{"embeddable":true,"href":"https:\/\/user.phil.hhu.de\/ehren\/wp-json\/wp\/v2\/comments?post=144"}],"version-history":[{"count":41,"href":"https:\/\/user.phil.hhu.de\/ehren\/wp-json\/wp\/v2\/pages\/144\/revisions"}],"predecessor-version":[{"id":206,"href":"https:\/\/user.phil.hhu.de\/ehren\/wp-json\/wp\/v2\/pages\/144\/revisions\/206"}],"wp:attachment":[{"href":"https:\/\/user.phil.hhu.de\/ehren\/wp-json\/wp\/v2\/media?parent=144"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}