"Theory of Neural networks and machine learning - Fall 2021- 275022"

Instructions for home assignments and final project

Instructions for project submission .

Grades The final grade is computed as a combination of (1) home assignments (2) Final project. Students must pass both to pass the course. Grade = 0.5 * Home Assignments + 0.5 Final project.

Home assignments policies: Students are allowed to solve assignments in pairs. They must write the solutions themselves and submit each assignment as individuals. If you have collaborated when working on an assignment, mark clearly the name of the people you collaborated with.

How to submit: Submit your colab notebook/a pdf with your written answers in the designated link on the Moodle course page.
Acceptable format of written answers: PDF. Acceptable format of codes: colab notebook. If you install any package as part of your code, please include this in the colab notebook (using the `!pip install ` command line).

Late submissions policy : Each late day results in a 5 points penalty, and the assignment will not be graded if submitted after 4 days or more. Coding answers that will not be submitted in a colab notebook format will not be checked and their grade will be zero.

List of classes and material:

Mon2021-10-11 Gal Intro: Learning, generalization, Regularization Slides Video Video2
Tue2021-10-12 Gal Linear classification, logistic regression, Perceptron - Video Video2
Mon2021-10-18 Gal GD, The Perceptron Algorithm, Perceptron as SGD. Slides Video Video2
Mon2021-10-25 Gal MLP, Multiclass classifiers Slides Video
Tue2021-10-26 Gal Max-Margin classification, SVM 1 2 (Sontag) Youtube
Mon2021-11-01 Gal Duality, dual SVM, kernels (advanced class) Slides(Sontag) Youtube
Tue2021-11-02 10AMAviv Perceptron & SGD Slides
Tue2021-11-02 2PMAviv MLE Logistic regression Slides
Tue2021-11-08 Gal Multi Layer perceptrons Slides Video
Mon2021-11-09 Gal Convolutional networks, Deep architectures, Word Embeddings ConvNets Word Embeddings Video Video2
Mon2021-11-09 Aviv Multiclass, MLP, Backpropagation Slides Slides2
Mon2021-11-15 Gal Sequence models, LSTM Slides Video
Tue2021-11-16 GalProjects description and assignments Submit here
Mon2021-11-16 Aviv SVMs interpretability Slides -
Mon2021-11-22 Gal Self-Supervised learning SSL Youtube
Tue2021-11-23 Gal Learning workflows, Contrastive learning SSL Workflows
Mon2021-11-16 Aviv MV Gaussians, PCA Slides -
Mon2021-12-06 GalNo Class, Time for projects--
Tue2021-12-07 GalDiscuss word embedding and sequence models--
Mon2021-12-13 GalNo Class, Time for projects--
Tue2021-12-14 GalNo Class, Time for projects--
Mon2021-12-20 GalProject proposal presentations online template -
Tue2021-12-21 GalProject proposal presentations--
Mon2021-12-27 GalOpen hour for projects--
Tue2021-12-28 GalOpen hour for projects--
Mon2022-01-03 GalNo Class, Time for projects--
Tue2022-01-04 GalNo Class, Time for projects--
Mon2022-01-10 GalOpen hour for projects- Schedule
Mon2022-01-11 GalOpen hour for projects- Schedule
Mon2022-01-17 GalFinal projects presentations- Schedule
Tue2022-01-18 GalFinal projects presentations- Schedule