Problem Set 10

Exercises are taken from the textbook chapters. Maximum score for this problem set is 18 points and the due date is Monday, November 22th, 2021 (11:59PM Eastern Time)

• Exercise 9.1: (a) 2 points, (b) 2 points, (c) 4 points, (d) 1 point.
• Exercise 9.2: (a) 2 points, (b) 2 points, (c) 4 points.
• Survey: 1 point. After submitting the survey, write the keyword at the end of your written submission.

You will submit three files for this problem set:

• Problem Set 10 written problems. The written problem (Exercises 9.1 (c)) belongs in this submission, as well as the survey code. Please submit one PDF for all written problems. Note that your solutions to written problems only need to be within the PDF and do not need to be duplicated in the notebooks. Please ensure that if you are submitted scans of handwritten solutions that the text is legible.
• Problem Set 10 notebook problems. The final versions of your notebooks: stochastic_optimization.ipynb, policy_gradient.ipynb (downloaded from Deepnote). Please double check that the notebook you are submitting has exactly this name.

When submitting to Gradescope, include all files in the same upload. This way, the autograder will be able to grade your notebooks, and the teaching staff will be able to read your written work. Please do not submit any other files. For the notebook problems, Gradescope will give you a grade. You can resubmit as many times as you like before the deadline.

Finally, we have a small survey. After you take the survey, you will be given a code. Include this code in your written submission.