Add comment about the reshape operation from the training_step function
parent
49715d4b74
commit
cd4e2e1313
|
@ -1376,7 +1376,9 @@
|
||||||
"cell_type": "markdown",
|
"cell_type": "markdown",
|
||||||
"metadata": {},
|
"metadata": {},
|
||||||
"source": [
|
"source": [
|
||||||
"Lastly, let's create a function that will sample some experiences from the replay memory and perform a training step:"
|
"Lastly, let's create a function that will sample some experiences from the replay memory and perform a training step:\n",
|
||||||
|
"\n",
|
||||||
|
"**Note**: the first 3 releases of the 2nd edition were missing the `reshape()` operation which converts `target_Q_values` to a column vector (this is required by the `loss_fn()`)."
|
||||||
]
|
]
|
||||||
},
|
},
|
||||||
{
|
{
|
||||||
|
|
Loading…
Reference in New Issue