一、The theorem of deterministic policy gradient之前得到的policy gradient theorem是merely valid for stochastic policies。如果policy必须是deterministic，那么必须derive a new policy gradient theorem。