Select the point handle(s) as described above and either click the Delete points button (Shape Tool InfoBar), or press "Del".