You should be able to delete a task directly from that tasks page rather than having to up a level and use the tasks drop down menu.

To resolve, I'll add a "Delete Task" button to the edit task dialog which you can open on any task by pressing the "Edit" button or pressing Shift+e