Remove the Gmail label when deleting an imported task

When I delete a task that was created from an email by adding the akiflow label the label is not removed even though it (supposedly) should be.