Deleting a cell currently requires going into the cell menu and selecting the Delete entry, or opening the command palette and selecting "Delete current cell".

Preferably there'd be a dedicated keyboard shortcut to delete a cell, or the option to auto-delete emptied cells on blur.