set -o emacs
stty erase ^?
Note, to get control in vi ctrl-v (keep this down when typing the next character).
This will now give you the use of the up and down arror keys as well as the backspace key for editing commands. This much easier than using ctrl-h and all the standard keystrokes.