You can control whether the Window Browser displays its history toolbar by the option Show Toolbar in the General tab of the Preferences, as described in Toolbar configurations.
LispWorks IDE User Guide (Windows version) - 25 Nov 2011