To remove all entries from the cache:
Delete the .nk2 files in which Outlook keeps those entries.
They are usually located unde the following location:
WIndows XP/2000
C:\Documents and Settings\username\Application Data\Microsoft\Outlook
Windows Vista /Outlook 2007
C:\users\username\appdata\roaming\microsoft\outlook