My ideal Collector's Edition:

An in-universe box. Like a wood box with the Keeper symbol burned into it.

Soundtrack CD. Some of the best music I've ever heard in a game came from the Thief...