Or more to the point, Peter Greenaway's Prospero's Books and The Pillow Book do exactly this with reckless abandon.