provision for delayed reading of compound tokens

In work initiated by @Serge and @gregorweiss, the files are read and the compound token is tagged as such, but allocated with zero size. This maintains the token stream elements to allow delayed reading.