public const(Token)[] getTokensForParser(ubyte[] sourceCode, const LexerConfig config, StringCache* cache)

Returns

an array of tokens lexed from the given source code to the output range. All whitespace tokens are skipped and comments are attached to the token nearest to them.