The SQLite _TOKENIZE function has been changed to use a third column, token_index. This commit adds tests for the _TOKENIZE token_index column, and for the source column, which was previously untested.
The SQLite _TOKENIZE function has been changed to use a third column, token_index. This commit adds tests for the _TOKENIZE token_index column, and for the source column, which was previously untested.