Plateau: searching for a part of camelCased word does not yield results

[ReesePlews]

search is working much better in the dev branch than earlier, but there are still some questions about search rules; the anticipated results are not always what one expects.

input of "c" returns

but input of "park" or "_park" returns

"*park" returns

how to pick up "park" to get better results?

[strogonoff]

Good point. It looks like tokenizer should be improved to split camelCased words into distinct tokens (both in index and query). cc @ronaldtse this is a search problem that could probably be delegated.

[strogonoff]

input of "c" returns

I am not sure if that example shows a problem? @ReesePlews

Regarding the park, that is a problem. I will rename the issue to reflect that problem. The problem is that “park” is considered part a word (e.g., “DistributionBusinessPark”), and just “park” does not appear in the document as a standalone word, and so either that entire word needs to be searched or as you have noticed a wildcard must be used for a partial match.

We can address that by splitting camel-cased words into tokens, and/or add help text about wildcard support.

This is not very typical for an English document (where “park” would be used numerous times, and therefore be found), but we should support this case.

[strogonoff]

@ReesePlews The reason “c” is found in clause 4.25.4.6.9 is because you will see “C” does appear as a standalone word in the table in that clause. In other circumstances it appears as part of words with numbers, and I assume the tokenizer splits a word into multiple tokens when it encounters a number in it. (E.g., in 6.3.1 it appears in “C01”, etc.)