Lucene Index problems with "-" character, StandardAnalyzer

[jeffciara]

Hi, same problem as Lucene Index problems with “-” character hyphen.

I need to search full word including hyphen, and not using hyphen "-" as operator in Query Parser Syntax.

For solving, i need to change the current Lucene "StandardAnalyzer", with another "WhitespaceAnalyzer" or "SimpleAnalyzer", but i didn't found where in my code.

I'm using :

• com.jidesoft.lucene.LuceneQuickTableFilterField
• com.jidesoft.lucene.LuceneFilterableTableModel
• com.jidesoft.grid.SortableTable

Code: Select all

luceneQuickTableFilterField.setTableModel(defaulTableModel);
luceneFilterableTableModel = new LuceneFilterableTableModel(luceneQuickTableFilterField.getDisplayTableModel());
sortableTable.setModel(luceneFilterableTableModel);


Actualy with table containing "MSG-123", searching :

• "MSG" found the entry "MSG-123"
• "MSG-" no found (cause : "-" hyphen interpreted as exclusion operator)
• "MSG-123" no found (cause : "-" hyphen interpreted as exclusion operator)

Thanks

[JIDE Support]

I haven't looked up in the Lucene documentation but you can't escape the "-"?

[jeffciara]

There is Escaping Special Characters in Apache Lucene, Query Parser Syntax.

I have have try it on my search field with escaped value, and doesn't work. Searching :

• "MSG\-" not found
• "MSG\-123" not found

[JIDE Support]

Did you turn on the lucene input mode? Tap the search icon, you will see a dropdown menu where the first menu item is Lucene Input Mode.

[jeffciara]

I tryed to activate lucene input mode without result : my input field doesn't trigger or result in table is not refreshed.
I'll retry...

[JIDE Support]

Activated the mode first then type.

[jeffciara]

Hi, it doesn't work.
With lucene input mode whith hyphen, it's listing other entries.
It's only work with full text search "Match exactly", but i would "Match anywhere" using hyphen.

All rows/values : "number", "number-", "number-zero", "number-one"


With default (no Lucene Input Mode)


Search "num"


Search "number"


Search "number-"


Search "number-zero"


Search ""number-zero"" (encapsulated with quotes :")


With Lucene Input Mode enabled


Search "num"


Search "number"


Search "number-"


Search "number-zero"


Search "number\-zero" escaping : doesn't work


Search "number -zero"


Search ""number-zero"" (encapsulated with quotes :")

[JIDE Support]

If the Lucene mode, you will have to do exactly what the Lucene syntax described. We actually just pass the string to Lucene and Lucence will do the query. We don't have any role during the search. In non-Lucene mode, we read your input and convert it to the Lucene syntax. In this case, I noticed we didn't escape the "-" which is why it was not working. I will fix that.

[JIDE Support]

I can't figure out what's going. Even I escape the "-", still no result.

This is the query I am using if you type "number-" in the non-lucene mode. I basically translated it from the plain text to a lucene compatible query. However, it is still not working. I don't know what's wrong with it. You can switch to the lucene mode and type the same string as below to try it and see if you can get it working.

Code: Select all

categoryname:*number\-* productname:*number\-* productsales:*number\-* shippeddate:*number\-*


[jeffciara]

Hi, thanks for your suggest, but it also doesn't work.

numbe : no result (numbe in not a full word)
number : all result (all words contain ""number")
number- : all result (all words contain ""number")
number\- : all result (all words contain ""number")
*number* : all result
*number-* : no result
name:number : all result
name:*number* : all result
name:*number\-* : no result
name:number-zero : all result
name:"number-zero" : 1 result "number-zero"
name:number\-zero : all result
name:"number\-zero" : 1 result "number-zero"
name:*number\-zero*: no result

[JIDE Support]

I didn't say it works. I have no idea why it is not working. Need a Lucene expert to help us out.