How to Enable FTS Indexer logging in Remedy 9.x
 

Legacy ID:KA430745

To Enable the FTS detailed logging, the log level needs to be changed in the file logback_server.xml
This file is stored in the <AR Install Dir>\conf  directory

Inside the file locate the following entries:

com.bmc.arsys.server.fts.impl.jms
com.bmc.arsys.server.domain.service.impl.FTSServiceImpl
com.bmc.arsys.server.domain.service.impl.MFSServiceImpl
com.bmc.arsys.server.fts.util.FTSSearchUtil
com.bmc.arsys.fts.impl.lucene.LuceneFTSService or com.bmc.arsys.fts.impl.lucene

Change the Log Level for the above to Debug

For example: 

  <logger name="com.bmc.arsys.server.fts.impl.jms"
        level=“Debug" additivity="false">
        <appender-ref ref="FTSLog" />
        <appender-ref ref="AlwaysOnLog" />
        <appender-ref ref="FTSLogToForm" />
    </logger>

After changing the log level to Debug you will need to load the changes.   This can be done by setting the "Reload Log Conf File" option 
from the AR System Administration Console --> System --> General --> Server Information --> Log Files tab

All the detailed DEBUG logging will now be stored in arfts.log.

Examples:

ARFTS.LOG   FTS Search on Worklog = ‘researching’

2018-05-07 08:42:06,320 [pool-List-thread-1] - Search Schema ID: 3656; Field and Terms: [536870922:researching]

2018-05-07 08:42:06,324 [pool-List-thread-1] - Query Field/Value: 536870922/researching

2018-05-07 08:42:06,327 [pool-List-thread-1] - Acquire Searcher Manager

2018-05-07 08:42:06,330 [pool-List-thread-1] - maxToReturn: 10001

2018-05-07 08:42:06,333 [pool-List-thread-1] - Making initial search request

2018-05-07 08:42:06,348 [pool-List-thread-1] - Completed initial search request

2018-05-07 08:42:06,351 [pool-List-thread-1] - Phase 2:  Getting All column data: 240

2018-05-07 08:42:06,361 [pool-List-thread-1] - Phase 2:  Completed getting All column data: 240

2018-05-07 08:42:06,363 [pool-List-thread-1] - Release Searcher Manager

2018-05-07 08:42:06,366 [pool-List-thread-1] - Search results count: 240

ARFTS.LOG   Indexing – Full Reindex 

The init is happening.

FTS: Initialize full text analyzers

FTS-IndexDeletionPolicy::onInit processing doDeletePolicy...

Delete Policy Time: 0

FTS-IndexDeletionPolicy::onInit   finished doDeletePolicy...

FTS-IndexDeletionPolicy::onCommit processing doDeletePolicy...

Delete Policy Time: 0

FTS:Deleted prior-commit-point  Generation='78'  File name='segments_26'  Version='78'  TS/CTS/Allowed/Delta='1525721051494/1525726826809/0/10'  POS/Last='0/2'  Location='MMapDirectory@C:\Program Files\BMC Software\ARSystem\ftsconfiguration\collection lockFactory=NativeFSLockFactory@C:\Program Files\BMC Software\ARSystem\ftsconfiguration\collection'.

FTS-IndexDeletionPolicy::onCommit   finished doDeletePolicy...

...

FTS: delete all indexes for schema 2696

FTS-IndexDeletionPolicy::onInit processing doDeletePolicy...

Delete Policy Time: 0

FTS-IndexDeletionPolicy::onInit   finished doDeletePolicy...

Indexing doc SDB000000000001

Created a new document with docId SDB000000000001

FTS: Indexing with FTSAnalyzer-> Schema id = 2696, Entry id = SDB000000000001, Field id =  1000001204, Value(first 20) = SDB_CAL_1000001, Literal indexing = false

FTS: Indexing with FTSAnalyzer-> Schema id = 2696, Entry id = SDB000000000001, Field id =  ArticleId_CAT_NAF, Value(first 20) = SDB_CAL_1000001, Literal indexing = true

FTS: Indexing with FTSAnalyzer-> Schema id = 2696, Entry id = SDB000000000001, Field id =  1000001203, Value(first 20) = Access alternate sys, Literal indexing = false

FTS: Indexing with FTSAnalyzer-> Schema id = 2696, Entry id = SDB000000000001, Field id =  1000001202, Value(first 20) = Unable to access Pay, Literal indexing = false

FTS: Indexing with FTSAnalyzer-> Schema id = 2696, Entry id = SDB000000000001, Field id =  title, Value(first 20) = Unable to access Pay, Literal indexing = false

...

Do commit flag 3

Field Names [Ljava.lang.String;@3241a52a

Created a new document with docId INC000000000003

ARFTS.LOG   Global Search on 'remedy'
 

2018-04-11 11:32:05,173 [pool-List-thread-2] - Threshold set by AR: 10000

2018-04-11 11:32:05,175 [pool-List-thread-2] - Search Terms - Must:  ; Should: remedy; Must Not: 

2018-04-11 11:32:05,178 [pool-List-thread-2] - Search Filter Query: ('StatusForSearch' = "Published" OR 'schemaId' = "1938" OR 'schemaId' = "2398" OR 'schemaId' = "1523" OR 'schemaId' = "2692" OR 'schemaId' = "2694" OR 'schemaId' = "2507" OR 'schemaId' = "1998" OR 'schemaId' = "2696" OR 'schemaId' = "1528" OR 'schemaId' = "3332") AND ('InternalUse' = "No"   OR 'schemaId' = "1938" OR 'schemaId' = "2398" OR 'schemaId' = "1523" OR 'schemaId' = "2692" OR 'schemaId' = "2694" OR 'schemaId' = "2507" OR 'schemaId' = "1998" OR 'schemaId' = "2696" OR 'schemaId' = "1528" OR 'schemaId' = "3332" )

2018-04-11 11:32:05,180 [pool-List-thread-2] - Search Schema IDs and Fields - [1938: 10000006, 301389923, 1000000000, 1000000151, 1000000182, 1000003227, 1000003228, 1000003229, 1000003230, ] [2398: 301389923, 301572100, 303497300, 1000000000, 1000000014, 1000000015, 1000000151, 1000000182, 1000000251, 1000000403, 1000003227, 1000003228, 1000003229, 1000003230, 1000003298, ] [2895: 240001002, 240001005, 302296501, 302300502, 302300507, 302301262, 302303151, 302303161, 302303171, 302303181, 302303191, 302303201, 302303211, 302303221, 302303231, 302303241, 302303251, 302303261, 302303271, 302303281, 302303291, 302303301, 302303311, 302303321, 302303331, 302303341, 302303351, 302303361, 302311142, 302311212, 1000000351, 1000000352, 1000000353, ] [2897: 240001002, 240001005, 302296501, 302300502, 302300507, 302301262, 302303151, 302303161, 302303171, 302303181, 302303191, 302303201, 302303211, 302303221, 302303231, 302303241, 302303251, 302303261, 302303271, 302303281, 302303291, 302303301, 302303311, 302303321, 302303331, 302303341, 302303351, 302303361, 302311142, 302311200, 302311201, 302311202, 1000000351, 1000000352, 1000000353, ] [1523: 301389614, 301572100, 1000000000, 1000000014, 1000000018, 1000000151, 1000000156, 1000000161, 1000000217, 1000000251, 1000000342, 1000000422, 1000000426, 1000000715, 1000005782, ] [2692: 301389875, 1000000000, 1000000014, 1000000151, 1000000217, 1000000218, 1000000251, 1000000396, 1000000834, 1000000835, 1000000837, 1000000855, 1000000979, ] [2905: 240001002, 240001005, 302300502, 302300507, 302301262, 302308621, 302308631, 302308651, 302311142, 1000000351, 1000000352, 1000000353, ] [2908: 240001002, 240001005, 302296501, 302300502, 302300507, 302301262, 302303151, 302303161, 302303171, 302303181, 302303191, 302303201, 302303211, 302303221, 302303231, 302303241, 302303251, 302303261, 302303271, 302303281, 302303291, 302303301, 302303311, 302303321, 302303331, 302303341, 302303351, 302303361, 302311142, 302311202, 302311207, 302311208, 302311209, 1000000351, 1000000352, 1000000353, ] [2694: 301389875, 1000000000, 1000000014, 1000000151, 1000000217, 1000000218, 1000000232, 1000000396, 1000000834, 1000000835, 1000000837, 1000000855, ] [2909: 240001002, 240001005, 302296501, 302300502, 302300507, 302301262, 302303151, 302303161, 302303171, 302303181, 302303191, 302303201, 302303211, 302303221, 302303231, 302303241, 302303251, 302303261, 302303271, 302303281, 302303291, 302303301, 302303311, 302303321, 302303331, 302303341, 302303351, 302303361, 302311142, 302311202, 302311205, 302311206, 1000000351, 1000000352, 1000000353, ] [2910: 240001002, 240001005, 302296501, 302300502, 302300507, 302301262, 302303151, 302303161, 302303171, 302303181, 302303191, 302303201, 302303211, 302303221, 302303231, 302303241, 302303251, 302303261, 302303271, 302303281, 302303291, 302303301, 302303311, 302303321, 302303331, 302303341, 302303351, 302303361, 302311142, 302311210, 1000000351, 1000000352, 1000000353, ] [2507: 301389923, 303489800, 1000000000, 1000000014, 1000000015, 1000000151, 1000000403, ] [1998: 10000523, 10002506, 10010413, 200000006, 200000020, 300810110, 300890310, 301244700, 1000000010, 1000000014, 1000000018, 1000000019, 1000000048, 1000000082, 1000000151, 1000000217, 1000000218, 1000000251, 1000000408, 1000000829, 1000003297, 1000003298, 1000003299, 1000003300, 1000003301, 1000003302, ] [2696: 301389875, 1000000000, 1000000014, 1000000217, 1000000218, 1000000251, 1000001202, 1000001203, 1000001204, ] [1528: 1, 8, 10000101, 10000523, 10002506, 10007000, 10010413, 1000000014, 1000000251, 1000003298, ] [3332: 301389923, 301572100, 1000000000, 1000000014, 1000000015, 1000000151, 1000000182, 1000000251, 1000000403, 1000003227, 1000003228, 1000003229, 1000003230, 1000003298, ]