no custom stylesheets displayed if RAC DEBUG activated

[Michael_Ruhnke]

We're struggle with freezing problems of 4-tier client at our customer site. The client freezes with (Swing UI / SWT UI Thread is not responding on 4-tier RAC). There is a open IR for that issue, although Siemens like to close the IR, because it is no software problem. We still don't know why that's happen. Also, we're not able to reproduce the issue directly. The client freeze during work, but we don't know when.

Hence, GTAC advice us to enable server and client side debug logging to upload the logs for further investigation. When activate RAC logging with aligned TcLogger.properties, most of our custom rendering summary stylesheets of item revisions didn't get loaded anymore. I found java.lang.NullPointerException in RAC debug log, but nothing in server debug log or server journal debug log.

RAC debug log to big to upload, but some fragments may explains the problem.

I need help from system experts to figure out the stylesheet problem.

DEBUG 2018-07-31 21:58:10,003 - name=C4_RecordRevisionSvAI  displayName=C4_RecordRevisionSvAI
uid=TYPE::C4_RecordRevisionSvAI::C4_RecordRevisionSvAI::C4_CustItemRevisionSvAI  typeUid=TYPE::ImanType::ImanType::POM_object
DEBUG 2018-07-31 21:58:10,010 - TCProperty::getLogicalValue(), value is null, but returning false
DEBUG 2018-07-31 21:58:10,014 - TCProperty::getLogicalValue(), value is null, but returning false
DEBUG 2018-07-31 21:58:10,019 - Transaction Initiated: hostname.14371 - 2018-07-31 09:58:10 - Internal-Core-2017-05-PresentationManagement:getStylesheetPerPage
DEBUG 2018-07-31 21:58:10,104 - TCProperty::getLogicalValue(), value is null, but returning false
ERROR 2018-07-31 21:58:10,218 - 
java.lang.NullPointerException
	at com.teamcenter.rac.kernel.TCTextService.getTextValue(Unknown Source)
	at com.teamcenter.rac.common.TCUtilities.getXRTValue(Unknown Source)
	at com.teamcenter.rac.common.TCUtilities.getXRTValue(Unknown Source)
	at com.teamcenter.rac.viewer.stylesheet.xmlstylesheet.Page.initialize(Unknown Source)
	at com.teamcenter.rac.viewer.stylesheet.viewer.XMLStylesheetHelper.getPageList(Unknown Source)
	at com.teamcenter.rac.viewer.provider.StylesheetCombinedContentProvider.getUISchema(Unknown Source)
	at com.teamcenter.rac.viewer.stylesheet.viewer.StylesheetRenderingViewer.loadUISchema(Unknown Source)
	at com.teamcenter.rac.viewer.stylesheet.viewer.StylesheetRenderingViewer.access$1(Unknown Source)
	at com.teamcenter.rac.viewer.stylesheet.viewer.StylesheetRenderingViewer$IC_UIRenderOperation.executeOperation(Unknown Source)
	at com.teamcenter.rac.aif.AbstractAIFOperation.runEx(Unknown Source)
	at com.teamcenter.rac.kernel.services.impl.TCOperationService.performOperation(Unknown Source)
	at com.teamcenter.rac.aif.kernel.AbstractAIFSession.performOperation(Unknown Source)
	at com.teamcenter.rac.aif.AbstractAIFOperation.run(Unknown Source)
	at org.eclipse.core.internal.jobs.Worker.run(Worker.java:54)
ERROR 2018-07-31 21:58:10,218 - 
java.lang.NullPointerException
	at com.teamcenter.rac.kernel.TCTextService.getTextValue(Unknown Source)
	at com.teamcenter.rac.common.TCUtilities.getXRTValue(Unknown Source)
	at com.teamcenter.rac.common.TCUtilities.getXRTValue(Unknown Source)
	at com.teamcenter.rac.viewer.stylesheet.xmlstylesheet.Page.initialize(Unknown Source)
	at com.teamcenter.rac.viewer.stylesheet.viewer.XMLStylesheetHelper.getPageList(Unknown Source)
	at com.teamcenter.rac.viewer.provider.StylesheetCombinedContentProvider.getUISchema(Unknown Source)
	at com.teamcenter.rac.viewer.stylesheet.viewer.StylesheetRenderingViewer.loadUISchema(Unknown Source)
	at com.teamcenter.rac.viewer.stylesheet.viewer.StylesheetRenderingViewer.access$1(Unknown Source)
	at com.teamcenter.rac.viewer.stylesheet.viewer.StylesheetRenderingViewer$IC_UIRenderOperation.executeOperation(Unknown Source)
	at com.teamcenter.rac.aif.AbstractAIFOperation.runEx(Unknown Source)
	at com.teamcenter.rac.kernel.services.impl.TCOperationService.performOperation(Unknown Source)
	at com.teamcenter.rac.aif.kernel.AbstractAIFSession.performOperation(Unknown Source)
	at com.teamcenter.rac.aif.AbstractAIFOperation.run(Unknown Source)
	at org.eclipse.core.internal.jobs.Worker.run(Worker.java:54)
DEBUG 2018-07-31 21:58:10,219 - TCProperty::getLogicalValue(), value is null, but returning false
DEBUG 2018-07-31 21:58:10,355 - TCProperty::getLogicalValue(), value is null, but returning false
DEBUG 2018-07-31 21:58:09,998 - hostname.08265: CachedClientMetaModel.loadTypesFromCache     ( C4_RecordRevisionSvAI )
DEBUG 2018-07-31 21:58:10,003 - hostname.08265: CachedClientMetaModel.ObjectFactory.constructPropertyDescription( C4_RecordRevisionSvAI: , currentDeepCopyData, newTargetObject, srcObjectTag, fnd0ContextProvider, fnd0CheckoutOnSaveAs, object_name, object_desc, fnd0AllowCopyAsRevision, performDeepCopy, fnd0DisallowCopyBVR, item_revision_id, sequence_limit, sequence_id, item_master_tag )
DEBUG 2018-07-31 21:58:10,003 - hostname.08265: CachedClientMetaModel.ObjectFactory.constructType( C4_RecordRevisionSvAI )
INFO  2018-07-31 21:58:10,003 - hostname.08265: CachedClientMetaModel.loadTypes                                 (Time:       6ms, Types Retrieved: C4_RecordRevisionSvAI)
DEBUG 2018-07-31 21:58:10,019 - hostname.65155.01.username.00087: Internal-Core-2017-05-PresentationManagement.getStylesheetPerPage
<?xml version="1.0" encoding="UTF-8"?>
<ns3:GetStylesheetPerPageInput xmlns:ns2="http://teamcenter.com/Schemas/Soa/2006-03/Base" xmlns:ns3="http://teamcenter.com/Schemas/Internal/Core/2017-05/PresentationManagement" xmlns="http://teamcenter.com/Schemas/Internal/Core/2013-05/PresentationManagement"><ns3:pref returnThumbnailTickets="true" stylesheetFormat="XRTOnly" processEntireXRT="false"/><ns3:inputData clientId="" boName="" stylesheetType="Summary" targetPage="tc_xrt_Overview"><ns3:boReference uid="xgBAAEmv4rzq6A"/></ns3:inputData></ns3:GetStylesheetPerPageInput>

DEBUG 2018-07-31 21:57:57,605 - hostname.53246.01.username.00053: ModelManagerImpl.ObjectFactory.addProperty   ( GTGAAI7k4rzq6A - c4_AENDERUNGSBEZEICHNUNG, c4_AENDERUNGSNUMMER, c4_ARTIKELGROESSE, c4_ERSTELLT_DATUM, c4_ERSTELLT_NAME, c4_ERSTELLT_REVISION_NAME, c4_FREIGEGEBEN_DATUM, c4_FREIGEGEBEN_NAME, c4_SUCHBEGRIFF_2, c4_GEPRUEFT_NAME_1, c4_MARKENNAME, c4_REF, c4_SUCHBEGRIFF_1, c4_NETTOGEWICHT, c4_TEILEART, c4_UDI, c4_WERKSTOFF, c4_GEPRUEFT_DATUM_1, c4_SELEKTION, object_name, item_revision_id, object_desc, checked_out_user, date_released, effectivity_text, item_id, last_mod_user, fnd0DSState, checked_out, Fnd0DigitalSignatureRel, creation_date, fnd0CurrentChangeContext, has_variant_module, last_mod_date, fnd0IsCheckoutable, object_string, is_vi, lsd, items_tag, object_type, owning_group, owning_user, owning_site, release_status_list, process_stage_list )
DEBUG 2018-07-31 21:57:57,607 - hostname.53246.01.username.00053: ModelManagerImpl.ObjectFactory.addProperty   ( gnPAAAqT4rzq6A - person, home_folder, default_group, object_string, user_name, user_id, userinbox, newstuff_folder, user_projects )
DEBUG 2018-07-31 21:57:57,607 - hostname.53246.01.username.00053: ModelManagerImpl.ObjectFactory.constructServiceData(   )
ERROR 2018-07-31 21:57:57,615 - 
java.lang.NullPointerException
	at com.teamcenter.rac.kernel.TCTextService.getTextValue(Unknown Source)
	at com.teamcenter.rac.common.TCUtilities.getXRTValue(Unknown Source)
	at com.teamcenter.rac.common.TCUtilities.getXRTValue(Unknown Source)
	at com.teamcenter.rac.viewer.stylesheet.xmlstylesheet.Page.initialize(Unknown Source)
	at com.teamcenter.rac.viewer.stylesheet.viewer.XMLStylesheetHelper.getPageList(Unknown Source)
	at com.teamcenter.rac.viewer.provider.StylesheetCombinedContentProvider.getUISchema(Unknown Source)
	at com.teamcenter.rac.viewer.stylesheet.viewer.StylesheetRenderingViewer.loadUISchema(Unknown Source)
	at com.teamcenter.rac.viewer.stylesheet.viewer.StylesheetRenderingViewer.access$1(Unknown Source)
	at com.teamcenter.rac.viewer.stylesheet.viewer.StylesheetRenderingViewer$IC_UIRenderOperation.executeOperation(Unknown Source)
	at com.teamcenter.rac.aif.AbstractAIFOperation.runEx(Unknown Source)
	at com.teamcenter.rac.kernel.services.impl.TCOperationService.performOperation(Unknown Source)
	at com.teamcenter.rac.aif.kernel.AbstractAIFSession.performOperation(Unknown Source)
	at com.teamcenter.rac.aif.AbstractAIFOperation.run(Unknown Source)
	at org.eclipse.core.internal.jobs.Worker.run(Worker.java:54)
DEBUG 2018-07-31 21:57:57,616 - TCProperty::getLogicalValue(), value is null, but returning false
ERROR 2018-07-31 21:57:57,616 - 
java.lang.NullPointerException
	at com.teamcenter.rac.kernel.TCTextService.getTextValue(Unknown Source)
	at com.teamcenter.rac.common.TCUtilities.getXRTValue(Unknown Source)
	at com.teamcenter.rac.common.TCUtilities.getXRTValue(Unknown Source)
	at com.teamcenter.rac.viewer.stylesheet.xmlstylesheet.Page.initialize(Unknown Source)
	at com.teamcenter.rac.viewer.stylesheet.viewer.XMLStylesheetHelper.getPageList(Unknown Source)
	at com.teamcenter.rac.viewer.provider.StylesheetCombinedContentProvider.getUISchema(Unknown Source)
	at com.teamcenter.rac.viewer.stylesheet.viewer.StylesheetRenderingViewer.loadUISchema(Unknown Source)
	at com.teamcenter.rac.viewer.stylesheet.viewer.StylesheetRenderingViewer.access$1(Unknown Source)
	at com.teamcenter.rac.viewer.stylesheet.viewer.StylesheetRenderingViewer$IC_UIRenderOperation.executeOperation(Unknown Source)
	at com.teamcenter.rac.aif.AbstractAIFOperation.runEx(Unknown Source)
	at com.teamcenter.rac.kernel.services.impl.TCOperationService.performOperation(Unknown Source)
	at com.teamcenter.rac.aif.kernel.AbstractAIFSession.performOperation(Unknown Source)
	at com.teamcenter.rac.aif.AbstractAIFOperation.run(Unknown Source)
	at org.eclipse.core.internal.jobs.Worker.run(Worker.java:54)
DEBUG 2018-07-31 21:57:57,716 - hostname.39059.01.username.00054: Internal-Core-2011-06-ICT.invokeICTMethod( ICCT, getProperties )
<?xml version="1.0" encoding="UTF-8"?>
<InvokeICTMethodInput className="ICCT" methodName="getProperties" xmlns:ns2="http://teamcenter.com/Schemas/Soa/2006-03/Base" xmlns="http://teamcenter.com/Schemas/Internal/Core/2011-06/ICT"><args val="C4_CustItemRevision"/><args val="TYPE::C4_CADItemRevision::C4_CADItemRevision::C4_CustItemRevision"/><args val="GTGAAI7k4rzq6A"/><args val=""><array><entries val="process_stage"/><entries val="publication_sites"/><entries val="ics_classified"/></array></args></InvokeICTMethodInput>


DEBUG 2018-07-31 21:57:57,717 - Transaction Initiated: hostname.14371 - 2018-07-31 09:57:57 - Internal-Core-2011-06-ICT:invokeICTMethod( ICCT.getProperties )
DEBUG 2018-07-31 21:57:57,717 - TCProperty::getLogicalValue(), value is null, but returning false
DEBUG 2018-07-31 21:57:57,729 - hostname.39059.01.username.00054

[RandyEllsworth]

Usually, TextService issues can be resolved by rebuilding the Client Meta Cache and Shared Memory. You will need to shutdown Teamcenter and all the services except for the FSC service that owns the FMS Master. Delete the shared memory directory (Note: you will not be able to delete it if any processes are accessing it).

Then open a Teamcenter command window and run:
# Delete
generate_metadata_cache -u=infodba -p=infodba -g=dba -delete -log %TC_TMP_DIR%
generate_client_meta_cache -u=infodba -p=infodba -g=dba -t delete all
# Regenerate
generate_client_meta_cache -u=infodba -p=infodba -g=dba -t generate all
generate_metadata_cache -u=infodba -p=infodba -g=dba -force -log %TC_TMP_DIR%

You can also try disabling the client cache by adding to portal.bat:
set TC_SKIP_CLIENT_CACHE=1
As a temporary work-around until you can shutdown Teamcenter to rebuild shared memory, client meta and metadata caches. Note: this will increase the amount of memory each tcserver consumes until they begin to share a cache again.

[Michael_Ruhnke]

Unfortunately deleting and regenerating both cache did not the trick.

Also tried to deactivate the Siemens TCPB Plug-In in tc_profilevars. Furthermore tried to comment the com.teamcenter.rac.viewer.stylesheet.StylesheetRenderingService in TcLogger.properties. Both with no effect.

I'm going further to reduce the logging parameters until the stylsheets gets loading, although it is may not sensible.

What else could prevent the stylesheet from loading in debug mode?

Two further questions:

1. Should I pay attention on the folowing rows in debug log, or is it just debug information and no error?

DEBUG 2018-07-31 15:57:57,163 - TCProperty::getLogicalValue(), value is null, but returning false

2. What does this error line mean? I couldn't find anything in solution center

ERROR 2018-07-31 15:57:07,989 - org.eclipse.core.runtime - org.eclipse.ui - 4 - Unable to create menu item "com.teamcenter.rac.pse.pca.OpenSVRDialog", command "com.teamcenter.rac.pse.pca.OpenSVRDialog" not defined

[RandyEllsworth]

The first is just debug info. The second looks like a plugin for Structure Manager although I haven't seen that one before. Have you already evaluated your Transient Volume settings?

[Michael_Ruhnke]

Good point Randy! I forgot to check the transient volume folder - it isn't empty... looks like something goes wrong.

I checked the settings. The Transient_Volume_Installation_Location is set to %COMPUTERNAME% in TC_DATA\tc_profilevars.bat seems to be correct. Also checked the FMS master config. Transient volume_id and root path looks good as well. Attached the Prefs of *transient* and the backup.xml.

What could be the reason that the transient files are not cleared?

Once the setting are OK, would you just clear the transient volume and try again?

[RandyEllsworth]

As far as I can tell, all the preferences look correct from the given backup.xml. The only recommendation I can make is that the order needs to be changed for Transient_Volume_RootDir. Teamcenter will read the first in the list and if it fails then the second, etc. so reverse the order that you have them in.

Transient_Volume_RootDir
d:\plm\server_vols\test\transientVolume
/tmp/transientVolume_infodba

Or, you can remove the /tmp/transientVolume_infodba altogether.
As you stated, the transient volume folder should be empty if all is working well. I don't think changing the order of the tc pref will make a difference.

Another point with transient volumes is that every Server Manager (tcserver) instance requires one be defined locally on the server. Ensure that you have a TV on each server running Server Manager. You can have only one default but many TV's. The trick is that they all need the same path (or a path defined in Transient_Volume_RootDir) so maybe it should read:

Transient_Volume_RootDir
d:\plm\server_vols\test\transientVolume
C:\Temp

[Michael_Ruhnke]

Thx Randy! I've cleared the transient volume and removed the unix Transient_Volume_RootDir path from the Pref. But all this doesn't solved my issue.

Tomorrow I'm going to review the logs again...