Oracle WebCenter Content 12c Unable to execute service GET_SYSTEM_CONFIGURATION_PAGE


Recently I have come across an issue associated with Oracle Webcenter Content 12c(12.2.1.3) content server. Below is the short summary of the same

Problem Statement- 
Content Server started but issue encountered while accessing the content server and shows an error message- 
CONTENT SERVER REQUEST FAILED
Unable to execute service GET_SYSTEM_CONFIGURATION_PAGE and function prepareSystemConfigPage. The error was caused by an internally generated issue. The error has been logged.


Below is the generated log-

<Sep 27, 2018 3:56:45 PM IST> <Warning> <Socket> <BEA-000449> <Closing the socket, as no data read from it on 192.168.0.132:53,326 during the configured idle timeout of 5 seconds.> 
<Sep 27, 2018 4:52:37 PM IST> <Error> <JDBC> <BEA-001112> <Test "SELECT 1 FROM DUAL" set up for pool "CSDS" failed with exception: "java.sql.SQLRecoverableException: IO Error: Connection reset".> 
<Sep 27, 2018 4:52:37 PM IST> <Error> <JDBC> <BEA-001112> <Test "SELECT 1 FROM DUAL" set up for pool "CSDS" failed with exception: "java.sql.SQLRecoverableException: IO Error: Connection reset".> 
<Sep 27, 2018 4:52:37 PM IST> <Error> <JDBC> <BEA-001112> <Test "SELECT 1 FROM DUAL" set up for pool "CSDS" failed with exception: "java.sql.SQLRecoverableException: IO Error: Connection reset".> 
<Sep 27, 2018 4:52:37 PM IST> <Error> <JDBC> <BEA-001112> <Test "SELECT 1 FROM DUAL" set up for pool "CSDS" failed with exception: "java.sql.SQLRecoverableException: IO Error: Connection reset".> 
<Sep 27, 2018 4:52:37 PM IST> <Error> <JDBC> <BEA-001112> <Test "SELECT 1 FROM DUAL" set up for pool "CSDS" failed with exception: "java.sql.SQLRecoverableException: IO Error: Connection reset".> 
<Sep 27, 2018 4:54:18 PM IST> <Error> <JDBC> <BEA-001112> <Test "SELECT 1 FROM DUAL" set up for pool "opss-audit-DBDS" failed with exception: "java.sql.SQLRecoverableException: IO Error: Connection reset".> 
<Sep 27, 2018 4:54:18 PM IST> <Error> <JDBC> <BEA-001112> <Test "SELECT 1 FROM DUAL" set up for pool "opss-audit-viewDS" failed with exception: "java.sql.SQLRecoverableException: IO Error: Connection reset".> 
<Sep 27, 2018 4:54:18 PM IST> <Error> <JDBC> <BEA-001112> <Test "SELECT 1 FROM DUAL" set up for pool "opss-data-source" failed with exception: "java.sql.SQLRecoverableException: IO Error: Connection reset".> 
<Sep 27, 2018 4:54:35 PM IST> <Error> <oracle.ucm.idccs> <UCM-CS-060003> <Event generated by user 'weblogic' at host '192.168.0.215:16200'.> 
<Sep 27, 2018 4:54:35 PM IST> <Error> <oracle.ucm.idccs> <UCM-CS-000001> <general exception
intradoc.common.ServiceException: !csServiceDataException,GET_SYSTEM_CONFIGURATION_PAGE,prepareSystemConfigPage!$
at intradoc.server.ServiceRequestImplementor.buildServiceException(ServiceRequestImplementor.java:2220)
at intradoc.server.Service.buildServiceException(Service.java:2419)
at intradoc.server.Service.createServiceExceptionEx(Service.java:2413)
at intradoc.server.Service.createServiceException(Service.java:2408)
at intradoc.server.ServiceRequestImplementor.handleActionException(ServiceRequestImplementor.java:1860)
at intradoc.server.ServiceRequestImplementor.doAction(ServiceRequestImplementor.java:1810)
at intradoc.server.Service.doAction(Service.java:570)
at intradoc.server.ServiceRequestImplementor.doActions(ServiceRequestImplementor.java:1527)
at intradoc.server.Service.doActions(Service.java:565)
at intradoc.server.ServiceRequestImplementor.executeActions(ServiceRequestImplementor.java:1459)
at intradoc.server.Service.executeActions(Service.java:551)
at intradoc.server.ServiceRequestImplementor.doRequest(ServiceRequestImplementor.java:760)
at intradoc.server.Service.doRequest(Service.java:1991)
at intradoc.server.ServiceManager.processCommand(ServiceManager.java:520)
at intradoc.server.IdcServerThread.processRequest(IdcServerThread.java:348)
at intradoc.idcwls.IdcServletRequestUtils.doRequest(IdcServletRequestUtils.java:1358)
at intradoc.idcwls.IdcServletRequestUtils.processFilterEvent(IdcServletRequestUtils.java:1752)
at intradoc.idcwls.IdcIntegrateWrapper.processFilterEvent(IdcIntegrateWrapper.java:223)
at sun.reflect.GeneratedMethodAccessor732.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at idcservlet.common.IdcMethodHolder.invokeMethod(IdcMethodHolder.java:87)
at idcservlet.common.ClassHelperUtils.executeMethodEx(ClassHelperUtils.java:305)
at idcservlet.common.ClassHelperUtils.executeMethodWithArgs(ClassHelperUtils.java:278)
at idcservlet.ServletUtils.executeContentServerIntegrateMethodOnConfig(ServletUtils.java:1752)
at idcservlet.IdcFilter.doFilter(IdcFilter.java:459)
at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:78)
at oracle.security.jps.ee.http.JpsAbsFilter$1.run(JpsAbsFilter.java:141)
at java.security.AccessController.doPrivileged(Native Method)
at oracle.security.jps.util.JpsSubject.doAsPrivileged(JpsSubject.java:315)
at oracle.security.jps.ee.util.JpsPlatformUtil.runJaasMode(JpsPlatformUtil.java:649)
at oracle.security.jps.ee.http.JpsAbsFilter.runJaasMode(JpsAbsFilter.java:124)
at oracle.security.jps.ee.http.JpsAbsFilter.doFilter(JpsAbsFilter.java:232)
at oracle.security.jps.ee.http.JpsFilter.doFilter(JpsFilter.java:94)
at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:78)
at oracle.dms.servlet.DMSServletFilter.doFilter(DMSServletFilter.java:224)
at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:78)
at oracle.security.jps.ee.http.JpsAbsFilter$1.run(JpsAbsFilter.java:141)
at java.security.AccessController.doPrivileged(Native Method)
at oracle.security.jps.util.JpsSubject.doAsPrivileged(JpsSubject.java:315)
at oracle.security.jps.ee.util.JpsPlatformUtil.runJaasMode(JpsPlatformUtil.java:649)
at oracle.security.jps.ee.http.JpsAbsFilter.runJaasMode(JpsAbsFilter.java:124)
at oracle.security.jps.ee.http.JpsAbsFilter.doFilter(JpsAbsFilter.java:232)
at oracle.security.jps.ee.http.JpsFilter.doFilter(JpsFilter.java:94)
at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:78)
at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.wrapRun(WebAppServletContext.java:3654)
at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3620)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:326)
at weblogic.security.service.SecurityManager.runAsForUserCode(SecurityManager.java:196)
at weblogic.servlet.provider.WlsSecurityProvider.runAsForUserCode(WlsSecurityProvider.java:203)
at weblogic.servlet.provider.WlsSubjectHandle.run(WlsSubjectHandle.java:71)
at weblogic.servlet.internal.WebAppServletContext.doSecuredExecute(WebAppServletContext.java:2423)
at weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2280)
at weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2258)
at weblogic.servlet.internal.ServletRequestImpl.runInternal(ServletRequestImpl.java:1626)
at weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1586)
at weblogic.servlet.provider.ContainerSupportProviderImpl$WlsRequestExecutor.run(ContainerSupportProviderImpl.java:270)
at weblogic.invocation.ComponentInvocationContextManager._runAs(ComponentInvocationContextManager.java:348)
at weblogic.invocation.ComponentInvocationContextManager.runAs(ComponentInvocationContextManager.java:333)
at weblogic.work.LivePartitionUtility.doRunWorkUnderContext(LivePartitionUtility.java:54)
at weblogic.work.PartitionUtility.runWorkUnderContext(PartitionUtility.java:41)
at weblogic.work.SelfTuningWorkManagerImpl.runWorkUnderContext(SelfTuningWorkManagerImpl.java:617)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:397)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:346)
Caused By: intradoc.data.DataException: !syParameterNotFound,SystemConfigPageType
at intradoc.idcwls.WlsServiceHandler.prepareSystemConfigPage(WlsServiceHandler.java:143)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at intradoc.common.IdcMethodHolder.invokeMethod(IdcMethodHolder.java:86)
at intradoc.common.ClassHelperUtils.executeMethodReportStatus(ClassHelperUtils.java:324)
at intradoc.server.ServiceHandler.executeAction(ServiceHandler.java:79)
at intradoc.server.Service.doCodeEx(Service.java:626)
at intradoc.server.Service.doCode(Service.java:598)
at intradoc.server.ServiceRequestImplementor.doAction(ServiceRequestImplementor.java:1737)
at intradoc.server.Service.doAction(Service.java:570)
at intradoc.server.ServiceRequestImplementor.doActions(ServiceRequestImplementor.java:1527)
at intradoc.server.Service.doActions(Service.java:565)
at intradoc.server.ServiceRequestImplementor.executeActions(ServiceRequestImplementor.java:1459)
at intradoc.server.Service.executeActions(Service.java:551)
at intradoc.server.ServiceRequestImplementor.doRequest(ServiceRequestImplementor.java:760)
at intradoc.server.Service.doRequest(Service.java:1991)
at intradoc.server.ServiceManager.processCommand(ServiceManager.java:520)
at intradoc.server.IdcServerThread.processRequest(IdcServerThread.java:348)
at intradoc.idcwls.IdcServletRequestUtils.doRequest(IdcServletRequestUtils.java:1358)
at intradoc.idcwls.IdcServletRequestUtils.processFilterEvent(IdcServletRequestUtils.java:1752)
at intradoc.idcwls.IdcIntegrateWrapper.processFilterEvent(IdcIntegrateWrapper.java:223)
at sun.reflect.GeneratedMethodAccessor732.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at idcservlet.common.IdcMethodHolder.invokeMethod(IdcMethodHolder.java:87)
at idcservlet.common.ClassHelperUtils.executeMethodEx(ClassHelperUtils.java:305)
at idcservlet.common.ClassHelperUtils.executeMethodWithArgs(ClassHelperUtils.java:278)
at idcservlet.ServletUtils.executeContentServerIntegrateMethodOnConfig(ServletUtils.java:1752)
at idcservlet.IdcFilter.doFilter(IdcFilter.java:459)
at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:78)
at oracle.security.jps.ee.http.JpsAbsFilter$1.run(JpsAbsFilter.java:141)
at java.security.AccessController.doPrivileged(Native Method)
at oracle.security.jps.util.JpsSubject.doAsPrivileged(JpsSubject.java:315)
at oracle.security.jps.ee.util.JpsPlatformUtil.runJaasMode(JpsPlatformUtil.java:649)
at oracle.security.jps.ee.http.JpsAbsFilter.runJaasMode(JpsAbsFilter.java:124)
at oracle.security.jps.ee.http.JpsAbsFilter.doFilter(JpsAbsFilter.java:232)
at oracle.security.jps.ee.http.JpsFilter.doFilter(JpsFilter.java:94)
at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:78)
at oracle.dms.servlet.DMSServletFilter.doFilter(DMSServletFilter.java:224)
at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:78)
at oracle.security.jps.ee.http.JpsAbsFilter$1.run(JpsAbsFilter.java:141)
at java.security.AccessController.doPrivileged(Native Method)
at oracle.security.jps.util.JpsSubject.doAsPrivileged(JpsSubject.java:315)
at oracle.security.jps.ee.util.JpsPlatformUtil.runJaasMode(JpsPlatformUtil.java:649)
at oracle.security.jps.ee.http.JpsAbsFilter.runJaasMode(JpsAbsFilter.java:124)
at oracle.security.jps.ee.http.JpsAbsFilter.doFilter(JpsAbsFilter.java:232)
at oracle.security.jps.ee.http.JpsFilter.doFilter(JpsFilter.java:94)
at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:78)
at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.wrapRun(WebAppServletContext.java:3654)
at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3620)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:326)
at weblogic.security.service.SecurityManager.runAsForUserCode(SecurityManager.java:196)
at weblogic.servlet.provider.WlsSecurityProvider.runAsForUserCode(WlsSecurityProvider.java:203)
at weblogic.servlet.provider.WlsSubjectHandle.run(WlsSubjectHandle.java:71)
at weblogic.servlet.internal.WebAppServletContext.doSecuredExecute(WebAppServletContext.java:2423)
at weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2280)
at weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2258)
at weblogic.servlet.internal.ServletRequestImpl.runInternal(ServletRequestImpl.java:1626)
at weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1586)
at weblogic.servlet.provider.ContainerSupportProviderImpl$WlsRequestExecutor.run(ContainerSupportProviderImpl.java:270)
at weblogic.invocation.ComponentInvocationContextManager._runAs(ComponentInvocationContextManager.java:348)
at weblogic.invocation.ComponentInvocationContextManager.runAs(ComponentInvocationContextManager.java:333)
at weblogic.work.LivePartitionUtility.doRunWorkUnderContext(LivePartitionUtility.java:54)
at weblogic.work.PartitionUtility.runWorkUnderContext(PartitionUtility.java:41)
at weblogic.work.SelfTuningWorkManagerImpl.runWorkUnderContext(SelfTuningWorkManagerImpl.java:617)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:397)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:346)

Analysis Outcome-
1. <Socket> <BEA-000449> <Closing the socket, as no data read from it on 192.168.0.132:53,326 during the configured idle timeout of 5 seconds.> indicates that there is some issue with database connectivity. So we can check database connectivity followed by necessary db level logs if required.

2. Middleware products can store there config files in either database or file system. So if database has been used to store config files or metadata so that should be up and running prior to running the respective FMW product, in this case Oracle WebCenter content. If file system has been used, make sure necessary permission Read/Write is available on respective files/directories.

3. Restarting the managed servers and checking the server_name.out file (was_wcc.out) from location $DOMAIN_HOME/servers/MGD_SERVER/logs/MGD_SERVER.out can also give clue regarding the issue.

[More details will be added later]









Comments

Popular posts from this blog

Oracle SOA Suite- Implementing Email Notification

Oracle SOA Suite 12c- PKIX path building failed & unable to find valid certification path to requested target

Migration of Oracle SOA Suite Composite from 11g to 12c