Usage/Event Filtering Logic In SGG For UIQ(D7) Queries (Doc ID 2573602.1)

Last updated on SEPTEMBER 19, 2022

Applies to:

Symptoms

Usage/Event Filtering logic in SGG queries MDM for each filter UOM for Usage and Event types for Events.


When we update the EnvironmentSettings XQuery and setting the filterUsage and filterEvents to true, we are experiencing lots of error in SGG OSB environment which impacts loading of reads.
Those filter will query the D1-GetHeadEndUOMs and D1-GetHeadEndEvents services in MDM.

ERROR
-----------------------
Jun 19, 2019 3:15:52 AM CDT> <[service_name: SGG-D7-SSNXML-CM/Proxy Services/InboundProxyService] Exception in pipeline processing
oracle.tip.pc.services.pipeline.PipelineException: Last attempt to save invalid row is failed: 20190531-3546e328-9a79-431b-8397-a1d6684f3ed4-1-165-503-2019-06-19-03-15-52-031.xml
at com.splwg.d1.sgg.osb.common.GenericFileProcessor.processInvalidRow(GenericFileProcessor.java:1154)
at com.splwg.d1.sgg.osb.common.GenericFileProcessor.messageFlowErrorOccurredPlain(GenericFileProcessor.java:1077)
at com.splwg.d1.sgg.osb.common.GenericFileProcessor.messageFlowErrorOccurredPlainOnThread(GenericFileProcessor.java:561)
at com.splwg.d1.sgg.osb.messageFlow.FileProcessorUtil.messageFlowErrorOccurredPlain(FileProcessorUtil.java:36)
at sun.reflect.GeneratedMethodAccessor1123.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at stages.transform.runtime.JavaCalloutRuntimeStep$1.run(JavaCalloutRuntimeStep.java:184)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:368)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:163)
at weblogic.security.Security.runAs(Security.java:61)
at com.bea.wli.sb.util.security.SecurityUtils.executeAs(SecurityUtils.java:70)
at stages.transform.runtime.JavaCalloutRuntimeStep.processMessage(JavaCalloutRuntimeStep.java:204)
at com.bea.wli.sb.stages.StageMetadataImpl$WrapperRuntimeStep.processMessage(StageMetadataImpl.java:384)
at com.bea.wli.sb.stages.impl.SequenceRuntimeStep.processMessage(SequenceRuntimeStep.java:33)
at com.bea.wli.sb.pipeline.components.PipelineStage.processMessage(PipelineStage.java:89)
at com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:902)
at com.bea.wli.sb.pipeline.components.Pipeline.processMessage(Pipeline.java:153)
at com.bea.wli.sb.pipeline.PipelineContextImpl.handleError(PipelineContextImpl.java:1013)
at com.bea.wli.sb.pipeline.MessageProcessor.processRequest(MessageProcessor.java:96)
at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher$1.run(PipelineDispatcher.java:139)
at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher$1.run(PipelineDispatcher.java:136)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:368)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:163)
at com.bea.wli.sb.util.security.SecurityUtils.executeAs(SecurityUtils.java:102)
at com.bea.wli.sb.security.WLSSecurityContextService.executeAs(WLSSecurityContextService.java:55)
at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher.dispatch(PipelineDispatcher.java:134)
at com.bea.wli.sb.service.handlerchain.handlers.ServiceInvoker.dispatch(ServiceInvoker.java:156)
at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:132)
at com.bea.wli.sb.service.handlerchain.handlers.UpdateInboundOperationalStatistics.dispatch(UpdateInboundOperationalStatistics.java:75)
at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:132)
at com.bea.wli.sb.service.handlerchain.handlers.InboundMessageContentHandler.dispatch(InboundMessageContentHandler.java:170)
at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:132)
at com.bea.wli.sb.service.handlerchain.handlers.CheckAccessControl.dispatch(CheckAccessControl.java:65)
at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:132)
at com.bea.wli.sb.service.handlerchain.handlers.UpdateInboundTransportStatistics.dispatch(UpdateInboundTransportStatistics.java:64)
at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:132)
at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:132)
at com.bea.wli.sb.service.handlerchain.handlers.DefaultInboundErrorHandler.dispatch(DefaultInboundErrorHandler.java:44)
at com.bea.wli.sb.service.handlerchain.InboundHandlerChain.dispatch(InboundHandlerChain.java:124)
at com.bea.wli.sb.transports.TransportDispatcherClient.dispatch(TransportDispatcherClient.java:97)
at com.bea.wli.sb.transports.TransportManagerImpl.receiveMessage(TransportManagerImpl.java:351)
at com.bea.wli.sb.transports.local.LocalMessageContext$1.run(LocalMessageContext.java:183)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:368)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:163)
at com.bea.wli.sb.util.security.SecurityUtils.executeAs(SecurityUtils.java:102)
at com.bea.wli.sb.service.handlerchain.handlers.TransportProviderInvoker$ServiceCredentialCallback.runAsSubject(TransportProviderInvoker.java:281)
at com.bea.wli.sb.transports.local.LocalMessageContext.send(LocalMessageContext.java:178)
at com.bea.wli.sb.transports.local.LocalTransportProvider.sendMessageAsync(LocalTransportProvider.java:326)
at sun.reflect.GeneratedMethodAccessor1114.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.bea.wli.sb.transports.Util$1.invoke(Util.java:80)
at com.sun.proxy.$Proxy205.sendMessageAsync(Unknown Source)
at com.bea.wli.sb.transports.TransportManagerImpl.sendMessageToService(TransportManagerImpl.java:508)
at com.bea.wli.sb.transports.TransportManagerImpl.sendMessageAsync(TransportManagerImpl.java:396)
at com.bea.wli.sb.service.handlerchain.handlers.TransportProviderInvoker.dispatch(TransportProviderInvoker.java:87)
at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:132)
at com.bea.wli.sb.service.handlerchain.handlers.EndpointManagementHandler.dispatch(EndpointManagementHandler.java:47)
at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:132)
at com.bea.wli.sb.service.handlerchain.handlers.UpdateOutboundStatistics.dispatch(UpdateOutboundStatistics.java:65)
at com.bea.wli.sb.service.handlerchain.handlers.LoadBalanceFailover$LoadBalanceFailoverHelper.sendMessageAsync(LoadBalanceFailover.java:408)
at com.bea.wli.sb.service.handlerchain.handlers.LoadBalanceFailover$LoadBalanceFailoverHelper.sendMessageToServiceAsync(LoadBalanceFailover.java:333)
at com.bea.wli.sb.service.handlerchain.handlers.LoadBalanceFailover$LoadBalanceFailoverHelper.sendMessageToService(LoadBalanceFailover.java:280)
at com.bea.wli.sb.service.handlerchain.handlers.LoadBalanceFailover.dispatch(LoadBalanceFailover.java:162)
at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:132)
at com.bea.wli.sb.service.handlerchain.handlers.OutboundMessageContentHandler.dispatch(OutboundMessageContentHandler.java:70)
at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:132)
at com.bea.wli.sb.service.handlerchain.handlers.CheckTxDeadlock.dispatch(CheckTxDeadlock.java:59)
at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:132)
at com.bea.wli.sb.service.handlerchain.handlers.SetSoapAction.dispatch(SetSoapAction.java:167)
at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:132)
at com.bea.wli.sb.service.handlerchain.handlers.OutboundMessagePatternHandler.dispatch(OutboundMessagePatternHandler.java:174)
at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:132)
at com.bea.wli.sb.service.handlerchain.OutboundHandlerChain.dispatch(OutboundHandlerChain.java:96)
at com.bea.wli.sb.service.dispatcher.TransportDispatcher.dispatch(TransportDispatcher.java:58)
at com.bea.wli.sb.context.PipelineDispatcherClient.dispatch(PipelineDispatcherClient.java:216)
at com.bea.wli.sb.pipeline.PipelineContextImpl.doDispatch(PipelineContextImpl.java:515)
at com.bea.wli.sb.pipeline.PipelineContextImpl.dispatch(PipelineContextImpl.java:491)
at stages.routing.runtime.RouteRuntimeStep.processMessage(RouteRuntimeStep.java:131)
at com.bea.wli.sb.stages.StageMetadataImpl$WrapperRuntimeStep.processMessage(StageMetadataImpl.java:384)
at com.bea.wli.sb.pipeline.components.RouteNode.doRequest(RouteNode.java:131)
at com.bea.wli.sb.pipeline.components.Node.processMessage(Node.java:82)
at com.bea.wli.sb.pipeline.PipelineContextImpl.execute(PipelineContextImpl.java:902)
at com.bea.wli.sb.pipeline.components.Router.processMessage(Router.java:205)
at com.bea.wli.sb.pipeline.MessageProcessor.processRequest(MessageProcessor.java:87)
at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher$1.run(PipelineDispatcher.java:139)
at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher$1.run(PipelineDispatcher.java:136)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:368)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:163)
at com.bea.wli.sb.util.security.SecurityUtils.executeAs(SecurityUtils.java:102)
at com.bea.wli.sb.security.WLSSecurityContextService.executeAs(WLSSecurityContextService.java:55)
at com.bea.wli.sb.pipeline.dispatcher.PipelineDispatcher.dispatch(PipelineDispatcher.java:134)
at com.bea.wli.sb.service.handlerchain.handlers.ServiceInvoker.dispatch(ServiceInvoker.java:156)
at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:132)
at com.bea.wli.sb.service.handlerchain.handlers.UpdateInboundOperationalStatistics.dispatch(UpdateInboundOperationalStatistics.java:75)
at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:132)
at com.bea.wli.sb.service.handlerchain.handlers.ComputeOperation.dispatch(ComputeOperation.java:110)
at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:132)
at com.bea.wli.sb.service.handlerchain.handlers.InboundMessageContentHandler.dispatch(InboundMessageContentHandler.java:170)
at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:132)
at com.bea.wli.sb.service.handlerchain.handlers.CheckAccessControl.dispatch(CheckAccessControl.java:65)
at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:132)
at com.bea.wli.sb.service.handlerchain.handlers.UpdateInboundTransportStatistics.dispatch(UpdateInboundTransportStatistics.java:64)
at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:132)
at com.bea.wli.sb.service.handlerchain.handlers.AbstractHandler.dispatch(AbstractHandler.java:132)
at com.bea.wli.sb.service.handlerchain.handlers.DefaultInboundErrorHandler.dispatch(DefaultInboundErrorHandler.java:44)
at com.bea.wli.sb.service.handlerchain.InboundHandlerChain.dispatch(InboundHandlerChain.java:124)
at com.bea.wli.sb.transports.TransportDispatcherClient.dispatch(TransportDispatcherClient.java:97)
at com.bea.wli.sb.transports.TransportManagerImpl.receiveMessage(TransportManagerImpl.java:351)
at com.bea.wli.sb.transports.jca.binding.JCATransportInboundOperationBindingServiceImpl$4.run(JCATransportInboundOperationBindingServiceImpl.java:478)
at com.bea.wli.sb.transports.jca.binding.JCATransportInboundOperationBindingServiceImpl$4.run(JCATransportInboundOperationBindingServiceImpl.java:476)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:368)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:163)
at weblogic.security.Security.runAs(Security.java:61)
at com.bea.wli.sb.util.security.SecurityUtils.executeAs(SecurityUtils.java:70)
at com.bea.wli.sb.transports.jca.binding.JCATransportInboundOperationBindingServiceImpl.sendMessage(JCATransportInboundOperationBindingServiceImpl.java:476)
at com.bea.wli.sb.transports.jca.binding.JCATransportInboundOperationBindingServiceImpl.invokeOneWay(JCATransportInboundOperationBindingServiceImpl.java:137)
at com.bea.wli.sb.transports.jca.binding.JCAInboundRequestListener.post(JCAInboundRequestListener.java:39)
at oracle.tip.adapter.sa.impl.inbound.JCAInboundListenerImpl.onMessage(JCAInboundListenerImpl.java:216)
at oracle.tip.adapter.fw.jca.messageinflow.MessageEndpointImpl.onMessage(MessageEndpointImpl.java:664)
at oracle.tip.adapter.file.inbound.Publisher.doPipelinePublish(Publisher.java:753)
at oracle.tip.adapter.file.inbound.Publisher.onMessageDelegate(Publisher.java:712)
at oracle.tip.adapter.file.inbound.Publisher.publishMessage(Publisher.java:521)
at oracle.tip.adapter.file.inbound.InboundSyncTranslatorDelegate.xlate(InboundSyncTranslatorDelegate.java:493)
at oracle.tip.adapter.file.inbound.InboundSyncTranslatorDelegate.doXlate(InboundSyncTranslatorDelegate.java:120)
at oracle.tip.adapter.file.inbound.ProcessorDelegate.doXlate(ProcessorDelegate.java:482)
at oracle.tip.adapter.file.inbound.ProcessorDelegate.doPipeline(ProcessorDelegate.java:389)
at oracle.tip.adapter.file.inbound.ProcessorDelegate.process(ProcessorDelegate.java:225)
at oracle.tip.adapter.file.inbound.ProcessWork.run(ProcessWork.java:199)
at oracle.tip.adapter.sa.impl.fw.jca.work.WorkerJob.go(WorkerJob.java:53)
at oracle.tip.adapter.sa.impl.fw.common.ThreadPool.run(ThreadPool.java:281)
at java.lang.Thread.run(Thread.java:748)
Caused By: java.io.FileNotFoundException: /shared_ext_data/sgg/stg03/bge/d7-ssnxml-error/20190531-3546e328-9a79-431b-8397-a1d6684f3ed4-1-165-503-2019-06-19-03-15-52-031.xml (File too large)
at java.io.FileOutputStream.open0(Native Method)
at java.io.FileOutputStream.open(FileOutputStream.java:270)
at java.io.FileOutputStream.(FileOutputStream.java:213)
at java.io.FileOutputStream.(FileOutputStream.java:162)



STEPS
-----------------------
The issue can be reproduced at will with the following steps:
1. In SGG, enable additional filtering so the file processing takes longer.
2. Begin getting additional errors in SGG as above


BUSINESS IMPACT
-----------------------
The issue has the following business impact:
Due to this issue, users cannot process flies successfully with filtering on.

Changes

Cause

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.