Workflow Issues
Workflow Issues
Workflow Issues
ORA-20002: 3207
--------------------------------------------------------------------------------
Description :
Email Body Contain: ORA-20002: 3207: User 'SYSADMIN' does not have access to
notification
--------------------------------------------------------------------------------
Version:
Oracle Workflow Cartridge - Version: 11.5
This problem can occur on any platform.
OWF H
FND H
ATG H
ATG CU1
ATG CU2
11.5.10
11.5.10 CU1
11.5.10 CU2
--------------------------------------------------------------------------------
Error Messages:
Error
ORA-20002: 3207: User 'SYSADMIN' does not have access to notification 76183.
ORA-06512: at "APPS.WF_ADVANCED_WORKLIST", line 82 ORA-06512: at line 1
--------------------------------------------------------------------------------
Cause :
--------------------------------------------------------------------------------
Solution :
A. Option #1 (RECOMMENDED):
1. Login to E-Business as the user who can modify the Workflow System Administrator
and navigate:
Workflow Administrator Web Applications > Administration
Then select either the SYSADMIN user or the Workflow Administrator Web Applications
responsibility as the Workflow System Administrator.
2. Send another type of the failing notification and confirm that the issue has been fixed.
B. Option #2:
1. Login to E-Business as the user who can modify the Workflow System Administrator
and navigate:
3. Send another type of the failing notification and confirm that the issue has been fixed.
--------------------------------------------------------------------------------
References :
Note 344936.1
Workflow: Scenario 2 Notification Mailer Does Not Start, remains In status Starting
Describe Scenario 2 Notification Mailer Does Not Start, remains In status Starting here.
Description :
Agent Listeners Will Not Start, Stuck in Deactivating Status, Notification Mailer is
Down.
--------------------------------------------------------------------------------
Versions :
--------------------------------------------------------------------------------
Error Messages:
Workflow agent listeners will not start. When viewed via the Oracle Applications
Manager (OAM) the service components are stuck in a transitional status: starting,
stopping, deactivating, terminating and never move to the final phase: started,
deactivated or terminated. This in turn prevents the notification mailer from starting up.
--------------------------------------------------------------------------------
Cause:
If the ICM or the Service container is shut down while the mailer is still running, this
may cause dead processes, which could prevent the container from restarting.
--------------------------------------------------------------------------------
Solution :
Procedure A
==========
1. Logon to OAM / workflow manager / service components and click the link to the
component container.
2. The actual and target processes on the containers should be symmetrical, that is, 1 and
1. Sometimes they're stuck with 1 and 0, which is bad.
3. Stop the containers. The status should move to deactivating and then to deactivated.
If they stay in deactivating for more than a few minutes then abort the container. the
status will move from terminating to terminated.
4. Once the status is terminated then restart the containers. Wait a few minutes to see if
the processes come up symmetrically (1 and 1) then check the listener status.
Procedure B
==========
This takes the place of the old cmclean.sql scripts
3. If your OAM User Interface isn't the same or if you have problems then use the
Help/Search screen to locate the Concurrent Manager Recovery Wizard. The location of
this wizard changes almost with every new version of OAM.
NOTE: The recovery wizard and cmclean.sql only works if there are no orphan java
processes at the OS level. They need to be killed. This works on Linux for find the
Workflow Service processes ps -ef|grep -i FNDCPGSC*.
--------------------------------------------------------------------------------
References :
Note 335652.1
Description :
Notifications with embedded framework regions are not mailed or sent out. Other non-
framework notifications are mailed. So far, this has been observed in REQAPPRV
notifications, but this is not limited to this type of notification.
--------------------------------------------------------------------------------
Versions :
Oracle Workflow Cartridge - Version: 11.5.10 This problem can occur on any platform.
REQAPPRV notifications Any notification type with an embedded framework region
OWF.H 3258819
--------------------------------------------------------------------------------
Error Messages:
The only hint of an error may appear in the listener log file
(APPLCSF/logs/FNDCPGxxxxxx.txt) where you may see a ?http connection refused?
message such as this:
UNEXPECTED:[SVC-GSM-WFMLRSVC-28875-10006 :
oracle.apps.fnd.wf.mailer.NotificationFormatter.getFormattedMessages()
--------------------------------------------------------------------------------
Cause :
As was documented in the ?About OWF.H? note 258312.1, outbound notifications with
embedded framework regions require a physical web server address with a port in either
of these two profile options:
--------------------------------------------------------------------------------
Solution :
The solution is to set profile WF: Workflow Mailer Framework Web Agent to a non
virtual specific machine name and port number.
Steps
If the customer environment has OWF.H installed and load balancing server like BigIP
configured, then update the value for WF_MAIL_WEB_AGENT in profile.
1.1 Check OWF.H installed in the customer environment. a. Run the following sql query
as APPS user
If the above sql query returns the following output means OWF.H installed in customer
environment.
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
DECODE(BUG_NUMBER,3258819,'POST11IOWF.HPATCHSETNOTE258312.1AFW
FDS.ODFV115.40W
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
3258819 Post 11i OWF.H Patchset Note 258312.1 afwfds.odf v115.40 wfengb.pls
v115.174
b. If OWF.H is not installed, then you can skip the steps 1.2, 1.3 and 1.4
Run the following queries to make sure that the Load Balancing Server is being used:
If the above queries return a BigIP URL, then you need to perform steps 1.3 and 1.4. The
following helps in determining whether it is a BigIP URL or not:
A non BigIP URL has ?http? in it and points to one of physical machine addresses of mid-
tier where Apache is running. A valid URL looks like the following:
http://auohsXXXX.oracleoutsourcing.com:12715://
Whereas a BigIP URL usually has ?https? and/or port 443 in it.
1.3 Once you confirmed that the customer environment has the OWF.H installed and load
balancing server(BigIP) is configured, then run the update_profile.sql in Apps MidTier?
to update WF_MAIL_WEB_AGENT profile option.
SQL> @update_profile.sql
TODAY
--------------------------------------------------------------------------------
--------------------------------------------------------------------------------
0511250741
a. Stop the mailer, listeners and service compoment container in that order using OAM
b. Run the following sql scripts in MidTier? from SQL prompt as apps user.
Workflow: Scenario 4 Workflow Mailer Fails Sending Plain text with HTML
Attachments Notifications
Users with their notification preference set to Plain text mail with HTML
attachments (MAILATTCH) do not receive emailed notifications
--------------------------------------------------------------------------------
Error :
JAVA.LANG.STACKOVERFLOWERROR
JAVA.LANG.NULLPOINTEREXCEPTION
JAVA.NET.SOCKETEXCEPTION
--------------------------------------------------------------------------------
Versions :
Applies to:
Oracle Workflow Cartridge - Version: 11.5.10
This problem can occur on any platform.
ATG H
OWF H
11.5.10
ATG CU1
11.5.10 E-BUS CU1
--------------------------------------------------------------------------------
Users with their notification preference set to Plain text mail with HTML attachments
(MAILATTCH) do not receive emailed notifications. The following errors are in the
Workflow Mailer log:
fnd.wf.mailer.URLMIMETagListener?:oracle.apps.fnd.wf.mailer.URLMIMETagListener
?.tagFound(HTMLTagEvent?) TAG {<META name="fwk-error-detail"
content="oracle.apps.fnd.framework.OAException: java.lang.NullPointerException?
at oracle.apps.fnd.framework.OAException.wrapperException(OAException.java:888)
at
oracle.apps.fnd.framework.webui.OAPageErrorHandler?.prepareException(OAPageError
Handler?.java:1139)
at
oracle.apps.fnd.framework.webui.OAPageBean?.renderDocument(OAPageBean?.java:26
41)
at
oracle.apps.fnd.framework.webui.OAPageBean?.renderDocument(OAPageBean?.java:24
49)
at _oahtml._OA._jspService(_OA.java:105)
at oracle.jsp.runtime.HttpJsp.service(HttpJsp.java:119)
at oracle.jsp.app.JspApplication.dispatchRequest(JspApplication.java:417)
at oracle.jsp.JspServlet.doDispatch(JspServlet.java:267)
at oracle.jsp.JspServlet.internalService(JspServlet.java:186)
at oracle.jsp.JspServlet.service(JspServlet.java:156)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:588)
at oracle.jsp.provider.Jsp20RequestDispatcher.forward(Jsp20RequestDispatcher.java:162)
at oracle.jsp.runtime.OraclePageContext.forward(OraclePageContext.java:187)
at _oahtml._OA._jspService(_OA.java:98)
at oracle.jsp.runtime.HttpJsp?.service(HttpJsp?.java:119)
at oracle.jsp.app.JspApplication?.dispatchRequest(JspApplication?.java:417)
at oracle.jsp.JspServlet?.doDispatch(JspServlet?.java:267)
at oracle.jsp.JspServlet?.internalService(JspServlet?.java:186)
at oracle.jsp.JspServlet?.service(JspServlet?.java:156)
at javax.servlet.http.HttpServlet?.service(HttpServlet?.java:588)
at org.apache.jserv.JServConnection?.processRequest(JServConnection?.java:456)
at org.apache.jserv.JServConnection?.run(JServConnection?.java:294)
at java.lang.Thread.run(Thread.java:534)
## Detail 0 ##
java.lang.NullPointerException?
at
oracle.apps.fnd.framework.webui.laf.text.TableRenderer?._getColumnHeaderData?
(TableRenderer?.java:300)
at
oracle.apps.fnd.framework.webui.laf.text.TableRenderer?.renderContent(TableRenderer?.
java:71)
at oracle.cabo.ui.BaseRenderer?.render(Unknown Source)
UNEXPECTED:[SVC-GSM-WFMLRSVC-18366-10006 :
oracle.apps.fnd.cp.gsc.Processor.run():An unexpected RuntimeException? or Throwable
occurred ->
java.lang.StackOverflowError?
--------------------------------------------------------------------------------
Cause :
The issue is caused by Bug:4435132
When emails are sent in plain text mode, if the email content contains an
OAAdvancedTableBean?, then the Java Mailer fails with a StackOverflowError? which is
due to an internal NullPointerException? (NPE) thrown by the OA Framework. The NPE
occurs at the following location:
java.lang.NullPointerException? at
oracle.apps.fnd.framework.webui.laf.text.TableRenderer?._getColumnHeaderData?
(TableRenderer?.java:300)
--------------------------------------------------------------------------------
Solution :
1. Workaround:
Login to E-Business as the affected user and use the Preferences link at the top of the
screen to change your Email Style to HTML Mail or HTML Mail with attachments.
2. Code fix:
Apply Patch:4435132
--------------------------------------------------------------------------------
Reference :
Description :
Notification email style preferences defaults to "do not send mail" eventhough the
Notificiation Style is set to a different value in Workflow Global Preference e.g. "Plain
text with HTML attachments."
Therefore users can inadvertently commit the 'Do Not Send Me Mail' notification style
when changing other preferences fields.
Steps to reproduce:
Cause :
Email style in General Preferences page is required item in the Oracle Applications
11.5.10 however OA Framework preference page is not aware of the default Notification
Style for Workflow Mailer. This issue is raised in bug 4234372.
--------------------------------------------------------------------------------
Solution :
The fix to bug 4234372 is scheduled to be fixed in Patch 4125550 '11.5.10 Consolidated
Update (CU2) for ATG Product Family.'
One-off Patch 4292220 has been released for customers who apply Patch 4017300
'11.5.10 Consolidated Update (CU1) for ATG Product Family.'
java/preferences/server/PreferencesVORowImpl?.java 115.21
java/preferences/server/PreferencesVO.xml 115.13
java/preferences/webui/PreferencesPage?CO.java 115.52
mds/preferences/webui/PreferencesPG.xml 115.26
The change in behaviour is that OA Framework 11.5.10 preferences page has the
following behaviour:
1. It detects the default email style when the user did not make specific choice.
2. It does not save when user does not make specific choice.
3. It adds a blank value to the choices for users to reset to default.
--------------------------------------------------------------------------------
References :
Bug 4234372 - Notif Email Style Defaults Do Not Send Me Mail After 11.5.10 Upgrade
Bug 4292220 - Request One-Off For Bug 4234372 On 11.5.10.1cu
--------------------------------------------------------------------------------
Symptoms
Unable to Edit the Java Mailer parameters as the following error appears
This record has already been updated by another user. Please re-query and try again.
ORA-06512: at "APPS.FND_SVC_COMP_PARAM_VALS_PKG", line 288 ORA-
06512: at line 1
--------------------------------------------------------------------------------
Error Messages
Cause:
--------------------------------------------------------------------------------
Solution :*
Here are the instructions to solve the problem:
Description :
Mailer log shows
SVC-GSM-WFALSNRSVC-695493 :
oracle.apps.fnd.cp.gsc.Processor.processControlEvent?(String)]:Did not receive any
control events.
--------------------------------------------------------------------------------
Cause :
There are Workflow related events subscribed to the wrong Business Event System. To
confirm this is the problem the following query can be used. If there are rows returned
then it means that there are incorrect event subscriptions:
Alternatively, the following steps can help to find those incorrect subscriptions:
- Connect to Applications and select the Workflow Administrator Web Applications
responsibility
- Click on Business Events (right panel)
- Click on Subscriptions sub-tab
- Perform a search using the Systems that are not the current one. There might be multiple
nodes, but only one is to be correct (as far as Workflow is concern). Look for those
subscriptions in those incorrect systems to confirm this is the case.
--------------------------------------------------------------------------------
Solution :
Commit;
--------------------------------------------------------------------------------
References :
Bug 3413090 - Workflow Mailer And Agent Listener Services Staying In Starting Status
Workflow: Scenario 8 Users unable to monitor the workflow. Only sysadmin can!
The workflow administrator is set to SYSADMIN which does not allow view
all workflows submitted by other users using the status monitor. Need
to change this in a way so that users can see the status of workflow
using monitoring facility. First compare with the another instance where
PMP is performed (or if it is first PMPd instance, than use the PROD instance).
TEXT
SYSADMIN
Once compared, update the value to match the instance where customer does
not have any issues. Even after the above, if issue still persists use the
following update statement and hopefully would resolve the issue.
SQL> commit;
Commit complete.
--------------------------------------------------------------------------------
Cause :
Either the queue WF_CONTROL or its data is corrupted, probably due to the
change of the IMAP/SMTPserver settings.
Since the WF_CONTROL queue is used by the notification mailer to hold runtime
data, and it is not valid, the mailer will not be able to start up
--------------------------------------------------------------------------------
Error Messages:
ORA-20002
ORA-24026 operation failed, queue %s.%s has errors
--------------------------------------------------------------------------------
Solution :
1. Stop Workflow Agent listeners
This solution may work for a range of scenarios where the Diagram is not showing.
note 231286.1 - Configuring the Oracle Workflow 2.6 Java-based Notification Mailer
with Oracle Applications 11i
note 418069.1 - ACCEPT button is not Working when Creating a New Agent Listener
2.2 If Support diagnostics is not installed, simply download and unzip patch 5679259
(p5679259_11i_GENERIC.zip)
The wf java mailer for OHS customers should be the same as the wf account
userid. wfsid/wdsid.
NOTE: Following query will give you requested parameter values requested by the
diagnstic script:
4. Check WFJavaMailerSetup?115_xxxx_wfver_sql.txt
4.1 If you see any invalid queue, do this to validate a single queue
and you should do this FIRST. then run wfver.sql again to doublecheck that
it is valid. Make sure you stop the mailer , listeners and service containers first.
Example Syntax:
sqlplus apps/apps @$FND_TOP/patch/115/sql/wfntfqup APPS apps APPLSYS
3. Ensure that this index is in place, by running
INDEX_NAME COLUMN_NAME
------------------------- -------
WF_NOTIFICATION_OUT_N1 CORRID
Example Syntax:
sqlplus apps/apps @$FND_TOP/patch/115/sql/wfqidxc2 APPLSYS APPS
APPS_TS_QUEUES
--------------------------------------------------------------------------------
2. Message state
Edit the Workflow Notification Mailer component to regularly restart. Ensure that the
Workflow Notification Mailer is selected and click on edit. If available, click on the
Advanced button to get to the "Define" configuration stop.
Navigate to the Schedule Events page Click on Next until the Schedule page is reached.
Set a submit date for "today" (ie choose the current date from the calendar).
Set the interval for the number of minutes (1440 suffice stop issued once everyday, 10080
would suffice stop issued once every seven days).
Set a submit date for "today" (ie choose the current date from the calendar).
Set the interval for the number of minutes (1440 suffice start issued once everyday, 10080
would suffice start issued once every seven days).
--------------------------------------------------------------------------------
The following was part of the metalink note for auto start stop, but its seen that this does
not have much impact on autobounce.
--------------------------------------------------------------------------------
Set the profile options to a high enough value so as not to time out (Not sure if its really
required though) Set the profile values for the SYSADMIN user (The default mailer user)
or the framework mailer user (In this case it would be preferred to have a separate Mailer
user for this workaround), to the following values:
The objective of the work around is to set the ICX profile options so that the session does
not time out within a week and to have the mailer stop and start once a week. A smaller
frequency could also be used i.e. Once per day or once per every other day. The ICX
profile options should be adjusted to suit.
It is not recommended to make these profile value changes at the site level. They should
be done at the mailer frame work user level. The default user is SYSADMIN but a new
mailer user could be created and the profile options set for that user only. The user needs
to be configured in the mailer configuration parameters as the FRAMEWORK_USER
and the user must also have a responsibility that is listed as the Workflow Administrator
Role. The Workflow Administrator Role is configured under the Workflow Administrator
Web Applications responsibility, under the Administration menu link.
Workflow: Verify SMTP and IMAP server configuration (Manual,Automatic)
Important: These tests must be run from the concurrent processing tier where the
Java Mailer is running.
Manual verification
%% telnet crmops02.us.oracle.com 25
Trying 144.25.76.117...
Connected to crmops02.us.oracle.com.
Escape character is '^]'.
220 crmops02.us.oracle.com ESMTP Sendmail 8.9.3 (PHNE_18546)/8.7.1; Fri, 31 Jan
2003 05:56:18 -0800 (PST)
%% EHLO ap102ses.us.oracle.com
250-EXPN
250-VERB
250-8BITMIME
250-SIZE
250-DSN
250-ONEX
250-ETRN
250-XUSR
250 HELP
%% MAIL FROM: wfuser@crmops02.us.oracle.com
250 wfuser@crmops02.us.oracle.com... Sender ok
%% RCPT TO: myemail@oracle.com
250 myemail@oracle.com... Recipient ok
%% DATA
354 Enter mail, end with "." on a line by itself
%% Subject: Test message via CRMOPS2
%%
%% Test message body
%% .
250 FAA17833 Message accepted for delivery
%% quit
221 crmops02.us.oracle.com closing connection
Connection closed by foreign host.
Values in <...> are the values defined (or to be defined) for mailer configuration
using OAM.
IMAP Server:
$AFJVAPRG -classpath $AF_CLASSPATH -Dprotocol=imap
-Dserver=<Inbound EMailAccount? Server Name> -Dport=143
Example output:
--------------------------------------------------------------------------------
-Daccount=notesuser2@ap700lts.us.oracle.com -Dpassword=XXXXX
-Dconnect_timeout=120 -Dfolder=INBOX oracle.apps.fnd.wf.mailer.Mailer
INBOX
Drafts
Sent
PROCESS
DISCARD
--------------------------------------------------------------------------------
Note: Email Processing (PROCESS and DISCARD Folder) should get listed like
"PROCESS" and "DISCARD" in output above. If not, these folders are required
to be created by connecting to the IMAP / Inbound Email account with any email
client (e.g. Netscape Messenger or Microsoft Outlook). These folders should be
created before they are specified in the mailer configuration within OAM. The
notification mailer may not be able to access folders that were created using
command line tools outside the e-mail client.
SMTP Server:
$AFJVAPRG -classpath $AF_CLASSPATH -Dprotocol=smtp
-Dserver=<Outbound Email Account Server Name>
Example Output:
--------------------------------------------------------------------------------
-Daccount=notesuser6@ap700lts.us.oracle.com -Dconnect_timeout=120
oracle.apps.fnd.wf.mailer.Mailer
--------------------------------------------------------------------------------
If above tests are successful from commandline, mailer should also be able to
connect to IMAP / SMTP server. If these tests are not successful then mailer
will also not be able to connect. Then it is IMAP / SMTP server issue that administrators
need to take a look at.
You can use the following script to change any Workflow Notification Mailer parameter
or even any workflow agent listener parameter without login to the application
Do the following
Workflow: How To Start or Stop The Workflow Mailer From The Command Line
--------------------------------------------------------------------------------
Describe How To Start or Stop The Workflow Mailer From The Command Line here.
The Workflow Mailer runs within Workflow Mailer Service's JVM, therefore it can be
started or stopped without stopping the container Mailer Service. Just is a SQL script to
raise the proper events. The SQL script will look as follows:
declare
l_Component_Id number := '&component';
l_errcode number;
l_errstr varchar2(4000);
begin
-- to stop component
FND_SVC_COMPONENT.Stop_Component(l_Component_Id, l_errcode, l_errstr);
-- to start component
FND_SVC_COMPONENT.Start_Component(l_Component_Id, l_errcode, l_errstr);
commit;
end;
/
exit
Just alike, the Workflow Deferred Agent Listener runs within the Workflow Agent
Listener container.
Now, to find what is the value of the l_Component_Id to enter, find the Workflow Mailer
component ID. It is usually 10006, but it can vary, especially if there are other Workflow
Mailers different from the seeded one. To make sure about of the component_id run the
following query:
If the query returns more than one row then it means there are more than one mailer.
Now, for the Workflow Deferred Agent Listener the following query can be used:
RefNote: 452354.1