All my Background Jobs Cancelled

Updated May 18, 2018

Hello,

I hope you experts out there can help me resolve this issue regarding all the background jobs failed. I have remove all the inconsistency objects on the TEMSE using SM12. Somehow the problem still persist. Please see message below:

Background Job Error

-------------------------------------

Try these options in your system:

Do a consistency check of the Background Processing System as follows:

Run Transaction SM65
Select Goto ... Additional tests
Select these options: Perform TemSe check
1. Consistency check DB tables
2. List
3. Check profile parameters
4. Check host names
5. Determine no. of jobs in queue
6. All job servers and then click execute.
Once you get the results check to see if you have any inconsistencies in any of your tables.
If there are any inconsistencies reported then run the "Background Procesing Analyses" (SM65 .. Goto ... Additional Tests) again.
This time check the "Consistency check DB tables" and the "Remove Inconsistencies" options.
Run this a couple of times until all inconsistencies are removed from the tables.

Comments

30 Aug 2012 1:47 am Shalesh Singh Visen
I ran SM65 and there were no inconsistencies, please see attached report, maybe you can see something that could be unusual.

********************************************************************************
* *
* Analysis Tool - Background Processing *
* *
********************************************************************************
* Test: Test TemSe functionality *
********************************************************************************
* *
* ==> TemSe test completed successfully *
* *
********************************************************************************
* Test: Database table consistency test *
********************************************************************************
* *
* ==> No entry found in TBTCO for the folllowing TBTCP entry: *
* *
* EU_PUT 17452101 *
* EU_REORG 17463701 *
* *
* ==> Jobs with BTCEVTJOB entries and incorrect status *
* *
* SAP-LANGUAGE-IMPORT-JOB-3 16514501 : terminated *
* *
* *
********************************************************************************
* Test: Check Profile Parameters *
********************************************************************************
* Server = jvcprod_PRD_03 , Date = 20.12.0829 , Time = 11:47:24 *
********************************************************************************
* *
* rdisp/btctime = 60 *
* rdisp/wp_no_btc = 7 *
* rdisp/btcname = jvcprod_PRD_03 *
* *
* ==> Server is configured correctly for background processing *
* *
********************************************************************************
* Test: Check local host names against message server *
********************************************************************************
* Server = jvcprod_PRD_03 , Date = 20.12.0829 , Time = 11:47:24 *
********************************************************************************
* *
* Local host name = jvcprod *
* *
* ==> Local host name matches the name on the message server *
* *
********************************************************************************
* Test: Determine no.of requests in background mode *
********************************************************************************
* Server = jvcprod_PRD_03 , Date = 20.12.0829 , Time = 11:47:24 *
********************************************************************************
* *
* ==> No.of requests in background queue = 0 *
********************************************************************************

30 Aug 2012 1:48 am Shalesh Singh Visen
Error Logs

Details Page 2 Line 30 System Log: Local analysis of jvcprod 1
------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------------------------------------------
|Time |Ta|Cl.|User |Tcod|MNo|C|Text Date : 29.08.12
|12:30:19|W1|000|SAPSYS | |F6H|K|Database error: TemSe->XRTAB(3)->128 for table TST01 key [680]JOBLGX11251801X44317,1
------------------------------------------------------------------------------------------------------------------------------------
... |
------------------------------------------------------------------------------------------------------------------------------------
Details
Recording at local and central time........................ 2012.08.29 12:30:19
Task................ 1758 W1 Work process No. 1
User................ SAPSYS
Client.............. 000
Terminal............
Session............. 1
Transaction code....
Program name........
Problem class....... K SAP Basis problem
Development class... STMS Temse
------------------------------------------------------------------------------------------------------------------------------------
Further details for this message type
Module name......... $Id: //
Location............ 1
Error text.......... XRTAB&3&128&TST01&
------------------------------------------------------------------------------------------------------------------------------------
Documentation for system log message F6 H :
|Database error: TemSe->&A(&B)->&C for table &D key &a |
| ! ! ! ! |
| ! ! ! Table name |
| ! ! Error number |
| ! Function number |
| Database access module |
|Possible database access modules |
|RTAB |
|Direct access with entire or partial primary key |
|XRTAB |
|direct access with entire or partial primary key for all clients |
|INCLUDE 'RSTS_RTAB_FUNCTIONS' OBJECT DOKU ID TX |
|INCLUDE 'RSTS_RTAB_ERRORS' OBJECT DOKU ID TX |
|INCLUDE 'RSTS_TABLES' OBJECT DOKU ID TX |
------------------------------------------------------------------------------------------------------------------------------------
Parameter
a.. [680]JOBLGX11251801X44317,1
------------------------------------------------------------------------------------------------------------------------------------
Technical details
File................ 000542
Position............ 0006217400
Entry type.......... k ( Error (module, location) )
Message ID.......... F6 H
Variable parts...... XRTAB&3&128&TST01& $Id: // 1

*********************************************************************************
Details Page 2 Line 31 System Log: Local analysis of jvcprod 1
------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------------------------------------------
|Time |Ta|Cl.|User |Tcod|MNo|C|Text Date : 29.08.12
|12:30:19|W1|000|SAPSYS | |R43|K|RSTS: Rollback failed, return code 08
------------------------------------------------------------------------------------------------------------------------------------
... |
------------------------------------------------------------------------------------------------------------------------------------
Details
Recording at local and central time........................ 2012.08.29 12:30:19
Task................ 1758 W1 Work process No. 1
User................ SAPSYS
Client.............. 000
Terminal............
Session............. 1
Transaction code....
Program name........
Problem class....... K SAP Basis problem
Development class... STSK SM04,SM06,SMON
------------------------------------------------------------------------------------------------------------------------------------
Further details for this message type
Module name......... thxxhead
Line................ 9345
Error text.......... 08
Caller.............. ThIRoll
Reason/called....... rstswr_
------------------------------------------------------------------------------------------------------------------------------------
Documentation for system log message R4 3 :
|Error when executing SAP rollback. Check the preceding system log |
|entries. |
------------------------------------------------------------------------------------------------------------------------------------
Technical details
File................ 000542
Position............ 0006217500
Entry type.......... m ( Error (function,module,line) )
Message ID.......... R4 3
Variable parts...... 08 ThIRollrstswr_thxxhead9345

30 Aug 2012 1:52 am Shalesh Singh Visen
I know these are very basic but you can try with these steps:

1. Check the file system and see if any file system is full at OS level which is impacting jobs.
2. Goto /usr/sap//DVEBMG<00>/SYS/global check whether folder JOBLG exits there. You can replace the existing folder by creating new folder and restarting your system.

30 Aug 2012 1:52 am Shalesh Singh Visen
Here is what our folders look likein this case we are n client 680:

I need to end the system first, rename the existing 680JOBLG file and create a new 680JOBLG file? What program do I use to create this new 680JOBLG file Microsoft NOTEPAD ? Or will the system recreate one when I re-start the system?
Please advise.
Thanks.

30 Aug 2012 1:57 am Shalesh Singh Visen

30 Aug 2012 1:58 am Shalesh Singh Visen
First need to know about your OS to tell you how to create new 680JOBLG directory. Secondly if there is any Basis person available then ask them to stop SAP System before doing anything under /usr/sap/PRD/SYS/global file system.

Also I am seeing one 680TEST directory there in /usr/sap/PRD/SYS/global which is strange.

You just stop SAP system. Rename 680JOBLG directory to some other name and create one new directory as 680JOBLG.

Did you check whether your file system is not full? Is there sufficient space available at OS level.

30 Aug 2012 2:00 am Shalesh Singh Visen
We are running SAP on OS400 (iSeries). I am the jack of all trade here, a bit of application development , a bit of basis . In this case , I'll have to end the system.
As for the 680test file on this folder, someone must have created this morning. There is no records on this file and I do not think it effects anything on the system.
I checked, our file system is huge, has lots of space , only 27% used.
Just curious, does the system automatically create this file when I re-start the system? If not, I can use the OS400 command to create the 680JOBLG file. Please advise.

30 Aug 2012 2:00 am Shalesh Singh Visen
Please follow below steps:

1. Stop SAP System.
2. Rename 680JOBLG
3. Create 680JOBLG. Set proper permission as of other client joblg folders.
4. Start your SAP System.

Check if job started in SAP System. Let me know how it goes.

31 Aug 2012 2:12 am Shalesh Singh Visen
I did everything you listed below and the background jobs still failed. Another places I should look or do?

31 Aug 2012 2:12 am Shalesh Singh Visen
Are you getting same error or different one now?

Could you please provide me latest directory structure under /usr/sap/PRD/SYS/global (with permissions). Also please provide me logs from dev_w* log file for any background job.

31 Aug 2012 2:12 am Shalesh Singh Visen
I did get the similar errors last night after I created the new 680JOBLG folder. However, this morning, I ran RSTS0020 and cleared the inconsistencies from TST01 table, it seems most background jobs are running only few failed. I'll see if I can get you the logs on dev_w* log later.
Thanks for your follow up.