Difference between revisions of "Information Systems:Overnight ENDOFDAY"

From uniWIKI
Jump to navigation Jump to search
 
(23 intermediate revisions by 2 users not shown)
Line 1: Line 1:
The scheduler starts this job at 1:00AM; every morning except Sunday - when the End of Week is called. It calls [[Overnight ENDOFDAY#EODDAILY|EODDAILY]], which will -
+
The scheduler starts this job at 1:00AM; every morning except Sunday - when the End of Week is called. It calls [[EODDAILY]], which will -
   
 
- End all programs that use ASW or extension files, and end subsystems so users cannot sign on.
 
- End all programs that use ASW or extension files, and end subsystems so users cannot sign on.
Line 9: Line 9:
 
The following sections only show the main functions in the programs; not any error checking. Whenever there can be an error that shouldn't affect processing, the programs have the MONMSG (monitor message) command to ignore it. When a file that is to be rebuilt can't be cleared (because it is in use by another job), the program will automatically skip the rebuild.
 
The following sections only show the main functions in the programs; not any error checking. Whenever there can be an error that shouldn't affect processing, the programs have the MONMSG (monitor message) command to ignore it. When a file that is to be rebuilt can't be cleared (because it is in use by another job), the program will automatically skip the rebuild.
   
==EODDAILY==
+
* [[EODDAILY]]
   
  +
This is called by the scheduler (job name ENDOFDAY) every day except Sunday, at 1:00AM. It puts the computer into an application restricted state. If it fails, it will be cancelled by the backup; which starts at 3:00AM.
/* send email that daily overnight process is starting */
 
 
CHGVAR VAR(&SMSG) VALUE('EOD starting (2:15 3:00 +
 
5:00 6:30)')
 
CHGVAR VAR(&LMSG) VALUE(&SMSG)
 
CALL PGM(OPMSGSEND) PARM(&SMSG &LMSG)
 
 
/* End all processes that use either ASW or extension files. This is */
 
/* so that the temporary backup can save all files, and because some of */
 
/* the ASW jobs cannot run if any other jobs are using their files. */
 
 
CALL PGM([[Overnight ENDOFDAY#EODEND2|EODEND2]])
 
 
/* run End of Day processing */
 
 
CALL PGM([[Overnight ENDOFDAY#EOD|EOD]])
 
 
/* send email that daily overnight process ended normally */
 
 
CHGVAR VAR(&SMSG) VALUE('Daily overnite processing +
 
ended Normally')
 
CHGVAR VAR(&LMSG) VALUE('This message means there +
 
were no errors that halted processing. If +
 
this message is not sent, it means the +
 
full backup cancelled this job.')
 
CALL PGM(OPMSGSEND) PARM(&SMSG &LMSG)
 
 
/* Reset the submit time for this job on the scheduler to 1:00AM. This is */
 
/* in case a warehouse supervisor has delayed it. */
 
 
CHGJOBSCDE JOB(ENDOFDAY) ENTRYNBR(000025) +
 
SCDTIME('01:00:00')
 
   
==EODEND2==
+
* [[EODEND2]]
   
This will end all processes that can use either ASW or extension files. This does not end Domino, so that I.T. staff will receive the emails being sent.
+
This will end all processes that can use either ASW or extension files. This does not end Domino, so that I.T. staff will receive the emails being sent. This is called by EODDAILY and EODWEEKLY.
   
  +
* [[EOD]]
/* End EDI monitors for SPS Commerce and EDI Gateway */
 
 
EDIENDMON
 
EDIENDEDIG
 
 
/* End subsystems that run user jobs */
 
 
ENDSBS SBS(QINTER) OPTION(*IMMED)
 
ENDSBS SBS(QBATCH) OPTION(*IMMED)
 
ENDSBS SBS(DCRF) OPTION(*IMMED)
 
ENDSBS SBS(UP1480BS) OPTION(*IMMED)
 
ENDSBS SBS(TLABARCODE) OPTION(*IMMED)
 
ENDSBS SBS(BC400SERVR) OPTION(*IMMED)
 
ENDSBS SBS(MONITOR2) OPTION(*IMMED)
 
 
/* End IMS, IMP, IOP, OMS, and EMA */
 
 
CHGDTAARA DTAARA(IMSWITCH) VALUE('STOP ')
 
CHGDTAARA DTAARA(IMPSWITCH) VALUE('STOP ')
 
CHGDTAARA DTAARA(IOPSWITCH) VALUE('STOP ')
 
CHGDTAARA DTAARA(OMSWITCH) VALUE('STOP ')
 
CHGDTAARA DTAARA(EMASWITCH) VALUE('STOP ')
 
 
ENDIMSJOB
 
ENDIMPJOB
 
ENDIOPJOB
 
ENDOMSJOB
 
ENDEMAJOBS
 
 
ENDIMSSUB OPTION(*IMMED)
 
ENDIMPSUB OPTION(*IMMED)
 
ENDIOPSUB OPTION(*IMMED)
 
ENDOMSSUB OPTION(*IMMED)
 
ENDEMASUB OPTION(*IMMED)
 
 
/* End Web servers, pause for one minute, then end subsystem */
 
 
ENDTCPSVR SERVER(*HTTP) HTTPSVR(WEBSMART)
 
ENDTCPSVR SERVER(*HTTP) HTTPSVR(WEBTEST)
 
ENDTCPSVR SERVER(*HTTP) HTTPSVR(WEBINTER)
 
DLYJOB DLY(60)
 
ENDSBS SBS(QHTTPSVR) DELAY(60)
 
 
/* Explicity end Telnet server with a 5 minute delay - otherwise */
 
/* there could be a problem with the RF guns */
 
 
ENDTCPSVR SERVER(*TELNET)
 
DLYJOB DLY(300)
 
   
  +
This does the overnight processing. It is called by EODDAILY and EODWEEKLY.
==EOD==
 
   
  +
* [[EODBUTEMP]]
/* Do temporary backup. This is to restore files if update program */
 
/* bombs. It can be used to do a quick restore if say, a user deletes */
 
/* something they shouldn't. And it is used to rebuild test libraries. */
 
 
CALL PGM([[Overnight ENDOFDAY#EODBUTEMP|EODBUTEMP]])
 
 
/* Set up production environment for company VA. */
 
 
CHGASWCOM COMPANY(VA)
 
 
/* Run End of Day updates. */
 
 
CALL PGM([[Overnight ENDOFDAY#EODUPD|EODUPD]])
 
 
/* Run End of Day reports. */
 
 
CALL PGM([[Overnight ENDOFDAY#EODRPT|EODRPT]])
 
 
/* Run End of Day housekeeping. */
 
 
CALL PGM([[Overnight ENDOFDAY#EODCLR|EODCLR]])
 
 
/* Clear consolidated item master file (XXITEMP). This is rebuilt in */
 
/* EODREBLD, but as it is used by so many jobs, it can be cleared only */
 
/* in the Application Restricted State. */
 
 
RCLRSC
 
CLRPFM FILE(XXITEMP)
 
 
/* Rebuild statistics files, and update summary files. As this can run */
 
/* while users are on the system, submit job to QBATCH so that it will */
 
/* run after the system is brought back up again. This gets it out of */
 
/* the restricted state sooner. */
 
 
SBMJOB CMD(CALL PGM([[Overnight ENDOFDAY#EODREBLD|EODREBLD]])) JOBQ(QS36EVOKE)
 
   
  +
This does a 'temporary' backup of the production data libraries, on tape '999999' which is reused every day. It can be used to restore files if something goes terribly wrong in the overnight processing, reload a file if something happens to it the next day (we have had users accidentally do mass deletes), or to rebuild the test environment (PL).
==EODBUTEMP==
 
   
  +
We used to do the regular backup at this point instead of after all the overnight processing. Then we discovered (during a year end audit) that transactions for the day had not updated G/L, A/R. etc on the tape.
/* Hold BRMS maintenance report so it doesn't print. */
 
 
OVRPRTF FILE(QP1AEP) HOLD(*YES)
 
 
/* Call BRMS Maintenance to expire tape '999999'. It has a one day */
 
/* retention, but still must be expired before it can be used again. */
 
/* Note that this temporary backup won't work if it runs before midnight.*/
 
 
STRMNTBRM RMVLOGE(*NONE) RUNCLNUP(*NO) RTVVOLSTAT(*NO) +
 
CHGJRN(*NO) PRTEXPMED(*NO) PRTVSNRPT(*NO) +
 
PRTBKUACT(*NO) PRTRCYRPT(*NONE)
 
 
/* Delete BRMS maintenance report */
 
 
DLTSPLF FILE(QP1AEP) SPLNBR(*LAST)
 
 
/* Run BRMS control group UNITEMP, which will save user data files only. */
 
 
STRBKUBRM CTLGRP(UNITEMP) SBMJOB(*NO)
 
   
  +
This is called by EOD.
==EODUPD==
 
   
  +
* [[EODUPD]]
/* Generate bills to suppliers for COOP AND VEDI. This has to run first */
 
/* so that generated entries will be included in the updates. */
 
 
CXBILL03C
 
CALL PGM(CXBILL06)
 
 
/* Run ASW command to put the current date minus 1 (as this job is */
 
/* running after midnight) into the LDA (local data area) */
 
 
CHGASWLDA TYPE(*DATDZ) RELVAL(-1) STARTPOS(001)
 
 
/* Extract yesterday's date from the LDA and convert it to numeric */
 
 
RTVDTAARA DTAARA(*LDA (1 8)) RTNVAR(&DATEC)
 
CHGVAR VAR(&DATE) VALUE(&DATEC)
 
 
/* Call ASW program to get yesterday's fiscal period, and convert to */
 
/* character. */
 
 
GETPERIOD DATE(&DATE) PERIOD(&PERIOD)
 
CHGVAR VAR(&PERIODC) VALUE(&PERIOD)
 
 
/* Print invoice journal. This will be file DMR352P in WRKSPLF EDOJOB. */
 
/* There are saved parameters for this. Just change the date and period.*/
 
 
RTVASWPAR PGM(DMC352) PAID(INVJOURNAL) USER(*ALL)
 
CHGASWLDA TYPE(*DATDZ) RELVAL(-1) STARTPOS(082)
 
CHGASWLDA VALUE(&PERIODC) TYPE(*CHAR) STARTPOS(090) +
 
POSITIONS(6)
 
EXCASWPGM PGM(DMC352) PARM(N)
 
 
/* Run nightly DIS to FIN. Again, there are saved parameters for this. */
 
/* Change the date and period. */
 
 
RTVASWPAR PGM(GCFC751) PAID(DIS2FIN) USER(*ALL)
 
CHGASWLDA TYPE(*DATDZ) RELVAL(-1) STARTPOS(082)
 
CHGASWLDA VALUE(&PERIODC) TYPE(*CHAR) STARTPOS(090) +
 
POSITIONS(6)
 
EXCASWPGM PGM(GCFC751) PARM(N)
 
 
/* Clear intermediate purchase suggestions from yesterday. */
 
 
RTVASWPAR PGM(DIC801) PAID(CLRSUGPO) USER(*ALL)
 
CHGASWLDA TYPE(*DATDZ) STARTPOS(1)
 
EXCASWPGM PGM(DIC801) PARM(N)
 
 
/* Generate purchase suggestions. */
 
 
RTVASWPAR PGM(INVC431) PAID(PURSUG2MAI) USER(*ALL)
 
EXCASWPGM PGM(INVC431) PARM(N)
 
 
RTVASWPAR PGM(INVC431) PAID(PURSUG3MAI) USER(*ALL)
 
EXCASWPGM PGM(INVC431) PARM(N)
 
 
/* Keep copy of purchase suggestions as there are sometimes questions */
 
/* about whether something was generated here, or manually. */
 
 
CPYF FROMFILE(UP1480BFVA/SROPUH) +
 
TOFILE(UP1480BFVA/SROPUH.B1) MBROPT(*REPLACE)
 
CPYF FROMFILE(UP1480BFVA/SROPUL) +
 
TOFILE(UP1480BFVA/SROPUL.B1) MBROPT(*REPLACE)
 
 
/* Update ASW Item Cost With Effective VEBA From CCP */
 
 
CALL PGM(IXRUP880)
 
 
/* Note that we can operate if the following jobs are not run. There may */
 
/* be some 'unexpected results', but that will not stop us from receiving,*/
 
/* picking, and shipping orders. */
 
 
/* Rebuild the Time Axis File */
 
 
RTVASWPAR PGM(DMC951) PAID(TIMEAXIS) USER(*ALL)
 
CHGASWLDA VALUE(&PERIODC) TYPE(*CHAR) STARTPOS(007) +
 
POSITIONS(6)
 
EXCASWPGM PGM(DMC951) PARM(N)
 
 
/* Rebuild A/R Credit Time Axis */
 
 
RTVASWPAR PGM(GDMC195) PAID(ARAXIS) USER(*ALL)
 
EXCASWPGM PGM(GDMC195) PARM(N)
 
 
/* Rebuild A/R and A/P Totals */
 
 
RTVASWPAR PGM(FSC880) PAID(ARAPREBLD) USER(*ALL)
 
EXCASWPGM PGM(FSC880) PARM(N)
 
 
/* Calculate items that will have a 5% increase in cost or 5% decrease */
 
/* in gross margin %, and email buyer. */
 
 
CALL PGM(IXRIQ405)
 
 
/* Send any 'READY' promos to ECU */
 
 
ECUPROMO
 
 
/* Adjust demand by items on promo. This is so that purchase */
 
/* suggestions for regular stocked items are not inflated by promo sales.*/
 
 
PXDEMAND
 
 
/* Use average purchase cost for warehouse MAI in SROSRO to update */
 
/* average purchase cost in SROSRO for RET, and average purchase cost */
 
/* in base item master file SROPRG. */
 
/* Do not share open data path, as SRBPRG may not be open for update. */
 
 
OVRDBF FILE(SRBPRG) TOFILE(SRBPRG) SHARE(*NO)
 
CALL PGM(AVGCST01)
 
 
/* Run miscellaneous billing - extract VEDI and COOP to be billed */
 
 
CALL PGM(CXBILL)
 
 
/* FTP Sales Orders with no invoiced lines. Normally, the FTP'ed */
 
/* invoice file includes cancelled order lines. This will send orders */
 
/* that haven't generated an invoice. */
 
 
CALL PGM(INVCUP300)
 
 
/* For miscellaneous (VEDI & COOP) billing, settle invoice to transfers */
 
 
CALL PGM(CXBILL07)
 
 
/* Cancel any held POS orders that are four days old or more */
 
 
CALL PGM(IOPMIN04)
 
 
/* Delete item notes that have expired */
 
 
CALL PGM(DMRUP101)
 
 
/* Try to reorganize Carrier Interface File */
 
 
RGZPFM FILE(ATLASPF)
 
   
  +
This does the updating that requires all users to be off the system. It is called by EOD.
==EODRPT==
 
   
  +
* [[EODRPT]]
/* DIS and WHM Integrity Reports - WHOLOP not balanced to SROSRO. For */
 
/* both MAI and RET. */
 
 
RTVASWPAR PGM(WMC251S) PAID(INTEGREP) USER(*ALL)
 
EXCASWPGM PGM(WMC251S) PARM(N)
 
RTVASWPAR PGM(WMC251S) PAID(RETINTEQ) USER(*ALL)
 
EXCASWPGM PGM(WMC251S) PARM(N)
 
 
/* Print onhand inventory at cost for both warehouses */
 
 
CHGJOB OUTQ(ELAHO)
 
RUNQRY QRY(STOCKST02A)
 
 
/* Print Lost Sales Report */
 
 
LOSTSALES
 
 
/* Reset out of stock code of 'A' or 'B' for items not back in stock. */
 
CALL PGM(PLZUP050)
 
   
  +
This generates reports. It is called by EOD.
==EODCLR==
 
   
  +
* [[EODREBLD]]
/* Delete spool files generated by ASW End of Day - only keep Invoice */
 
/* Register. */
 
 
DLTSPLF FILE(GCFP752) SPLNBR(*LAST)
 
DLTSPLF FILE(FKR050P) SPLNBR(*LAST)
 
DLTSPLF FILE(FMR050P) SPLNBR(*LAST)
 
DLTSPLF FILE(FMR050P) SPLNBR(*LAST)
 
DLTSPLF FILE(FMR066P) SPLNBR(*LAST)
 
DLTSPLF FILE(FMR065P) SPLNBR(*LAST)
 
DLTSPLF FILE(FMR065P) SPLNBR(*LAST)
 
 
/* Clear out queues of reports generated, but never actually printed */
 
 
CLROUTQ OUTQ(ASWPICKLST)
 
CLROUTQ OUTQ(ASWPUTAWAY)
 
CLROUTQ OUTQ(ASWSOREDI)
 
CLROUTQ OUTQ(JFPIPE)
 
 
/* Clear unused reports from Out Queues */
 
 
CALL PGM([[Overnight ENDOFDAY#OUTQCLEAR|OUTQCLEAR]])
 
 
/* Clear Pick List work files (these should be cleared each time the */
 
/* user exists the program, but apparently aren't always) */
 
 
CLRPFM FILE(WKPL30P)
 
CLRPFM FILE(WKPL40P)
 
CLRPFM FILE(WKPL45P)
 
 
/* Clear work files. Some of this are used in WebSmart; they are by */
 
/* user, and are only cleared when they make a new selection. Which */
 
/* means if they are not cleared here, there will be a set of records */
 
/* for every user who has ever used the program, and the file will grow. */
 
 
CLRPFM FILE(UROLCU)
 
CLRPFM FILE(WSVENODTP)
 
CLRPFM FILE(WSVENOSP)
 
CLRPFM FILE(WSGENERP)
 
CLRPFM FILE(WOPUR01AP)
 
CLRPFM FILE(WSCSTSLS1P)
 
CLRPFM FILE(INTRANSP)
 
CLRPFM FILE(INTRANS2P)
 
CLRPFM FILE(CAINTSLSP)
 
CLRPFM FILE(DETORDCST)
 
CLRPFM FILE(IUSERS)
 
CLRPFM FILE(SUMDCACT)
 
CLRPFM FILE(SUMINVC01)
 
CLRPFM FILE(SUMINVC02)
 
CLRPFM FILE(SUMSLSC02)
 
CLRPFM FILE(SUMSLSC03)
 
CLRPFM FILE(POSUM01)
 
CLRPFM FILE(POSUM01A)
 
CLRPFM FILE(PODET01)
 
 
/* Clear promo report work files */
 
 
CLRPFM FILE(PXWRK05P)
 
CLRPFM FILE(PXWRK06P)
 
   
  +
This rebuilds/updates master and statistic files used by Web Orders and InfoNet. These are built as part of the overnight processing instead of when a user requests the information. This also clears work files and spool files. It is submitted to QBATCH by EOD, to run after the restricted state has ended; about 5:00AM.
==EODREBLD==
 
   
  +
* [[EODCLR]]
/* clear files and folders for Web Orders */
 
/* there are some Unix commands run in Qshell that sometimes fail, so */
 
/* submit it to batch and wait for it to complete. If it doesn't, it */
 
/* won't affect the end of day - but the image and specification in Web */
 
/* Orders may not be correct. */
 
 
SBMJOB CMD(CALL PGM(WSOVERNIT1)) JOBQ(QS36EVOKE)
 
DLYJOB DLY(420)
 
 
/* rebuild files for Web Orders */
 
 
CALL PGM(WSOVERNIT2)
 
 
/* Build consolidated item master file (XXITEMP) */
 
 
CALL PGM(ITEMINFOCA)
 
 
/* Build summary file of lost sales */
 
/* (ITEMSTAT uses this file, so this has to run first) */
 
 
CLRPFM FILE(SUMVENLST)
 
CALL PGM(BLDSUMLST)
 
 
/* Rebuild item statistics file (XXSTATSP) */
 
 
CLRPFM FILE(XXSTATSP)
 
CALL PGM(ITEMSTAT)
 
 
/* Rebuild promo results files (for InfoNet) */
 
 
CALL PGM(PXRESBUILD)
 
 
/* Build summary file of sales (including brand) by customer */
 
/* (for IN_CUSTSLS) */
 
 
CALL PGM(BLDCSTSL2) PARM(' ')
 
 
/* Build summary file of freight vs sales (current and previous month) */
 
 
CALL PGM(BLDSUMFRT) PARM(' ')
 
CALL PGM(BLDSUMFRTP)
 
 
/* Build summary file to validate Analyser */
 
 
CALL PGM(BLDANAWRK)
 
 
/* Search for duplicate keys in ANOSTK */
 
 
RUNQRY QRY(ANOSTKCNT1) QRYFILE((*LIBL/ANOSTK))
 
RUNQRY QRY(ANOSTKCNT2) QRYFILE((*LIBL/ANOCOUNT))
 
 
/* Build file of sales order pattern - sales by the hour */
 
 
CALL PGM(BLDORDLIN) PARM(' ')
 
 
/* Build file of sales order statistics by day */
 
 
CALL PGM(BLDDAYLINF)
 
 
/* Build file of PO fill rates */
 
 
CALL PGM(BLDPOFRT) PARM(' ')
 
 
/* Build file of sales and budget by item account group */
 
 
CALL PGM(BLDSLSBUD) PARM(' ')
 
 
/* Build summary file of lost sales by warehouse */
 
 
CLRPFM FILE(SUMWHSLST)
 
CALL PGM(BLDWHSLST)
 
 
/* Build file of VEBA by province by day */
 
 
CALL PGM(BLDVEBA) PARM(' ')
 
 
 
/* send email that rebuild is complete */
 
 
CHGVAR VAR(&SMSG) VALUE('Statistics files rebuild +
 
is complete')
 
CHGVAR VAR(&LMSG) VALUE(&SMSG)
 
CALL PGM(OPMSGSEND) PARM(&SMSG &LMSG)
 
   
  +
Deletes reports that are generated but will never be printed; for example pick and putaway lists that we don't use because we use RF. Clears temporary work files. The programs that use these files delete records for the user. This program clears the files, which gets rid of these deleted records. This is called by EODREBLD.
==OUTQCLEAR==
 
   
  +
* [[OUTQCLEAR]]
/* Write list of spool files in out queues PRT01 and QPRINT to spool */
 
  +
/* files, then copy those spool files to a data file. */
 
  +
Runs a query against a file of all entries in out queues PRT01 and QPRINT, and builds a file of reports that can be deleted. Then reads that file, and deletes them. This is called by EODCLR.
 
  +
WRKOUTQ OUTQ(PRT01) OUTPUT(*PRINT)
 
  +
* [[WSOVERNIT1]]
CPYSPLF FILE(QPRTSPLQ) TOFILE(REPORT) SPLNBR(*LAST) +
 
  +
TOMBR(OUTQ)
 
  +
This is part of the process to rebuild files for Web Orders. On the Power 8, the shell commands sometimes come to a hard stop and need an operator response. That would stop the over night processing from completing. So EODREBLD submits this program, does something else that takes about 20 minutes, then runs the next part. If some of the shell commands are not run, the only effect on Web Orders is that some pictures or specifications may be missing. This is called by EODREBLD.
WRKOUTQ OUTQ(QPRINT) OUTPUT(*PRINT)
 
  +
CPYSPLF FILE(QPRTSPLQ) TOFILE(REPORT) SPLNBR(*LAST) +
 
  +
* [[WSOVERNIT2]]
TOMBR(OUTQ) MBROPT(*ADD)
 
  +
 
  +
This rebuilds files used in Web Orders. They are built once here, so they don't have to be rebuilt every time a store makes a request. This is called by EODREBLD.
/* Run a query to build a file of all spool files that can be deleted. */
 
  +
/* This query has a list of reports that are never printed. */
 
  +
* [[EODEMAIL]]
 
  +
RUNQRY QRY(OUTQCLR) QRYFILE((*LIBL/REPORT))
 
  +
This is called by the scheduler (job name EODEMAIL) every day at 8:00AM. It will email IT saying which tape volume was used for the backup, and archive the BRMS recovery reports to SuperServer.
 
  +
/* Read through the created file, and delete those spool files in it. */
 
  +
=Summary=
 
  +
NEXT:
 
  +
Order of events:
RCVF RCDFMT(OUTQDEL)
 
  +
MONMSG MSGID(CPF0864) EXEC(GOTO CMDLBL(END))
 
  +
'''Scheduled job name: ENDOFDAY, 1AM'''
CHGVAR VAR(&NUMBER) VALUE(&FILENUMB)
 
  +
# CL: EODDAILY
DLTSPLF FILE(&FILE) JOB(&JOBNUMB/&USER/&JOB) +
 
  +
## CL: EODEND2
SPLNBR(&NUMBER)
 
  +
## CL: EOD
GOTO CMDLBL(NEXT)
 
  +
### CL: EODBUTEMP
 
  +
### CL: EODUPD
END:
 
  +
### CL: EODRPT
 
  +
### SBMJOB: EODRBLD (queued until system up)
/* Delete the two spool files that were created. */
 
  +
 
  +
'''Scheduled job name: EODSAVE, 3AM'''
DLTSPLF FILE(QPRTSPLQ) SPLNBR(*LAST)
 
  +
# CL: EODBU
DLTSPLF FILE(QPRTSPLQ) SPLNBR(*LAST)
 
  +
## CL: EODEND3
  +
## SBMJOB: STRBKUBRM (full system save)
  +
  +
'''System up: ~5AM'''
  +
# EODRBLD from earlier job runs
  +
## SBMJOB: WSOVERNIT1
  +
## CL: WSOVERNIT2
  +
## CL: EODCLR
  +
  +
[[Category: Overnight Processing]]

Latest revision as of 16:16, 24 November 2016

The scheduler starts this job at 1:00AM; every morning except Sunday - when the End of Week is called. It calls EODDAILY, which will -

- End all programs that use ASW or extension files, and end subsystems so users cannot sign on.

- Do a 'temporary' backup of data libraries only. This uses tape '999999', which has a retention period of one day so that it can be over written every night. It can be used if something happens during the overnight processing, to quickly restore a file the next day if needed (without having to call the tape from off site storage), and to rebuild the test environment.

- Run updates, reports, and housekeeping (clear work files and out queues, and delete unnecessary spool files).

The following sections only show the main functions in the programs; not any error checking. Whenever there can be an error that shouldn't affect processing, the programs have the MONMSG (monitor message) command to ignore it. When a file that is to be rebuilt can't be cleared (because it is in use by another job), the program will automatically skip the rebuild.

This is called by the scheduler (job name ENDOFDAY) every day except Sunday, at 1:00AM. It puts the computer into an application restricted state. If it fails, it will be cancelled by the backup; which starts at 3:00AM.

This will end all processes that can use either ASW or extension files. This does not end Domino, so that I.T. staff will receive the emails being sent. This is called by EODDAILY and EODWEEKLY.

This does the overnight processing. It is called by EODDAILY and EODWEEKLY.

This does a 'temporary' backup of the production data libraries, on tape '999999' which is reused every day. It can be used to restore files if something goes terribly wrong in the overnight processing, reload a file if something happens to it the next day (we have had users accidentally do mass deletes), or to rebuild the test environment (PL).

We used to do the regular backup at this point instead of after all the overnight processing. Then we discovered (during a year end audit) that transactions for the day had not updated G/L, A/R. etc on the tape.

This is called by EOD.

This does the updating that requires all users to be off the system. It is called by EOD.

This generates reports. It is called by EOD.

This rebuilds/updates master and statistic files used by Web Orders and InfoNet. These are built as part of the overnight processing instead of when a user requests the information. This also clears work files and spool files. It is submitted to QBATCH by EOD, to run after the restricted state has ended; about 5:00AM.

Deletes reports that are generated but will never be printed; for example pick and putaway lists that we don't use because we use RF. Clears temporary work files. The programs that use these files delete records for the user. This program clears the files, which gets rid of these deleted records. This is called by EODREBLD.

Runs a query against a file of all entries in out queues PRT01 and QPRINT, and builds a file of reports that can be deleted. Then reads that file, and deletes them. This is called by EODCLR.

This is part of the process to rebuild files for Web Orders. On the Power 8, the shell commands sometimes come to a hard stop and need an operator response. That would stop the over night processing from completing. So EODREBLD submits this program, does something else that takes about 20 minutes, then runs the next part. If some of the shell commands are not run, the only effect on Web Orders is that some pictures or specifications may be missing. This is called by EODREBLD.

This rebuilds files used in Web Orders. They are built once here, so they don't have to be rebuilt every time a store makes a request. This is called by EODREBLD.

This is called by the scheduler (job name EODEMAIL) every day at 8:00AM. It will email IT saying which tape volume was used for the backup, and archive the BRMS recovery reports to SuperServer.

Summary

Order of events:

Scheduled job name: ENDOFDAY, 1AM

  1. CL: EODDAILY
    1. CL: EODEND2
    2. CL: EOD
      1. CL: EODBUTEMP
      2. CL: EODUPD
      3. CL: EODRPT
      4. SBMJOB: EODRBLD (queued until system up)

Scheduled job name: EODSAVE, 3AM

  1. CL: EODBU
    1. CL: EODEND3
    2. SBMJOB: STRBKUBRM (full system save)

System up: ~5AM

  1. EODRBLD from earlier job runs
    1. SBMJOB: WSOVERNIT1
    2. CL: WSOVERNIT2
    3. CL: EODCLR