Difference between revisions of "Information Systems:Overnight ENDOFDAY"

From uniWIKI
Jump to navigation Jump to search
 
(13 intermediate revisions by 2 users not shown)
Line 1: Line 1:
The scheduler starts this job at 1:00AM; every morning except Sunday - when the End of Week is called. It calls [[Overnight ENDOFDAY#EODDAILY|EODDAILY]], which will -
+
The scheduler starts this job at 1:00AM; every morning except Sunday - when the End of Week is called. It calls [[EODDAILY]], which will -
   
 
- End all programs that use ASW or extension files, and end subsystems so users cannot sign on.
 
- End all programs that use ASW or extension files, and end subsystems so users cannot sign on.
Line 9: Line 9:
 
The following sections only show the main functions in the programs; not any error checking. Whenever there can be an error that shouldn't affect processing, the programs have the MONMSG (monitor message) command to ignore it. When a file that is to be rebuilt can't be cleared (because it is in use by another job), the program will automatically skip the rebuild.
 
The following sections only show the main functions in the programs; not any error checking. Whenever there can be an error that shouldn't affect processing, the programs have the MONMSG (monitor message) command to ignore it. When a file that is to be rebuilt can't be cleared (because it is in use by another job), the program will automatically skip the rebuild.
   
==EODDAILY==
+
* [[EODDAILY]]
   
  +
This is called by the scheduler (job name ENDOFDAY) every day except Sunday, at 1:00AM. It puts the computer into an application restricted state. If it fails, it will be cancelled by the backup; which starts at 3:00AM.
/* send email that daily overnight process is starting */
 
 
CHGVAR VAR(&SMSG) VALUE('EOD starting (2:15 3:00 +
 
5:00 6:30)')
 
CHGVAR VAR(&LMSG) VALUE(&SMSG)
 
CALL PGM(OPMSGSEND) PARM(&SMSG &LMSG)
 
 
/* End all processes that use either ASW or extension files. This is */
 
/* so that the temporary backup can save all files, and because some of */
 
/* the ASW jobs cannot run if any other jobs are using their files. */
 
 
CALL PGM([[Overnight ENDOFDAY#EODEND2|EODEND2]])
 
 
/* run End of Day processing */
 
 
CALL PGM([[Overnight ENDOFDAY#EOD|EOD]])
 
 
/* send email that daily overnight process ended normally */
 
 
CHGVAR VAR(&SMSG) VALUE('Daily overnite processing +
 
ended Normally')
 
CHGVAR VAR(&LMSG) VALUE('This message means there +
 
were no errors that halted processing. If +
 
this message is not sent, it means the +
 
full backup cancelled this job.')
 
CALL PGM(OPMSGSEND) PARM(&SMSG &LMSG)
 
   
==EODEND2==
+
* [[EODEND2]]
   
This will end all processes that can use either ASW or extension files. This does not end Domino, so that I.T. staff will receive the emails being sent.
+
This will end all processes that can use either ASW or extension files. This does not end Domino, so that I.T. staff will receive the emails being sent. This is called by EODDAILY and EODWEEKLY.
   
  +
* [[EOD]]
/* End EDI monitors for SPS Commerce and EDI Gateway */
 
 
EDIENDMON
 
EDIENDEDIG
 
 
/* End subsystems that run user jobs */
 
 
ENDSBS SBS(QINTER) OPTION(*IMMED)
 
ENDSBS SBS(QBATCH) OPTION(*IMMED)
 
ENDSBS SBS(DCRF) OPTION(*IMMED)
 
ENDSBS SBS(UP1480BS) OPTION(*IMMED)
 
ENDSBS SBS(TLABARCODE) OPTION(*IMMED)
 
ENDSBS SBS(BC400SERVR) OPTION(*IMMED)
 
ENDSBS SBS(MONITOR2) OPTION(*IMMED)
 
 
/* End IMS, IMP, IOP, OMS, and EMA */
 
 
CHGDTAARA DTAARA(IMSWITCH) VALUE('STOP ')
 
CHGDTAARA DTAARA(IMPSWITCH) VALUE('STOP ')
 
CHGDTAARA DTAARA(IOPSWITCH) VALUE('STOP ')
 
CHGDTAARA DTAARA(OMSWITCH) VALUE('STOP ')
 
CHGDTAARA DTAARA(EMASWITCH) VALUE('STOP ')
 
 
ENDIMSJOB
 
ENDIMPJOB
 
ENDIOPJOB
 
ENDOMSJOB
 
ENDEMAJOBS
 
 
ENDIMSSUB OPTION(*IMMED)
 
ENDIMPSUB OPTION(*IMMED)
 
ENDIOPSUB OPTION(*IMMED)
 
ENDOMSSUB OPTION(*IMMED)
 
ENDEMASUB OPTION(*IMMED)
 
 
/* End Web servers, pause for one minute, then end subsystem */
 
 
ENDTCPSVR SERVER(*HTTP) HTTPSVR(WEBSMART)
 
ENDTCPSVR SERVER(*HTTP) HTTPSVR(WEBTEST)
 
ENDTCPSVR SERVER(*HTTP) HTTPSVR(WEBINTER)
 
DLYJOB DLY(60)
 
ENDSBS SBS(QHTTPSVR) DELAY(60)
 
 
/* Explicity end Telnet server with a 5 minute delay - otherwise */
 
/* there could be a problem with the RF guns */
 
 
ENDTCPSVR SERVER(*TELNET)
 
DLYJOB DLY(300)
 
   
  +
This does the overnight processing. It is called by EODDAILY and EODWEEKLY.
==EOD==
 
   
  +
* [[EODBUTEMP]]
/* Do temporary backup. This is to restore files if update program */
 
/* bombs. It can be used to do a quick restore if say, a user deletes */
 
/* something they shouldn't. And it is used to rebuild test libraries. */
 
 
CALL PGM([[Overnight ENDOFDAY#EODBUTEMP|EODBUTEMP]])
 
 
/* Set up production environment for company VA. */
 
 
CHGASWCOM COMPANY(VA)
 
 
/* Run End of Day updates. */
 
 
CALL PGM([[Overnight ENDOFDAY#EODUPD|EODUPD]])
 
 
/* Run End of Day reports. */
 
 
CALL PGM([[Overnight ENDOFDAY#EODRPT|EODRPT]])
 
 
/* Run End of Day housekeeping. */
 
 
CALL PGM([[Overnight ENDOFDAY#EODCLR|EODCLR]])
 
 
/* Clear consolidated item master file (XXITEMP). This is rebuilt in */
 
/* EODREBLD, but as it is used by so many jobs, it can be cleared only */
 
/* in the Application Restricted State. */
 
 
RCLRSC
 
CLRPFM FILE(XXITEMP)
 
 
/* Rebuild statistics files, and update summary files. As this can run */
 
/* while users are on the system, submit job to QBATCH so that it will */
 
/* run after the system is brought back up again. This gets it out of */
 
/* the restricted state sooner. */
 
 
SBMJOB CMD(CALL PGM([[Overnight ENDOFDAY#EODREBLD|EODREBLD]])) JOBQ(QS36EVOKE)
 
   
  +
This does a 'temporary' backup of the production data libraries, on tape '999999' which is reused every day. It can be used to restore files if something goes terribly wrong in the overnight processing, reload a file if something happens to it the next day (we have had users accidentally do mass deletes), or to rebuild the test environment (PL).
==EODBUTEMP==
 
   
  +
We used to do the regular backup at this point instead of after all the overnight processing. Then we discovered (during a year end audit) that transactions for the day had not updated G/L, A/R. etc on the tape.
/* Hold BRMS maintenance report so it doesn't print. */
 
 
OVRPRTF FILE(QP1AEP) HOLD(*YES)
 
 
/* Call BRMS Maintenance to expire tape '999999'. It has a one day */
 
/* retention, but still must be expired before it can be used again. */
 
/* Note that this temporary backup won't work if it runs before midnight.*/
 
 
STRMNTBRM RMVLOGE(*NONE) RUNCLNUP(*NO) RTVVOLSTAT(*NO) +
 
CHGJRN(*NO) PRTEXPMED(*NO) PRTVSNRPT(*NO) +
 
PRTBKUACT(*NO) PRTRCYRPT(*NONE)
 
 
/* Delete BRMS maintenance report */
 
 
DLTSPLF FILE(QP1AEP) SPLNBR(*LAST)
 
 
/* Run BRMS control group UNITEMP, which will save user data files only. */
 
 
STRBKUBRM CTLGRP(UNITEMP) SBMJOB(*NO)
 
   
  +
This is called by EOD.
==EODUPD==
 
   
  +
* [[EODUPD]]
/* Generate bills to suppliers for COOP AND VEDI. This has to run first */
 
/* so that generated entries will be included in the updates. */
 
 
CXBILL03C
 
CALL PGM(CXBILL06)
 
 
/* Run ASW command to put the current date minus 1 (as this job is */
 
/* running after midnight) into the LDA (local data area) */
 
 
CHGASWLDA TYPE(*DATDZ) RELVAL(-1) STARTPOS(001)
 
 
/* Extract yesterday's date from the LDA and convert it to numeric */
 
 
RTVDTAARA DTAARA(*LDA (1 8)) RTNVAR(&DATEC)
 
CHGVAR VAR(&DATE) VALUE(&DATEC)
 
 
/* Call ASW program to get yesterday's fiscal period, and convert to */
 
/* character. */
 
 
GETPERIOD DATE(&DATE) PERIOD(&PERIOD)
 
CHGVAR VAR(&PERIODC) VALUE(&PERIOD)
 
 
/* Print invoice journal. This will be file DMR352P in WRKSPLF EDOJOB. */
 
/* There are saved parameters for this. Just change the date and period.*/
 
 
RTVASWPAR PGM(DMC352) PAID(INVJOURNAL) USER(*ALL)
 
CHGASWLDA TYPE(*DATDZ) RELVAL(-1) STARTPOS(082)
 
CHGASWLDA VALUE(&PERIODC) TYPE(*CHAR) STARTPOS(090) +
 
POSITIONS(6)
 
EXCASWPGM PGM(DMC352) PARM(N)
 
 
/* Run nightly DIS to FIN. Again, there are saved parameters for this. */
 
/* Change the date and period. */
 
 
RTVASWPAR PGM(GCFC751) PAID(DIS2FIN) USER(*ALL)
 
CHGASWLDA TYPE(*DATDZ) RELVAL(-1) STARTPOS(082)
 
CHGASWLDA VALUE(&PERIODC) TYPE(*CHAR) STARTPOS(090) +
 
POSITIONS(6)
 
EXCASWPGM PGM(GCFC751) PARM(N)
 
 
/* Clear intermediate purchase suggestions from yesterday. */
 
 
RTVASWPAR PGM(DIC801) PAID(CLRSUGPO) USER(*ALL)
 
CHGASWLDA TYPE(*DATDZ) STARTPOS(1)
 
EXCASWPGM PGM(DIC801) PARM(N)
 
 
/* Generate purchase suggestions. */
 
 
RTVASWPAR PGM(INVC431) PAID(PURSUG2MAI) USER(*ALL)
 
EXCASWPGM PGM(INVC431) PARM(N)
 
 
RTVASWPAR PGM(INVC431) PAID(PURSUG3MAI) USER(*ALL)
 
EXCASWPGM PGM(INVC431) PARM(N)
 
 
/* Keep copy of purchase suggestions as there are sometimes questions */
 
/* about whether something was generated here, or manually. */
 
 
CPYF FROMFILE(UP1480BFVA/SROPUH) +
 
TOFILE(UP1480BFVA/SROPUH.B1) MBROPT(*REPLACE)
 
CPYF FROMFILE(UP1480BFVA/SROPUL) +
 
TOFILE(UP1480BFVA/SROPUL.B1) MBROPT(*REPLACE)
 
 
/* Update ASW Item Cost With Effective VEBA From CCP */
 
 
CALL PGM(IXRUP880)
 
 
/* Note that we can operate if the following jobs are not run. There may */
 
/* be some 'unexpected results', but that will not stop us from receiving,*/
 
/* picking, and shipping orders. */
 
 
/* Rebuild the Time Axis File */
 
 
RTVASWPAR PGM(DMC951) PAID(TIMEAXIS) USER(*ALL)
 
CHGASWLDA VALUE(&PERIODC) TYPE(*CHAR) STARTPOS(007) +
 
POSITIONS(6)
 
EXCASWPGM PGM(DMC951) PARM(N)
 
 
/* Rebuild A/R Credit Time Axis */
 
 
RTVASWPAR PGM(GDMC195) PAID(ARAXIS) USER(*ALL)
 
EXCASWPGM PGM(GDMC195) PARM(N)
 
 
/* Rebuild A/R and A/P Totals */
 
 
RTVASWPAR PGM(FSC880) PAID(ARAPREBLD) USER(*ALL)
 
EXCASWPGM PGM(FSC880) PARM(N)
 
 
/* Calculate items that will have a 5% increase in cost or 5% decrease */
 
/* in gross margin %, and email buyer. */
 
 
CALL PGM(IXRIQ405)
 
 
/* Send any 'READY' promos to ECU */
 
 
ECUPROMO
 
 
/* Adjust demand by items on promo. This is so that purchase */
 
/* suggestions for regular stocked items are not inflated by promo sales.*/
 
 
PXDEMAND
 
 
/* Use average purchase cost for warehouse MAI in SROSRO to update */
 
/* average purchase cost in SROSRO for RET, and average purchase cost */
 
/* in base item master file SROPRG. */
 
/* Do not share open data path, as SRBPRG may not be open for update. */
 
 
OVRDBF FILE(SRBPRG) TOFILE(SRBPRG) SHARE(*NO)
 
CALL PGM(AVGCST01)
 
 
/* Run miscellaneous billing - extract VEDI and COOP to be billed */
 
 
CALL PGM(CXBILL)
 
 
/* FTP Sales Orders with no invoiced lines. Normally, the FTP'ed */
 
/* invoice file includes cancelled order lines. This will send orders */
 
/* that haven't generated an invoice. */
 
 
CALL PGM(INVCUP300)
 
 
/* For miscellaneous (VEDI & COOP) billing, settle invoice to transfers */
 
 
CALL PGM(CXBILL07)
 
 
/* Cancel any held POS orders that are four days old or more */
 
 
CALL PGM(IOPMIN04)
 
 
/* Delete item notes that have expired */
 
 
CALL PGM(DMRUP101)
 
 
/* Try to reorganize Carrier Interface File */
 
 
RGZPFM FILE(ATLASPF)
 
   
  +
This does the updating that requires all users to be off the system. It is called by EOD.
==EODRPT==
 
   
  +
* [[EODRPT]]
/* DIS and WHM Integrity Reports - WHOLOP not balanced to SROSRO. For */
 
/* both MAI and RET. */
 
 
RTVASWPAR PGM(WMC251S) PAID(MAIINT) USER(*ALL)
 
EXCASWPGM PGM(WMC251S) PARM(N)
 
RTVASWPAR PGM(WMC251S) PAID(RETINT) USER(*ALL)
 
EXCASWPGM PGM(WMC251S) PARM(N)
 
 
/* Print onhand inventory at cost for both warehouses */
 
 
CHGJOB OUTQ(ELAHO)
 
RUNQRY QRY(STOCKST02A)
 
 
/* Print Lost Sales Report */
 
 
LOSTSALES
 
 
/* Reset out of stock code of 'A' or 'B' for items not back in stock. */
 
CALL PGM(PLZUP050)
 
   
  +
This generates reports. It is called by EOD.
==EODCLR==
 
   
  +
* [[EODREBLD]]
/* Delete spool files generated by ASW End of Day - only keep Invoice */
 
/* Register. */
 
 
DLTSPLF FILE(GCFP752) SPLNBR(*LAST)
 
DLTSPLF FILE(FKR050P) SPLNBR(*LAST)
 
DLTSPLF FILE(FMR050P) SPLNBR(*LAST)
 
DLTSPLF FILE(FMR050P) SPLNBR(*LAST)
 
DLTSPLF FILE(FMR066P) SPLNBR(*LAST)
 
DLTSPLF FILE(FMR065P) SPLNBR(*LAST)
 
DLTSPLF FILE(FMR065P) SPLNBR(*LAST)
 
 
/* Clear out queues of reports generated, but never actually printed */
 
 
CLROUTQ OUTQ(ASWPICKLST)
 
CLROUTQ OUTQ(ASWPUTAWAY)
 
CLROUTQ OUTQ(ASWSOREDI)
 
CLROUTQ OUTQ(JFPIPE)
 
 
/* Clear Pick List work files (these should be cleared each time the */
 
/* user exists the program, but apparently aren't always) */
 
 
CLRPFM FILE(WKPL30P)
 
CLRPFM FILE(WKPL40P)
 
CLRPFM FILE(WKPL45P)
 
 
/* Clear work files. Some of this are used in WebSmart; they are by */
 
/* user, and are only cleared when they make a new selection. Which */
 
/* means if they are not cleared here, there will be a set of records */
 
/* for every user who has ever used the program, and the file will grow. */
 
 
CLRPFM FILE(UROLCU)
 
CLRPFM FILE(WSVENODTP)
 
CLRPFM FILE(WSVENOSP)
 
CLRPFM FILE(WSGENERP)
 
CLRPFM FILE(WOPUR01AP)
 
CLRPFM FILE(WSCSTSLS1P)
 
CLRPFM FILE(INTRANSP)
 
CLRPFM FILE(INTRANS2P)
 
CLRPFM FILE(CAINTSLSP)
 
CLRPFM FILE(DETORDCST)
 
CLRPFM FILE(IUSERS)
 
CLRPFM FILE(SUMDCACT)
 
CLRPFM FILE(SUMINVC01)
 
CLRPFM FILE(SUMINVC02)
 
CLRPFM FILE(SUMSLSC02)
 
CLRPFM FILE(SUMSLSC03)
 
CLRPFM FILE(POSUM01)
 
CLRPFM FILE(POSUM01A)
 
CLRPFM FILE(PODET01)
 
 
/* Clear promo report work files */
 
 
CLRPFM FILE(PXWRK05P)
 
CLRPFM FILE(PXWRK06P)
 
 
/* Clear unused reports from Out Queues */
 
 
CALL PGM([[Overnight ENDOFDAY#OUTQCLEAR|OUTQCLEAR]])
 
   
  +
This rebuilds/updates master and statistic files used by Web Orders and InfoNet. These are built as part of the overnight processing instead of when a user requests the information. This also clears work files and spool files. It is submitted to QBATCH by EOD, to run after the restricted state has ended; about 5:00AM.
==EODREBLD==
 
   
  +
* [[EODCLR]]
/* clear files and folders for Web Orders */
 
/* there are some Unix commands run in Qshell that sometimes fail, so */
 
/* submit it to batch and wait for it to complete. If it doesn't, it */
 
/* won't affect the end of day - but the image and specification in Web */
 
/* Orders may not be correct. */
 
 
SBMJOB CMD(CALL PGM(WSOVERNIT1)) JOBQ(QS36EVOKE)
 
DLYJOB DLY(420)
 
 
/* Build consolidated item master file (XXITEMP). This must run before */
 
/* Web Order files are rebuilt. */
 
 
CALL PGM(ITEMINFOCA)
 
 
/* rebuild files for Web Orders */
 
 
CALL PGM([[Overnight ENDOFDAY#WSOVERNIT2|WSOVERNIT2]])
 
 
/* Run End of Day housekeeping. */
 
 
CALL PGM(EODCLR)
 
 
/* Build summary file of lost sales */
 
/* (ITEMSTAT uses this file, so this has to run first) */
 
 
CLRPFM FILE(SUMVENLST)
 
CALL PGM(BLDSUMLST)
 
 
/* Rebuild item statistics file (XXSTATSP) */
 
 
CLRPFM FILE(XXSTATSP)
 
CALL PGM(ITEMSTAT)
 
 
/* Rebuild promo results files (for InfoNet) */
 
 
CALL PGM(PXRESBUILD)
 
 
/* Build summary file of sales (including brand) by customer */
 
/* (for IN_CUSTSLS) */
 
 
CALL PGM(BLDCSTSL2) PARM(' ')
 
 
/* Build summary file of freight vs sales (current and previous month) */
 
 
CALL PGM(BLDSUMFRT) PARM(' ')
 
CALL PGM(BLDSUMFRTP)
 
 
/* Build summary file to validate Analyser */
 
 
CALL PGM(BLDANAWRK)
 
 
/* Search for duplicate keys in ANOSTK */
 
 
RUNQRY QRY(ANOSTKCNT1) QRYFILE((*LIBL/ANOSTK))
 
RUNQRY QRY(ANOSTKCNT2) QRYFILE((*LIBL/ANOCOUNT))
 
 
/* Build file of sales order pattern - sales by the hour */
 
 
CALL PGM(BLDORDLIN) PARM(' ')
 
 
/* Build file of sales order statistics by day */
 
 
CALL PGM(BLDDAYLINF)
 
 
/* Build file of PO fill rates */
 
 
CALL PGM(BLDPOFRT) PARM(' ')
 
 
/* Build file of sales and budget by item account group */
 
 
CALL PGM(BLDSLSBUD) PARM(' ')
 
 
/* Build summary file of lost sales by warehouse */
 
 
CLRPFM FILE(SUMWHSLST)
 
CALL PGM(BLDWHSLST)
 
 
/* Build file of VEBA by province by day */
 
 
CALL PGM(BLDVEBA) PARM(' ')
 
 
/* send email that rebuild is complete */
 
 
CHGVAR VAR(&SMSG) VALUE('Statistics files rebuild +
 
is complete')
 
CHGVAR VAR(&LMSG) VALUE(&SMSG)
 
CALL PGM(OPMSGSEND) PARM(&SMSG &LMSG)
 
   
  +
Deletes reports that are generated but will never be printed; for example pick and putaway lists that we don't use because we use RF. Clears temporary work files. The programs that use these files delete records for the user. This program clears the files, which gets rid of these deleted records. This is called by EODREBLD.
==OUTQCLEAR==
 
   
  +
* [[OUTQCLEAR]]
/* Write list of spool files in out queues PRT01 and QPRINT to spool */
 
/* files, then copy those spool files to a data file. */
 
 
WRKOUTQ OUTQ(PRT01) OUTPUT(*PRINT)
 
CPYSPLF FILE(QPRTSPLQ) TOFILE(REPORT) SPLNBR(*LAST) +
 
TOMBR(OUTQ)
 
WRKOUTQ OUTQ(QPRINT) OUTPUT(*PRINT)
 
CPYSPLF FILE(QPRTSPLQ) TOFILE(REPORT) SPLNBR(*LAST) +
 
TOMBR(OUTQ) MBROPT(*ADD)
 
 
/* Run a query to build a file of all spool files that can be deleted. */
 
/* This query has a list of reports that are never printed. */
 
 
RUNQRY QRY(OUTQCLR) QRYFILE((*LIBL/REPORT))
 
 
/* Read through the created file, and delete those spool files in it. */
 
 
NEXT:
 
RCVF RCDFMT(OUTQDEL)
 
MONMSG MSGID(CPF0864) EXEC(GOTO CMDLBL(END))
 
CHGVAR VAR(&NUMBER) VALUE(&FILENUMB)
 
DLTSPLF FILE(&FILE) JOB(&JOBNUMB/&USER/&JOB) +
 
SPLNBR(&NUMBER)
 
GOTO CMDLBL(NEXT)
 
 
END:
 
 
/* Delete the two spool files that were created. */
 
 
DLTSPLF FILE(QPRTSPLQ) SPLNBR(*LAST)
 
DLTSPLF FILE(QPRTSPLQ) SPLNBR(*LAST)
 
   
  +
Runs a query against a file of all entries in out queues PRT01 and QPRINT, and builds a file of reports that can be deleted. Then reads that file, and deletes them. This is called by EODCLR.
==WSOVERNIT2==
 
   
  +
* [[WSOVERNIT1]]
/* Keep last 14 Web item master files so that the regular catalogue can */
 
  +
/* tell if there has been a price change to the customer within the last 2 */
 
  +
This is part of the process to rebuild files for Web Orders. On the Power 8, the shell commands sometimes come to a hard stop and need an operator response. That would stop the over night processing from completing. So EODREBLD submits this program, does something else that takes about 20 minutes, then runs the next part. If some of the shell commands are not run, the only effect on Web Orders is that some pictures or specifications may be missing. This is called by EODREBLD.
/* weeks, and display that price in blue. (It uses WSITEMX14 only) */
 
  +
 
  +
* [[WSOVERNIT2]]
DLTF FILE(WSITEMX14)
 
  +
RNMOBJ OBJ(WSITEMX13) OBJTYPE(*FILE) NEWOBJ(WSITEMX14)
 
  +
This rebuilds files used in Web Orders. They are built once here, so they don't have to be rebuilt every time a store makes a request. This is called by EODREBLD.
RNMOBJ OBJ(WSITEMX12) OBJTYPE(*FILE) NEWOBJ(WSITEMX13)
 
  +
RNMOBJ OBJ(WSITEMX11) OBJTYPE(*FILE) NEWOBJ(WSITEMX12)
 
  +
* [[EODEMAIL]]
RNMOBJ OBJ(WSITEMX10) OBJTYPE(*FILE) NEWOBJ(WSITEMX11)
 
  +
RNMOBJ OBJ(WSITEMX09) OBJTYPE(*FILE) NEWOBJ(WSITEMX10)
 
  +
This is called by the scheduler (job name EODEMAIL) every day at 8:00AM. It will email IT saying which tape volume was used for the backup, and archive the BRMS recovery reports to SuperServer.
RNMOBJ OBJ(WSITEMX08) OBJTYPE(*FILE) NEWOBJ(WSITEMX09)
 
  +
RNMOBJ OBJ(WSITEMX07) OBJTYPE(*FILE) NEWOBJ(WSITEMX08)
 
  +
=Summary=
RNMOBJ OBJ(WSITEMX06) OBJTYPE(*FILE) NEWOBJ(WSITEMX07)
 
  +
RNMOBJ OBJ(WSITEMX05) OBJTYPE(*FILE) NEWOBJ(WSITEMX06)
 
  +
Order of events:
RNMOBJ OBJ(WSITEMX04) OBJTYPE(*FILE) NEWOBJ(WSITEMX05)
 
  +
RNMOBJ OBJ(WSITEMX03) OBJTYPE(*FILE) NEWOBJ(WSITEMX04)
 
  +
'''Scheduled job name: ENDOFDAY, 1AM'''
RNMOBJ OBJ(WSITEMX02) OBJTYPE(*FILE) NEWOBJ(WSITEMX03)
 
  +
# CL: EODDAILY
RNMOBJ OBJ(WSITEMX01) OBJTYPE(*FILE) NEWOBJ(WSITEMX02)
 
  +
## CL: EODEND2
 
  +
## CL: EOD
CRTPF FILE(&DATALIB/WSITEMX01) OPTION(*NOSOURCE +
 
  +
### CL: EODBUTEMP
*NOLIST) SIZE(*NOMAX)
 
  +
### CL: EODUPD
CPYF FROMFILE(WSITEMP) TOFILE(WSITEMX01) +
 
  +
### CL: EODRPT
MBROPT(*REPLACE) CRTFILE(*NO) FMTOPT(*NOCHK)
 
  +
### SBMJOB: EODRBLD (queued until system up)
 
  +
/* Clear files. */
 
  +
'''Scheduled job name: EODSAVE, 3AM'''
 
  +
# CL: EODBU
CLRPFM FILE(WSITEMP)
 
  +
## CL: EODEND3
CLRPFM FILE(WSVENDP)
 
  +
## SBMJOB: STRBKUBRM (full system save)
CLRPFM FILE(WSALTIP)
 
  +
CLRPFM FILE(WSPROMP)
 
  +
'''System up: ~5AM'''
 
  +
# EODRBLD from earlier job runs
/* Clear spool files from output queues. */
 
  +
## SBMJOB: WSOVERNIT1
/* These are only used when first generated. */
 
  +
## CL: WSOVERNIT2
 
  +
## CL: EODCLR
CLROUTQ OUTQ(CATPRCTKTS)
 
  +
CLROUTQ OUTQ(CATSHFLBLS)
 
  +
[[Category: Overnight Processing]]
 
/* Overrides. ASW uses shared access paths; meaning that if a program */
 
/* reading a file sequentially calls a program that reads that same file, */
 
/* the first program will continue to read the file from the record the */
 
/* second program read. */
 
 
OVRDBF FILE(SRBPRG) SHARE(*NO)
 
 
/* Import item data. */
 
 
CALL PGM(WSIMPITM) PARM(&BLANKITEM &BLANKPROMO +
 
&BLANKBOOK)
 
 
/* Import promotions. */
 
 
CALL PGM(WSIMPPRO)
 
 
/* Import Vendors. */
 
 
CALL PGM(WSIMPVND)
 
 
/* Update minimum order values in site options files. */
 
 
CALL PGM(WSUPDMIN)
 
 
/* Rebuild top sellers file if this is the first day of the month. */
 
 
RTVJOBA DATE(&DATE)
 
IF COND(%SUBSTRING(&DATE 3 2) = '01') THEN(CALL +
 
PGM(WSIMPTOPC))
 
 
/* Rebuild top "buyers" file if this is the first day of the month. */
 
 
IF COND(%SUBSTRING(&DATE 3 2) = '01') THEN(CALL +
 
PGM(WSIMPBUY))
 
 
/* BUILD FILE OF ITEM GROUPS THAT ARE IN THE WEB TOP BUYERS OR TOP */
 
/* SELLERS FILES */
 
 
CLRPFM FILE(WSCTLDB)
 
CALL PGM(WSITEMGRP)
 
 
/* BUILD FILE OF ITEM CATEGORY 1 THAT ARE IN THE WEB ITEM FILE */
 
 
CLRPFM FILE(WSCTLP1)
 
CALL PGM(WSCAT1)
 
 
/* BUILD HIERARCHIAL GROUP/CLASS FILE */
 
 
RUNQRY QRY(CATEGORY1) QRYFILE((*LIBL/WSITEMP) +
 
(*LIBL/SROPRG))
 
RUNQRY QRY(CATEGORY2) QRYFILE((*LIBL/CAT1) +
 
(*LIBL/SROCTLDG) (*LIBL/SROCTLDB) +
 
(*LIBL/SROCTLP1))
 
 
/* BUILD NEW ITEMS FILE (FIRST RECEIPT WITHIN LAST MONTH) */
 
 
CLRPFM FILE(WSNEWITM)
 
CALL PGM(WSNEWITEMS)
 
 
/* Delete overrides */
 
 
DLTOVR FILE(SRBPRG)
 

Latest revision as of 16:16, 24 November 2016

The scheduler starts this job at 1:00AM; every morning except Sunday - when the End of Week is called. It calls EODDAILY, which will -

- End all programs that use ASW or extension files, and end subsystems so users cannot sign on.

- Do a 'temporary' backup of data libraries only. This uses tape '999999', which has a retention period of one day so that it can be over written every night. It can be used if something happens during the overnight processing, to quickly restore a file the next day if needed (without having to call the tape from off site storage), and to rebuild the test environment.

- Run updates, reports, and housekeeping (clear work files and out queues, and delete unnecessary spool files).

The following sections only show the main functions in the programs; not any error checking. Whenever there can be an error that shouldn't affect processing, the programs have the MONMSG (monitor message) command to ignore it. When a file that is to be rebuilt can't be cleared (because it is in use by another job), the program will automatically skip the rebuild.

This is called by the scheduler (job name ENDOFDAY) every day except Sunday, at 1:00AM. It puts the computer into an application restricted state. If it fails, it will be cancelled by the backup; which starts at 3:00AM.

This will end all processes that can use either ASW or extension files. This does not end Domino, so that I.T. staff will receive the emails being sent. This is called by EODDAILY and EODWEEKLY.

This does the overnight processing. It is called by EODDAILY and EODWEEKLY.

This does a 'temporary' backup of the production data libraries, on tape '999999' which is reused every day. It can be used to restore files if something goes terribly wrong in the overnight processing, reload a file if something happens to it the next day (we have had users accidentally do mass deletes), or to rebuild the test environment (PL).

We used to do the regular backup at this point instead of after all the overnight processing. Then we discovered (during a year end audit) that transactions for the day had not updated G/L, A/R. etc on the tape.

This is called by EOD.

This does the updating that requires all users to be off the system. It is called by EOD.

This generates reports. It is called by EOD.

This rebuilds/updates master and statistic files used by Web Orders and InfoNet. These are built as part of the overnight processing instead of when a user requests the information. This also clears work files and spool files. It is submitted to QBATCH by EOD, to run after the restricted state has ended; about 5:00AM.

Deletes reports that are generated but will never be printed; for example pick and putaway lists that we don't use because we use RF. Clears temporary work files. The programs that use these files delete records for the user. This program clears the files, which gets rid of these deleted records. This is called by EODREBLD.

Runs a query against a file of all entries in out queues PRT01 and QPRINT, and builds a file of reports that can be deleted. Then reads that file, and deletes them. This is called by EODCLR.

This is part of the process to rebuild files for Web Orders. On the Power 8, the shell commands sometimes come to a hard stop and need an operator response. That would stop the over night processing from completing. So EODREBLD submits this program, does something else that takes about 20 minutes, then runs the next part. If some of the shell commands are not run, the only effect on Web Orders is that some pictures or specifications may be missing. This is called by EODREBLD.

This rebuilds files used in Web Orders. They are built once here, so they don't have to be rebuilt every time a store makes a request. This is called by EODREBLD.

This is called by the scheduler (job name EODEMAIL) every day at 8:00AM. It will email IT saying which tape volume was used for the backup, and archive the BRMS recovery reports to SuperServer.

Summary

Order of events:

Scheduled job name: ENDOFDAY, 1AM

  1. CL: EODDAILY
    1. CL: EODEND2
    2. CL: EOD
      1. CL: EODBUTEMP
      2. CL: EODUPD
      3. CL: EODRPT
      4. SBMJOB: EODRBLD (queued until system up)

Scheduled job name: EODSAVE, 3AM

  1. CL: EODBU
    1. CL: EODEND3
    2. SBMJOB: STRBKUBRM (full system save)

System up: ~5AM

  1. EODRBLD from earlier job runs
    1. SBMJOB: WSOVERNIT1
    2. CL: WSOVERNIT2
    3. CL: EODCLR