PERMA
DISASTER RECOVER PLAN - FIRST FOUR WEEKS
EXECUTIVE MANAGEMENT
Executive Management will notify department heads by phone to initiate the disaster recovery plan and begin the following activities:
1.Meet with department heads
2.Begin negotiations with British American for temporary space as outlined in “Space and Equipment Needs” below
3.Authorize the rental/lease of office furniture/work stations
HUMAN RESOURCES
Human Resources information is maintained mostly on paper files with some data on the server. Payroll is administered off-site by ADP.
Critical Activities:Initiate contact with employees through phone tree.
Ensure payroll continuation
Reconstruct employee files
Action / Staff/Space / Equipment / TimeframeActivate phone tree / 1/Home / Phone / Immediate
Notify ADP office that backup payroll plan is in effect / 1 / Phone / Immediate
Reconstruct employee files as necessary / Full / Full / 30 days
The Plan
The Human Resources staff and department head will be able to work from home to accomplish the immediate tasks of the first week of operation.
During the second week, a workstation, phones and other necessary equipment will be added as appropriate. At the end of four weeks, the Human Resources department will be in full operation.
CLAIMS
The majority of claims data is maintained on the server. However, there are paper files on each claim that include some medical reports, investigative reports, and some legal reports. All of this information is recoverable. The most difficult recovery will be investigative reports because of the somewhat unpredictable nature of that service.
Action / Staff/Space / Equipment / TimeframeContact Workers’ Compensation Board, attorneys, investigators and vendors to inform them of the situation and take the necessary steps to continue active cases and avoid penalties. / Manager; supervisors; four staff, workstations / phones, high speed connection / 24-48 hours
Notify interim claimsprocessingteam (four, plusone clerical). / Six claims, clerical, PA workstations / Computers, phones, high speed connection fax, copier / 5-10 days
Manual claims payments / Manager; supervisors / Work area; check stock / 5 days
Establish automatedpayments; begin phase-in offull operations. / 1 claims team/4
2 claims teams/8
3 claims teams/12
4 claims teams/16
All teams in place / Work area; check stock / 2-7 days
7-14 days
14-21 days
21-28 days
30 days
The Plan
The manager, assistant managers, and supervisors will establish communications with outside vendors and state agencies as necessaryduring the first 24 hours of operation. A full claims team will then be in place in 2 to 7 days, or sooner as equipment allows.
The post office will be notified by the manager to divert mail to the temporary location, and a receptionist will be at the temporary location within 24 hours to sort and distribute mail and coordinate phone service.
Claims payments may have to be made manually on a temporary, short-term basis until necessary computer systems are available.
Those departments not established at the temporary location may be required to pickup mail periodically.
INFORMATION TECHNOLOGY
The Information Technology department is the key to a successful recovery. All departments are dependent on the software and hardware as well as the files and data that are on the servers. Presently, all data, software and files are backed up daily and maintained offsite. This practice should allow for a reasonable recovery in the longterm as well as access to essential files and data in the short term. In order to continue operations in the timeframes outlined in this report, certain critical assumptions must be made as outlined below.
I. Critical Assumptions
- Space to accommodate 21 staff, 21 PCs, 5 servers, and 2 printers will be procured by another department and will be available within 24 hours. Ideally, the space will be pre-wired for 100mbit Ethernet, will provide high-speed Internet access, and will accommodate two phone lines for modems outside of the phone system. Within two weeks, there will be space to accommodate an additional 8 staff; within one month, there will be space to accommodate the full staff.
- All departments will maintain off-site records of information they will need immediately, such as: key contact names, phone numbers, and e-mail addresses (it is recommended that critical GroupWise address books be exported regularly and taken off-site); claims awards information and anything else in Claims or Finance that may require immediate manual checks to be issued; inventories of equipment, furniture, etc. that will require immediate replacement or immediate reporting to our insurance carriers (IT will take care of computer hardware and software inventories).
According to this plan, electronic data files (Word docs., Excel files, etc.) and e-mail address books will not be able to be restored for at least two days, so anything needed sooner should be maintained off-site by each department.
- Funds will be made available to the IT Department immediately and as needed thereafter. If we are able to use our normal vendors, they will extend us credit. However, we may need to use new vendors who will want checks or credit cards for purchases. We estimate needing $75,000 on day one, an additional $30,000 within the first two weeks, and an additional $140,000 within the first month. No additional budgeting is being done to accommodate disaster recovery, under the assumption that additional costs will be covered by our insurance.
- IT staff will have available from offsite storage: backup tapes from the two prior workdays; backup CDs for all current operating systems, server-based software, and software applications; policies and procedures documentation; hardware and software inventories; vendor contact information; a backup, preconfigured RS/6000 with monitor; laser check stock for Claims and Finance.
II. Organizational IT Needs: IT’s priorities will be to restore the functions listed below, for the staff listed, in the timeframes indicated.
Function / Department / # Staff / Timeframee-mail/web access / Claims /6 / 24-48 hours
Mem. Services /1
Communications /1
IT /4
Exec. Mgt. /2
Mem. Services /4 / 14 days
Word and Excel / Claims / 6 / 24-48 hours
Mem. Services /1
Communications /1
IT /4
Exec. Mgt. /2
Mem. Services /4 / 14 days
Claims system, check printing, and forms processing / Claims /4 (1 team) / 3-7 days
Claims /8 (2 teams) / 7-14 days
Claims /12 (3 teams) / 14-21 days
Claims /16 (4 teams) / 21-28 days
Claims /all / 30 days
Accounting system and check printing / Finance /2 / 5 days
High-speed Internet access (bank access) / Finance /2 / 5 days
Payroll processing / HR /1 / 5 days
Certificate of Insurance issuance / Loss Control /1 / 7-14 days
Policy issuance / Underwriting/3 / 20-90 days
Data Warehouse / all DW users / 30 days
Full operation / All / 30 days
The Plan
III. Recovery Actions for Week 1
Action / Staff/Space / Equipment. / TimeframeContact Nick Gorgievski to immediately obtain needed funds. / BD / Phone / Immediately.
Stay in touch with management and Karen Leffler regarding space procurement and wiring configuration available. / BD / Phone / Starts immediately.
Purchase new servers with compatible tape drives and UPS’ to replace Blue, Purple, Red, Silver, and Black. Obtain overnight shipping. Depending on temporary space configuration, purchase network switches, patch cables, and Internet routers as necessary. Start with CDW-G, then Dell. / WL desk space (can be home if necessary). / Phone / Starts immediately; servers needed in 24 hours.
Purchase 21 new PCsand monitors for users who need to be up and running within 1st week, 2 printers (at least one with MICR capabilities and flash RAM and MICR DIMMsrequired for check printing), and two modems. The goal is topurchase permanent replacement equipment. include combo CD/DVD burners on 2, and CD/DVD readers on the rest, for quicker ghosting. First determine if they can be purchased locally. Try CompUSA, ATEC Group, P&J Computer. If not available locally, go for overnight shipping from CDW-G or Dell. / CC/desk space (can be home if necessary). If no delivery available, rental van and help from other departments. / Phone / Starts immediately, initial PCs needed in 24 hours.
Procure services of two high-level network recovery and installation support staff; try Sage computer, P&J Computer, RHI, CGI. procure services of five PERMA staff from other departments to assist with PC deployment. / BD/desk space (can be home if necessary). / Phone / Immediately
Contact support vendors ofcritical systems and procure their assistance: Tropics, Hudson River, WSG, ADP. / BD/desk space (can be home if necessary). / Phone / Immediately
Monitor status of recovery actions, inform management of progress, inform departments when resources are available to them, procure additional resources if necessary. / BD / Phone / Starts immediately.
Procure RS/6000, backup tapes, and CDs from off-site space and deliver to temporary work space. / WL, BD / temporary office space. / As soon as space is available.
Determine if existing ghost image can be used. If not, load one PC w/Netware client, Word, Excel, IE, Symantec VirusScan, Tropics, PowerTrak, GroupWise client, printer driver(s), Ship Request, TIFF reader, LegalEase and PerpetuCalc (if LegalEase has to be installed from server, install on each PC after step 14), and create ghost image on DVD. / CC / temporary office space. / Starts as soon as PCs are procured. New PC buildup would take 4 hours; creation of ghost image to DVD would take 2.5 hours.
Setup and ghost remaining PCs. / CC, LR, 5 other PERMA staff / temporary office space. / Starts as soon as PCS are procured.
Install client-based networktools on one ITPC. / WL, contracted help / One PC / Starts as soon as PC is configured.
Configure networkinfrastructure (switches,cabling, internet router). ContactTime Warner to establish Internetservice. Contact WSG to provideaccess to perma.org e-mail. / WL, contracted help / Starts as soon as equipment is procured.
If WSG cannot provide access to e-mail, procure interim web-based e-mail accounts (yahoo, hotmail,etc.), if necessary (assessremaining time for GroupWiserecovery). / CC / One PC, Internet access / As soon as a PC is configured and has Internet access.
If WSG cannot provide access to e-mail, contact WSG with interim e-mail account for re-routing allweb submissions. Download anysubmissions that were sent toperma.org in interim, delivery toclaims. / BD / Phone / As soon as temporary e-mail accounts and internet access obtained.
Configure servers and restoreoperating systems, applications,and files. Priority: 1) black (domain controller), 2) purple(GroupWise), 3)blue and red (Tropics and Dynamics),4) silver(Tropics ISO), 5) claimssrv (Data Warehouse). / WL, contracted help / Starts as soon as servers are procured.
Install initial printers. / WL, contracted help / Starts after domain controller is restored.
Setup one MICR printer and test claims check printing. / BD, Tropics / After Tropics is up.
Install Dynamics client on two Finance PCs. / CC, Hudson River / Two configured PCs / Starts after initial PC setup completed, and software restored to red server.
Install ADP client on one PC, configure modem. / BD / One configured PC / Starts after initial PC setup completed, and software restored to red server.
IV. Recovery actions for week 2
Action / Staff/Space / Equipment / TimeframeProcure another 12 PCs (8 for users, 1 for ghost master, 2 for PC Anywhere hosts, 1 for Guinevere) and one more printer (additional printers depending on office space configuration). / CC / Phone / **This is the minimum order; depending on space available, it may make sense to order all remaining PCs at this time. Supplier can also probably stagger shipments.
Configure a master PC to use for ghost imaging (either new buildup or add to prior ghost master if available), including previously installed software plus Business Objects client, Access, PowerPoint, and Acrobat Reader. / CC, LR / One PC
Ghost and deploy 8 more PCs. / CC, LR
Install one more printer. / WL
Setup member database access onLoss Control PC. / CC
Setup Tropics-Dynamics Interface on Finance PCs. / BD
Install PC Anywhere hosts (IP-based). / WL / One PC
Install programming tools on one IT PC. / LR
V. Recovery actions for week 3
Action / Staff/Space / Equipment. / TimeframeProcure and deploy 11 more PCs, and additional printers depending on office space configuration.** / CC, LR, BD, WL
Install ModMaster on Underwriting PCs. / CC
Procure routers and restore VPN. / WL
Install new printers. / WL
Install WinFax on Loss Control PC, configure modem. / CC
**This is the minimum number needed for this week if not already ordered.
VI. Recovery actions for week 4 and beyond
Action / Staff/Space / Equipment / TimeframeProcure and deploy remaining users PCs and printers, including a high-speed printer and a color printer. / CC, LR, BD, WL
Install Acrobat Distiller on user PCs. / CC
Specify wiring needs for permanent office space, test wiring in advance of move. / WL
Setup network and computer equipment in permanent office space. / WL, CC, BD, LR, contracted help if necessary (depending on timeframe)
Procure and setup scanner. / CC
Update virus software to theserver version on those PCs that were setup early with standaloneversions. / CC
UNDERWRITING
The Underwriting department’s critical issues primarily revolve around member underwriting files and executing policy renewals and new policies. Much of the data relative to these two issues is contained in paper files. Plans are in the works to convert to electronic files with a target date of March of 2004. Most critical data is backed up electronically. The most critical activity is policy issuance.
Action / Staff/Space / Equipment / TimeframePolicy issuance(new and renewals) / Three staff, work area / One PC, access to server / Depends on timing: 1 to 3 months
Audit (contract service) / Manager / One PC, access to server / 3 months
Contact insurance carriers / Manager / Phone / Immediate
The Plan
Critical paper files will be stored in fire-resistive cabinets to be purchased in FY-2006 and shared with other departments as necessary.
The department head will work from home during the first week to accomplish immediate tasks. During the first week, paper files will be recovered and delivered to the temporary space. As necessary, underwriting staff will begin operations as space and equipment become available at the new location. The target for full operation at the temporary facility will be one month.
FINANCE
All the finance data and information needed to operate is on the server.
Action / Staff/Space / Equipment / TimeframePay administrative and operating expenses / One staff, Manager / One PC, phone, fax, highspeed access, two workstations, check stock, printer / 5 days
Establish basic office Services-phones, fax, copiers / Manager / Phone / 24 hours
The Plan
The department head will work from home to continue critical financial operations, including banking and the administration of operating expenses. The department head and staff will coordinate with Membership Services to ensure the establishment of basic phone service and fax/copy services at the temporary space. Fax and copy machines are readily available locally.
COMMUNICATIONS
The role of Communications will be to contact members as necessary and as directed by management about the status of the situation. All of the information needed to perform this activity is available on the server.
Action / Staff/Space / Equipment / TimeframeContact members / One staff,workstation / PC, phone, fax, copier / 24-48 hours
The Plan
The Communications person will work from home and coordinate with Membership Services to establish member communications concerning PERMA’s ongoing operations. Establishment at the new location will be as space and equipment become available.
LOSS CONTROL
The Loss Control Department operates primarily from remote locations. Service interruption to members will be minimal. The only critical service to members is providing certificates of insurance in a timely manner. All member information and service data is on the server in electronic files. Videos can be reordered from vendors and be available within two weeks for distribution.
Action / Staff/Space / Equipment / TimeframeIssue COI / One staff,workstation / PC, fax,phone / 1-2 weeks
Manage service / Manager; work from homecopier / Laptop, fax / Immediate
The Plan
The administrative assistant will report to the new location as space and equipment become available. The issuance of certificates of insurance will be delayed for up to two weeks. Membership Services, Communications and the Loss Control Consultants will communicate this to members. The administrative assistant and manager will begin ordering new videos. Full department services, including the video library, should be available to members within one month.
Regular loss control consulting service should not be significantly interrupted.
MEMBERSHIP SERVICES/MARKETING
Membership Services will be contacting members and answering questions. Their major role will be maintaining service continuity and customer confidence in PERMA.
Action / Staff/Space / Equipment / TimeframeMember contact / One staff and one workstation / Phone, fax, copier high speed connection / 48 hours
Member contact; resume full service / Full staff and workstations (3) / Same as above / 30 days
The Plan
Initially, the Membership Services/Marketing staff will be able to work from their homes to begin contacting the membership by telephone. Within 48 hours, the department manager will begin operations at the temporary location and, within two weeks, the operation should be fully operational at the new location. The Marketing staff will work from home during the first week to accomplish immediate tasks and continue marketing operations. Since the account executive works primarily outside the office, no immediate action would be necessary.
SPACE AND EQUIPMENT NEEDS
Our space needs during the first 24 hours will be approximately 3200 square feet to accommodate about 21 staff. The space needs to be appropriately equipped to accommodate personal computers, high speed cable and phones. British American has indicated that in the short term they could provide the necessary, properly equipped space either in this park or one of their other locations at any time.
We have a well established relationship with Standard Commercial Interiors and they would be able to quickly supply us with our furniture. However, for our long-term furniture needs, we should consider ordering our full replacement furniture immediately since it could take four months or longer to receive delivery.
We will immediately need to search for more space to accommodate our full operating staff. British American indicated that, given their present state of constant construction of new office space, we could occupy 18,000 square feet (our present occupancy) of space within 8-12 weeks. If we plan on rebuilding, we would have to plan on occupying the space for at least a year to allow time for rebuilding.
1
T:\AGRIP\ResourceCenter\DisasterPlanningand 9-11-01WTC\ResponsesToCSDSIPonITPlans\0608PERMA.doc