For njosh

aam20120p
the-practice-of-system-and-network-thomas-a-limoncelliwww.ebook-dl.com_.pdf

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

• • • • • •

• • • • • • • • •

• • • • • •

ptg18221866

ptg18221866

ptg18221866

. . .

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

. . .

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

BACKLOG ACTIVE COMPLETED

Use

Kanban

Try

Kanban

tool

Get some s!cky notes!

Get a white- board

Learn about

Kanban

ptg18221866

Linux Team

BACKLOG ACTIVE VERIFYING COMPLETED

Windows Team

Network Team

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

+

Database Web server(a)

Stateful

Database Web

server (b)

Stateful Stateless

SAN Web

server Database

service (c)

Stateful Stateless

ptg18221866

SAN Database

service

Stateful Stateless

Read-Only DB Cache Read-Only DB Cache Read-Only DB Cache Read-only DB cache

Read-Only DB Cache Read-Only DB Cache Read-Only DB Cache

Web

server

HTTP

requests

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

⇒ ⇒ ⇒

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

Develop

Configuration

Code

Data

Tests

Automation modules

Resource model

Monitor / Metrics

Builder Packager Packages Installer Automation

framework

Infrastructure

manager

Modular

automation

Operations

console Package

repository

Source

repository

Environment

Server specification

Monitor / Metrics

Automation modules

Acceptance tests

Builder Packager Installer Automation

framework

Deploy

Service delivery platform design pattern

Build

In fr

a st

ru ct

u re

A p

p li

ca ti

o n

Packages

Images

Build

console

Commit Build Package Register Promote Install Configure

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

No

Yes

No Error!

Done

Yes

Done

Is it

correct?

Is it

correct?Fix it.

ptg18221866

ptg18221866

ptg18221866

Generic Defini!on Beta Produc!on

H"p[]

blog::web

H"p[]

blog::app

Sql[]

blog::db

H"p[blog-beta]

Blog::Web[beta]

beta1.example.com

beta2.example.com

H"p[blog-beta]

Blog::App[beta]

Sql[blog-beta]

Blog::Db[beta]

H"p[blog-prod]

Blog::Web[prod]

prod1.example.com

prod3.example.com

H"p[blog-prod]

Blog::App[prod]

Sql[blog-prod]

Blog::Db[prod]

prod2.example.com

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866 Build

Re!re

Ini!alize

Debug

Entropy

Update

Rebuild New

In Clean

Off

UnknownConfigured

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

VM1 VM2

VM3 VM4

VM5 VM7

VM6V M

S e

rv e

r A

V M

S e

rv e

r B

Network SAN

VM1 VM2 VM3

VM4 VM5 VM6

VM7 VM8 VM9

VM10 VM11

VM8

VM9

V M

S e

rv e

r C

VM11

VM10

ptg18221866

VM1 VM2

VM3 VM4

VM5 VM7

VM7

VM7

VM6V M

S e

rv e

r A

V M

S e

rv e

r B

Network SAN

VM1 VM2 VM3

VM4 VM5 VM6

VM7 VM8 VM9

VM10 VM11

VM8

VM9

VM7

V M

S e

rv e

r C

VM11

VM10

ptg18221866+ +

ptg18221866

VM

VM

VM

VM

A

VM

VM

B

VMVM

VM

C

VM

VM

VM

VM

VM

VM

VM

VM

D E

(a)

VM

VM

VM

VM

A

VM

VM

VM

B

VM

VM

VM

C

VM

VM

VM

D

VM

VM

VM

E

(b)

VM

VM

VM

A

VM

VM

VM

B

VM

VM

VM

C

VM

VM

VM

D

VM

VM

VM

E

(c)

VM

VM

VM

A

VM

VM

B

VM

VM

VM

C

VM

VM

VM

D

VM

VM

VM

VM

E

(d)

+ +

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

+

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866 +++1

+++2

+

+

+ +

+

+ +

ptg18221866

ptg18221866

ptg18221866

◦ ◦

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

+

+

+

+

ptg18221866

+

+

+

+

ptg18221866

ptg18221866

ptg18221866

×

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

+

+

+

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

Cookie

Storage

Load

balancer

Replica Replica Replica

Internet

ptg18221866

+ + + +

+

+

+ +

+ +

+

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

= ( + + ) + ( + + ) + · · ·+ ( + + )

+

= + + · · ·+

ptg18221866

ptg18221866

+

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

+

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

( − )×

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

Server pod

Fabric switches

TOR switches

F1 F2 Fn

T1 T2 T3 Tm

ptg18221866

ptg18221866

ptg18221866

Field

office

Field

office

Field

office

Field

office

Field

office

Main

office

ptg18221866

ptg18221866 Secondary European

DC

Main European

DC

Secondary U.S. DC

Main U.S. DC

Secondary Asian

DC

Main Asian

DC

French office

Texas office

Florida office

Singapore office

U.K. office

New Jersey office

Colorado office

Japan office

Office

Office

Office

Office

Office

Office

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

. ×

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866

ptg18221866

START ENDThe Gree!ng

Verifica!onPlanning and Execu!on

Problem Iden!fi- ca!on

Th

A Proble

B

ni

C D

ptg18221866

The Gree!ng Th 1

ptg18221866

Problem Classifica!on

From later phases

2

Problem Statement

3

Problem Verifica!on

4

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

Solu!on Proposals

From later phase

To earlier phases

5

Solu!on Selec!on

6

Execu!on

7

ptg18221866

ptg18221866

ptg18221866

Cra! Verifica"on

To earlier phases

8

User Verifica"on/

Closing

9

END

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

. . . . . .

. . . . . . .

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

Subject: FYI - QUIET TIME IS COMING 09/25 - 10/06

Team

Just a reminder for you all that QUIET TIME will be here in three weeks.

It is scheduled to begin on 9/25 and go to 10/06.

Change control 96739 is below:

CHANGE SUMMARY DISPLAY CHANGE: 00096739

Assignee Class/Queue... GNSC Change Status/Type OR/INF

Assignee Name......... ___________________ IPL/Service Disrpt N/N

Requester Name........ FRED/ADDAMS Risk/Chg Reason... 1/QT

Enterer’s Name........ FRED/ADDAMS Proc Ctr/Cntl Ctr. NET/GNS

Enterer’s Phone....... (555)555-8765 Problem Fixed..... _______

Enterer’s Class/Queue.. GNSC Business Unit..... ALL

Plan Start Date/Time... 09/25/2000 00:01 Code..... GLOBAL

Plan End Date/Time..... 10/06/2000 24:00 COI............... ALL

Date/Time Entered...... 04/10/2000 14:26 Approval Status... PENDING

Date/Time Last Altered 06/22/2000 16:02 User Last Altered. NCC0FHA

Date Closed........... __________ Associated Doc.... N/A

System................ __________________________

Component/Application.. FISCAL-PROCESS&NTWK-QUIET-TIME

Description........... 4Q00/1Q01 FISCAL EXTENDED AVAILABILITY

System edited......... _________________________

Location

Loc added.... ____________

Fiscal processing, email, and network quiet time to support

quarterly book close/open activities.

Changes that may impact access to or data movement

between server/mainframe applications or email should be

rescheduled. Only emergency changes to prevent or

fix outages will be reviewed for possible implementation.

All changes will require a change exception form be

submitted to the CMRB.

See URL for Quiet Time Guidelines and contact information:

http://wwwin.foo.com/gnsc/quiet-time.html

Customer Impact: None

Test plan: None

Contact and Phone/Pager Numbers:

JOHN SMITH..........(555)555-1234

JANE JONES..........(555)555-4321

ALICE WALTER........(555)555-7890 800-555-5555 pin 123456

Backout Plan: None

*** BOTTOM OF DATA ***

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

To: all-users

Subject: SERVER REBOOT: 6 PM TODAY

From: System Administration Group <help@example.com>

Reply-To: tom@example.com

Date: Thu, 16 Jun 2001 10:32:13 -0500

WHO IS AFFECTED:

All hosts on DEVELOPER-NET, TOWNVILLE-NET, and BROCCOLI-NET.

WHAT WILL HAPPEN:

All servers will be rebooted.

WHEN?

Today between 6-8 PM (should take 1 hour)

WHY?

We are in the process of rolling out new kernel tuning

parameters to all servers. This requires a reboot. The

risk is minimal. For more information please visit:

http://portal.example.com/sa/news0005

I OBJECT!

Send mail to "help" and we will try to reschedule. Please

name the server you want us to keep up today.

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

• • • • • • • • • • • •

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

+

+

ptg18221866

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

. . .

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

APAC

EMEA

AMER

DNS client

Resolver: 1.1.1.1

DNS server (5.6.7.8) Anycast: 1.1.1.1

DNS client

Resolver: 1.1.1.1

DNS server (3.4.5.6) Anycast: 1.1.1.1

DNS client

Resolver: 1.1.1.1

DNS server (4.5.6.7) Anycast: 1.1.1.1

ptg18221866

ptg18221866

. ×

ptg18221866

ptg18221866 Ac!veDirectory

LDAP

Authoriza!on database

AAAApplica!on AAA

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

. . .

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

1+ 0

+

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

. . . . . . . . . . . . . . . . . .

ptg18221866

180

160

140

120

100

80

60

40

20

0

Daily

7-Day

14-Day

21-Day

28-Day

35-Day

0 5 10 15 20 25 30 35 40 45

X X X X X X

X X

X

X X X X X

X X X X X X

X X X X X X

X X X X X X

XX

X

X

X X

X XXX

XXXXXXXX X

X X

X XXXXXXXXX

ptg18221866

. . . . . . . . . . . . . . . . . .

ptg18221866

50

45

40

35

30

25

20

15

10

5

0

7-Day

14-Day

21-Day

28-Day

35-Day

0 5 10 15 20 25 30 35 40 45

X

X

X X X X

X X X X X X X X X

X X X X

X X X

X X X X X X X

X

X X X X

X X X X

X X X X X X X X X X X X X

ptg18221866

ptg18221866

ptg18221866

ptg18221866

+

ptg18221866

× ×

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

→ → → →

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

→ → → →

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

Database-

driven

dynamic

content

Dynamic

content

Static

content

Web server

Internet

ptg18221866

Data

server

Load

balancer

Web

server

Web

server

Web

server

Internet

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866

ptg18221866

The System Administrators’ Code of Ethics

We as professional System Administrators do hereby commit ourselves to the highest standards of ethical and professional conduct, and agree to be guided by this code of ethics, and encourage every System Administrator to do the same.

Professionalism I will maintain professional conduct in the workplace and will not allow personal feelings or beliefs to cause me to treat people unfairly or unprofessionally.

Personal Integrity I will be honest in my professional dealings and forthcoming about my competence and the impact of my mistakes. I will seek assistance from others when required.

I will avoid conflicts of interest and biases whenever possible. When my advice is sought, if I have a conflict of interest or bias, I will declare it if appropriate, and recuse myself if necessary.

Privacy I will access private information on computer systems only when it is necessary in the course of my technical duties. I will maintain and protect the confidentiality of any information to which I may have access, regardless of the method by which I came into knowledge of it.

Laws and Policies I will educate myself and others on relevant laws, regulations, and policies regarding the performance of my duties.

Communication I will communicate with management, users, and colleagues about computer matters of mutual interest. I will strive to listen to and understand the needs of all parties.

System Integrity I will strive to ensure the necessary integrity, reliability, and availability of the systems for which I am responsible.

I will design and maintain each system in a manner to support the purpose of the system to the organization.

Education I will continue to update and enhance my technical knowledge and other work-related skills. I will share my knowledge and experience with others.

Responsibility to Computing Community I will cooperate with the larger computing community to maintain the integrity of network and computing resources.

Social Responsibility As an informed professional, I will encourage the writing and adoption of relevant policies and laws consistent with these ethical principles.

Ethical Responsibility I will strive to build and maintain a safe, healthy, and productive workplace.

I will do my best to make decisions consistent with the safety, privacy, and well-being of my community and the public, and to disclose promptly factors that might pose unexamined risks or dangers.

I will accept and offer honest criticism of technical work as appropriate and will credit properly the contributions of others.

I will lead by example, maintaining a high ethical standard and degree of professionalism in the performance of all my duties. I will support colleagues and co-workers in following this code of ethics.

Copyright © 2014 The USENIX Association. USENIX grants permission to reproduce this Code in any format, provided that the wording is not changed in any way, that signatories USENIX, LISA, and LOPSA are included, and that no other signatory or logo is added without explicit permission from the copyright holder(s).

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

. . . . . . . . .

. . .

++

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866

ptg18221866

ptg18221866

. . . .

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

×

++

ptg18221866 ++

++

++

++

++

++

++

++

++

ptg18221866

++

++

ptg18221866

. . . .

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

+ +

ptg18221866

ptg18221866

ptg18221866

1

1

1

1 1

1 1 1

1

12/2014 1/2015 2/2015 3/2015 4/2015

Regular Response

Service A

Emergency Response

Monitoring and Metrics

Capacity Planning

Life-Cycle Management

New Service Introduction and Removal

Service Deployment and Decommissioning

Resource Efficiency

1 1 2 2

2

2

2

222

2 2

2 2

2

22 2

2

3 3

3

3

3

3

3 4 4 4

4

3

1 2 2

2 22

3

3 3

4 4 4 5

1

2014Q1Team 1

Service A

Service B

Service C

2015Q1 2015Q2 2015Q3 2015Q4

1

ptg18221866

ptg18221866

ptg18221866

1 1 1

2 32

3

1 2

1 1 2 2 2

2 3 3 3 4

4 3 4 5

1

2014Q1

Team 1

Team 2

Team 3

Team 4

Team 5

2015Q1 2015Q2 2015Q3 2015Q4

3

+

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866. . .

ptg18221866

. . .

ptg18221866

ptg18221866

. . .

ptg18221866

ptg18221866

. . .

ptg18221866

ptg18221866

. . .

ptg18221866

ptg18221866

. . .

ptg18221866

ptg18221866

. . .

ptg18221866

ptg18221866

. . .

. . .

ptg18221866

ptg18221866

. . .

ptg18221866

ptg18221866

. . .

ptg18221866

ptg18221866

. . .

ptg18221866

ptg18221866

. . .

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

+

+

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866

ptg18221866 This page intentionally left blank

ptg18221866

To see our complete list of upcoming conferences, go to www.usenix.org/conferences

SREcon is a gathering of engineers who care deeply about site reliability, systems engineering, and working with complex distributed systems at scale. The conference has a culture of critical thought, deep technical insights, continuous improvement, and innovation.

For more than 30 years, LISA has been the premier conference for IT operations, where systems engineers, operations professionals, and academic researchers share real-world knowledge about designing, building, and maintaining the critical systems of our interconnected world.

HAVE WE GOT A CONFERENCE FOR YOU!

ptg18221866

PEARSONALWAYS LEARNING

For more information and sample content visit informit.com/tposa. eBook and print formats available.

The Practice of System Administration, Volume 2—Cloud System Administration

informit.com/tposa

The Practice of Cloud System Administration focuses on “distributed” or “cloud” computing

and brings a DevOps/SRE sensibility to the

practice of system administration. Unsatisfied

with books that cover either design or operations

in isolation, the authors created this authoritative

reference centered on a comprehensive approach.

The Practice of Cloud System Administration brings together knowledge and best practices

for administering systems in the age of cloud

computing, and for architecting, scaling, and

operating services that perform reliably and well.

Case studies and examples from Google, Etsy, Twitter, Facebook, Netflix, Amazon, and

other industry giants are explained in practical ways that are useful to all enterprises.

ptg18221866

Addison-Wesley • Cisco Press • IBM Press • Microsoft Press • Pearson IT Certif ication • Prentice Hall • Que • Sams • VMware Press

REGISTER YOUR PRODUCT at informit.com/register

Access Additional Benefits and SAVE 35% on Your Next Purchase

• Download available product updates.

• Access bonus material when applicable.

• Receive exclusive offers on new editions and related products.

(Just check the box to hear from us when setting up your account.)

• Get a coupon for 35% for your next purchase, valid for 30 days. Your code will

be available in your InformIT cart. (You will also find it in the Manage Codes

section of your account page.)

Registration benefits vary by product. Benefits will be listed on your account page

under Registered Products.

InformIT.com–The Trusted Technology Learning Source InformIT is the online home of information technology brands at Pearson, the world’s foremost

education company. At InformIT.com you can

• Shop our books, eBooks, software, and video training.

• Take advantage of our special offers and promotions (informit.com/promotions).

• Sign up for special offers and content newsletters (informit.com/newsletters).

• Read free articles and blogs by information technology experts.

• Access thousands of free chapters and video lessons.

Connect with InformIT–Visit informit.com/community Learn about InformIT community events and programs.

  • Cover
  • Title Page
  • Copyright Page
  • Contents
  • Preface
  • Acknowledgments
  • About the Authors
  • Part I: Game-Changing Strategies
    • 1 Climbing Out of the Hole
      • 1.1 Organizing WIP
        • 1.1.1 Ticket Systems
        • 1.1.2 Kanban
        • 1.1.3 Tickets and Kanban
      • 1.2 Eliminating Time Sinkholes
        • 1.2.1 OS Installation and Configuration
        • 1.2.2 Software Deployment
      • 1.3 DevOps
      • 1.4 DevOps Without Devs
      • 1.5 Bottlenecks
      • 1.6 Getting Started
      • 1.7 Summary
      • Exercises
    • 2 The Small Batches Principle
      • 2.1 The Carpenter Analogy
      • 2.2 Fixing Hell Month
      • 2.3 Improving Emergency Failovers
      • 2.4 Launching Early and Often
      • 2.5 Summary
      • Exercises
    • 3 Pets and Cattle
      • 3.1 The Pets and Cattle Analogy
      • 3.2 Scaling
      • 3.3 Desktops as Cattle
      • 3.4 Server Hardware as Cattle
      • 3.5 Pets Store State
      • 3.6 Isolating State
      • 3.7 Generic Processes
      • 3.8 Moving Variations to the End
      • 3.9 Automation
      • 3.10 Summary
      • Exercises
    • 4 Infrastructure as Code
      • 4.1 Programmable Infrastructure
      • 4.2 Tracking Changes
      • 4.3 Benefits of Infrastructure as Code
      • 4.4 Principles of Infrastructure as Code
      • 4.5 Configuration Management Tools
        • 4.5.1 Declarative Versus Imperative
        • 4.5.2 Idempotency
        • 4.5.3 Guards and Statements
      • 4.6 Example Infrastructure as Code Systems
        • 4.6.1 Configuring a DNS Client
        • 4.6.2 A Simple Web Server
        • 4.6.3 A Complex Web Application
      • 4.7 Bringing Infrastructure as Code to Your Organization
      • 4.8 Infrastructure as Code for Enhanced Collaboration
      • 4.9 Downsides to Infrastructure as Code
      • 4.10 Automation Myths
      • 4.11 Summary
      • Exercises
  • Part II: Workstation Fleet Management
    • 5 Workstation Architecture
      • 5.1 Fungibility
      • 5.2 Hardware
      • 5.3 Operating System
      • 5.4 Network Configuration
        • 5.4.1 Dynamic Configuration
        • 5.4.2 Hardcoded Configuration
        • 5.4.3 Hybrid Configuration
        • 5.4.4 Applicability
      • 5.5 Accounts and Authorization
      • 5.6 Data Storage
      • 5.7 OS Updates
      • 5.8 Security
        • 5.8.1 Theft
        • 5.8.2 Malware
      • 5.9 Logging
      • 5.10 Summary
      • Exercises
    • 6 Workstation Hardware Strategies
      • 6.1 Physical Workstations
        • 6.1.1 Laptop Versus Desktop
        • 6.1.2 Vendor Selection
        • 6.1.3 Product Line Selection
      • 6.2 Virtual Desktop Infrastructure
        • 6.2.1 Reduced Costs
        • 6.2.2 Ease of Maintenance
        • 6.2.3 Persistent or Non-persistent?
      • 6.3 Bring Your Own Device
        • 6.3.1 Strategies
        • 6.3.2 Pros and Cons
        • 6.3.3 Security
        • 6.3.4 Additional Costs
        • 6.3.5 Usability
      • 6.4 Summary
      • Exercises
    • 7 Workstation Software Life Cycle
      • 7.1 Life of a Machine
      • 7.2 OS Installation
      • 7.3 OS Configuration
        • 7.3.1 Configuration Management Systems
        • 7.3.2 Microsoft Group Policy Objects
        • 7.3.3 DHCP Configuration
        • 7.3.4 Package Installation
      • 7.4 Updating the System Software and Applications
        • 7.4.1 Updates Versus Installations
        • 7.4.2 Update Methods
      • 7.5 Rolling Out Changes...Carefully
      • 7.6 Disposal
        • 7.6.1 Accounting
        • 7.6.2 Technical: Decommissioning
        • 7.6.3 Technical: Data Security
        • 7.6.4 Physical
      • 7.7 Summary
      • Exercises
    • 8 OS Installation Strategies
      • 8.1 Consistency Is More Important Than Perfection
      • 8.2 Installation Strategies
        • 8.2.1 Automation
        • 8.2.2 Cloning
        • 8.2.3 Manual
      • 8.3 Test-Driven Configuration Development
      • 8.4 Automating in Steps
      • 8.5 When Not to Automate
      • 8.6 Vendor Support of OS Installation
      • 8.7 Should You Trust the Vendor’s Installation?
      • 8.8 Summary
      • Exercises
    • 9 Workstation Service Definition
      • 9.1 Basic Service Definition
        • 9.1.1 Approaches to Platform Definition
        • 9.1.2 Application Selection
        • 9.1.3 Leveraging a CMDB
      • 9.2 Refresh Cycles
        • 9.2.1 Choosing an Approach
        • 9.2.2 Formalizing the Policy
        • 9.2.3 Aligning with Asset Depreciation
      • 9.3 Tiered Support Levels
      • 9.4 Workstations as a Managed Service
      • 9.5 Summary
      • Exercises
    • 10 Workstation Fleet Logistics
      • 10.1 What Employees See
      • 10.2 What Employees Don’t See
        • 10.2.1 Purchasing Team
        • 10.2.2 Prep Team
        • 10.2.3 Delivery Team
        • 10.2.4 Platform Team
        • 10.2.5 Network Team
        • 10.2.6 Tools Team
        • 10.2.7 Project Management
        • 10.2.8 Program Office
      • 10.3 Configuration Management Database
      • 10.4 Small-Scale Fleet Logistics
        • 10.4.1 Part-Time Fleet Management
        • 10.4.2 Full-Time Fleet Coordinators
      • 10.5 Summary
      • Exercises
    • 11 Workstation Standardization
      • 11.1 Involving Customers Early
      • 11.2 Releasing Early and Iterating
      • 11.3 Having a Transition Interval (Overlap)
      • 11.4 Ratcheting
      • 11.5 Settinga Cut-Off Date
      • 11.6 Adapting for Your Corporate Culture
      • 11.7 Leveraging the Path of Least Resistance
      • 11.8 Summary
      • Exercises
    • 12 Onboarding
      • 12.1 Making a Good First Impression
      • 12.2 IT Responsibilities
      • 12.3 Five Keys to Successful Onboarding
        • 12.3.1 Drive the Process with an Onboarding Timeline
        • 12.3.2 Determine Needs Ahead of Arrival
        • 12.3.3 Perform the Onboarding
        • 12.3.4 Communicate Across Teams
        • 12.3.5 Reflect On and Improve the Process
      • 12.4 Cadence Changes
      • 12.5 Case Studies
        • 12.5.1 Worst Onboarding Experience Ever
        • 12.5.2 Lumeta’s Onboarding Process
        • 12.5.3 Google’s Onboarding Process
      • 12.6 Summary
      • Exercises
  • Part III: Servers
    • 13 Server Hardware Strategies
      • 13.1 All Eggs in One Basket
      • 13.2 Beautiful Snowflakes
        • 13.2.1 Asset Tracking
        • 13.2.2 Reducing Variations
        • 13.2.3 Global Optimization
      • 13.3 Buyin Bulk, Allocate Fractions
        • 13.3.1 VM Management
        • 13.3.2 Live Migration
        • 13.3.3 VM Packing
        • 13.3.4 Spare Capacity for Maintenance
        • 13.3.5 Unified VM/Non-VM Management
        • 13.3.6 Containers
      • 13.4 Grid Computing
      • 13.5 Blade Servers
      • 13.6 Cloud-Based Compute Services
        • 13.6.1 What Is the Cloud?
        • 13.6.2 Cloud Computing’s Cost Benefits
        • 13.6.3 Software as a Service
      • 13.7 Server Appliances
      • 13.8 Hybrid Strategies
      • 13.9 Summary
      • Exercises
    • 14 Server Hardware Features
      • 14.1 Workstations Versus Servers
        • 14.1.1 Server Hardware Design Differences
        • 14.1.2 Server OS and Management Differences
      • 14.2 Server Reliability
        • 14.2.1 Levels of Redundancy
        • 14.2.2 Data Integrity
        • 14.2.3 Hot-Swap Components
        • 14.2.4 Servers Should Be in Computer Rooms
      • 14.3 Remotely Managing Servers
        • 14.3.1 Integrated Out-of-Band Management
        • 14.3.2 Non-integrated Out-of-Band Management
      • 14.4 Separate Administrative Networks
      • 14.5 Maintenance Contracts and Spare Parts
        • 14.5.1 Vendor SLA
        • 14.5.2 Spare Parts
        • 14.5.3 Tracking Service Contracts
        • 14.5.4 Cross-Shipping
      • 14.6 Selecting Vendors with Server Experience
      • 14.7 Summary
      • Exercises
    • 15 Server Hardware Specifications
      • 15.1 Models and Product Lines
      • 15.2 Server Hardware Details
        • 15.2.1 CPUs
        • 15.2.2 Memory
        • 15.2.3 Network Interfaces
        • 15.2.4 Disks: Hardware Versus Software RAID
        • 15.2.5 Power Supplies
      • 15.3 Things to Leave Out
      • 15.4 Summary
      • Exercises
  • Part IV: Services
    • 16 Service Requirements
      • 16.1 Services Make the Environment
      • 16.2 Starting with a Kick-Off Meeting
      • 16.3 Gathering Written Requirements
      • 16.4 Customer Requirements
        • 16.4.1 Describing Features
        • 16.4.2 Questions to Ask
        • 16.4.3 Service Level Agreements
        • 16.4.4 Handling Difficult Requests
      • 16.5 Scope, Schedule, and Resources
      • 16.6 Operational Requirements
        • 16.6.1 System Observability
        • 16.6.2 Remote and Central Management
        • 16.6.3 Scaling Up or Out
        • 16.6.4 Software Upgrades
        • 16.6.5 Environment Fit
        • 16.6.6 Support Model
        • 16.6.7 Service Requests
        • 16.6.8 Disaster Recovery
      • 16.7 Open Architecture
      • 16.8 Summary
      • Exercises
    • 17 Service Planning and Engineering
      • 17.1 General Engineering Basics
      • 17.2 Simplicity
      • 17.3 Vendor-Certified Designs
      • 17.4 Dependency Engineering
        • 17.4.1 Primary Dependencies
        • 17.4.2 External Dependencies
        • 17.4.3 Dependency Alignment
      • 17.5 Decoupling Hostname from Service Name
      • 17.6 Support
        • 17.6.1 Monitoring
        • 17.6.2 Support Model
        • 17.6.3 Service Request Model
        • 17.6.4 Documentation
      • 17.7 Summary
      • Exercises
    • 18 Service Resiliency and Performance Patterns
      • 18.1 Redundancy Design Patterns
        • 18.1.1 Masters and Slaves
        • 18.1.2 Load Balancers Plus Replicas
        • 18.1.3 Replicas and Shared State
        • 18.1.4 Performance or Resilience?
      • 18.2 Performance and Scaling
        • 18.2.1 Dataflow Analysis for Scaling
        • 18.2.2 Bandwidth Versus Latency
      • 18.3 Summary
      • Exercises
    • 19 Service Launch: Fundamentals
      • 19.1 Planning for Problems
      • 19.2 The Six-Step Launch Process
        • 19.2.1 Step 1: Define the Ready List
        • 19.2.2 Step 2: Work the List
        • 19.2.3 Step 3: Launch the Beta Service
        • 19.2.4 Step 4: Launch the Production Service
        • 19.2.5 Step 5: Capture the Lessons Learned
        • 19.2.6 Step 6: Repeat
      • 19.3 Launch Readiness Review
        • 19.3.1 Launch Readiness Criteria
        • 19.3.2 Sample Launch Criteria
        • 19.3.3 Organizational Learning
        • 19.3.4 LRC Maintenance
      • 19.4 Launch Calendar
      • 19.5 Common Launch Problems
        • 19.5.1 Processes Fail in Production
        • 19.5.2 Unexpected Access Methods
        • 19.5.3 Production Resources Unavailable
        • 19.5.4 New Technology Failures
        • 19.5.5 Lack of User Training
        • 19.5.6 No Backups
      • 19.6 Summary
      • Exercises
    • 20 Service Launch: DevOps
      • 20.1 Continuous Integration and Deployment
        • 20.1.1 Test Ordering
        • 20.1.2 Launch Categorizations
      • 20.2 Minimum Viable Product
      • 20.3 Rapid Release with Packaged Software
        • 20.3.1 Testing Before Deployment
        • 20.3.2 Time to Deployment Metrics
      • 20.4 Cloning the Production Environment
      • 20.5 Example: DNS/DHCP Infrastructure Software
        • 20.5.1 The Problem
        • 20.5.2 Desired End-State
        • 20.5.3 First Milestone
        • 20.5.4 Second Milestone
      • 20.6 Launch with Data Migration
      • 20.7 Controlling Self-Updating Software
      • 20.8 Summary
      • Exercises
    • 21 Service Conversions
      • 21.1 Minimizing Intrusiveness
      • 21.2 Layers Versus Pillars
      • 21.3 Vendor Support
      • 21.4 Communication
      • 21.5 Training
      • 21.6 Gradual Roll-Outs
      • 21.7 Flash-Cuts: Doing It All at Once
      • 21.8 Backout Plan
        • 21.8.1 Instant Roll-Back
        • 21.8.2 Decision Point
      • 21.9 Summary
      • Exercises
    • 22 Disaster Recovery and Data Integrity
      • 22.1 Risk Analysis
      • 22.2 Legal Obligations
      • 22.3 Damage Limitation
      • 22.4 Preparation
      • 22.5 Data Integrity
      • 22.6 Redundant Sites
      • 22.7 Security Disasters
      • 22.8 Media Relations
      • 22.9 Summary
      • Exercises
  • Part V: Infrastructure
    • 23 Network Architecture
      • 23.1 Physical Versus Logical
      • 23.2 The OSI Model
      • 23.3 Wired Office Networks
        • 23.3.1 Physical Infrastructure
        • 23.3.2 Logical Design
        • 23.3.3 Network Access Control
        • 23.3.4 Location for Emergency Services
      • 23.4 Wireless Office Networks
        • 23.4.1 Physical Infrastructure
        • 23.4.2 Logical Design
      • 23.5 Datacenter Networks
        • 23.5.1 Physical Infrastructure
        • 23.5.2 Logical Design
      • 23.6 WAN Strategies
        • 23.6.1 Topology
        • 23.6.2 Technology
      • 23.7 Routing
        • 23.7.1 Static Routing
        • 23.7.2 Interior Routing Protocol
        • 23.7.3 Exterior Gateway Protocol
      • 23.8 Internet Access
        • 23.8.1 Outbound Connectivity
        • 23.8.2 Inbound Connectivity
      • 23.9 Corporate Standards
        • 23.9.1 Logical Design
        • 23.9.2 Physical Design
      • 23.10 Software-Defined Networks
      • 23.11 IPv6
        • 23.11.1 The Need for IPv6
        • 23.11.2 Deploying IPv6
      • 23.12 Summary
      • Exercises
    • 24 Network Operations
      • 24.1 Monitoring
      • 24.2 Management
        • 24.2.1 Access and Audit Trail
        • 24.2.2 Life Cycle
        • 24.2.3 Configuration Management
        • 24.2.4 Software Versions
        • 24.2.5 Deployment Process
      • 24.3 Documentation
        • 24.3.1 Network Design and Implementation
        • 24.3.2 DNS
        • 24.3.3 CMDB
        • 24.3.4 Labeling
      • 24.4 Support
        • 24.4.1 Tools
        • 24.4.2 Organizational Structure
        • 24.4.3 Network Services
      • 24.5 Summary
      • Exercises
    • 25 Datacenters Overview
      • 25.1 Build, Rent, or Outsource
        • 25.1.1 Building
        • 25.1.2 Renting
        • 25.1.3 Outsourcing
        • 25.1.4 No Datacenter
        • 25.1.5 Hybrid
      • 25.2 Requirements
        • 25.2.1 Business Requirements
        • 25.2.2 Technical Requirements
      • 25.3 Summary
      • Exercises
    • 26 Running a Datacenter
      • 26.1 Capacity Management
        • 26.1.1 Rack Space
        • 26.1.2 Power
        • 26.1.3 Wiring
        • 26.1.4 Network and Console
      • 26.2 Life-Cycle Management
        • 26.2.1 Installation
        • 26.2.2 Moves, Adds, and Changes
        • 26.2.3 Maintenance
        • 26.2.4 Decommission
      • 26.3 Patch Cables
      • 26.4 Labeling
        • 26.4.1 Labeling Rack Location
        • 26.4.2 Labeling Patch Cables
        • 26.4.3 Labeling Network Equipment
      • 26.5 Console Access
      • 26.6 Workbench
      • 26.7 Tools and Supplies
        • 26.7.1 Tools
        • 26.7.2 Spares and Supplies
        • 26.7.3 Parking Spaces
      • 26.8 Summary
      • Exercises
  • Part VI: Helpdesks and Support
    • 27 Customer Support
      • 27.1 Having a Helpdesk
      • 27.2 Offering a Friendly Face
      • 27.3 Reflecting Corporate Culture
      • 27.4 Having Enough Staff
      • 27.5 Defining Scope of Support
      • 27.6 Specifying How to Get Help
      • 27.7 Defining Processes for Staff
      • 27.8 Establishing an Escalation Process
      • 27.9 Defining “Emergency” in Writing
      • 27.10 Supplying Request-Tracking Software
      • 27.11 Statistical Improvements
      • 27.12 After-Hours and 24/7 Coverage
      • 27.13 Better Advertising for the Helpdesk
      • 27.14 Different Helpdesks for Different Needs
      • 27.15 Summary
      • Exercises
    • 28 Handling an Incident Report
      • 28.1 Process Overview
      • 28.2 Phase A—Step 1: The Greeting
      • 28.3 Phase B: Problem Identification
        • 28.3.1 Step 2: Problem Classification
        • 28.3.2 Step 3: Problem Statement
        • 28.3.3 Step 4: Problem Verification
      • 28.4 Phase C: Planning and Execution
        • 28.4.1 Step 5: Solution Proposals
        • 28.4.2 Step 6: Solution Selection
        • 28.4.3 Step 7: Execution
      • 28.5 Phase D: Verification
        • 28.5.1 Step 8: Craft Verification
        • 28.5.2 Step 9: Customer Verification/Closing
      • 28.6 Perils of Skipping a Step
      • 28.7 Optimizing Customer Care
        • 28.7.1 Model-Based Training
        • 28.7.2 Holistic Improvement
        • 28.7.3 Increased Customer Familiarity
        • 28.7.4 Special Announcements for Major Outages
        • 28.7.5 Trend Analysis
        • 28.7.6 Customers Who Know the Process
        • 28.7.7 An Architecture That Reflects the Process
      • 28.8 Summary
      • Exercises
    • 29 Debugging
      • 29.1 Understanding the Customer’s Problem
      • 29.2 Fixing the Cause, Not the Symptom
      • 29.3 Being Systematic
      • 29.4 Having the Right Tools
        • 29.4.1 Training Is the Most Important Tool
        • 29.4.2 Understanding the Underlying Technology
        • 29.4.3 Choosing the Right Tools
        • 29.4.4 Evaluating Tools
      • 29.5 End-to-End Understanding of the System
      • 29.6 Summary
      • Exercises
    • 30 Fixing Things Once
      • 30.1 Story: The Misconfigured Servers
      • 30.2 Avoiding Temporary Fixes
      • 30.3 Learn from Carpenters
      • 30.4 Automation
      • 30.5 Summary
      • Exercises
    • 31 Documentation
      • 31.1 What to Document
      • 31.2 A Simple Template for Getting Started
      • 31.3 Easy Sources for Documentation
        • 31.3.1 Saving Screenshots
        • 31.3.2 Capturing the Command Line
        • 31.3.3 Leveraging Email
        • 31.3.4 Mining the Ticket System
      • 31.4 The Power of Checklists
      • 31.5 Wiki Systems
      • 31.6 Findability
      • 31.7 Roll-Out Issues
      • 31.8 A Content-Management System
      • 31.9 A Culture of Respect
      • 31.10 Taxonomy and Structure
      • 31.11 Additional Documentation Uses
      • 31.12 Off-Site Links
      • 31.13 Summary
      • Exercises
  • Part VII: Change Processes
    • 32 Change Management
      • 32.1 Change Review Boards
      • 32.2 Process Overview
      • 32.3 Change Proposals
      • 32.4 Change Classifications
      • 32.5 Risk Discovery and Quantification
      • 32.6 Technical Planning
      • 32.7 Scheduling
      • 32.8 Communication
      • 32.9 Tiered Change Review Boards
      • 32.10 Change Freezes
      • 32.11 Team Change Management
        • 32.11.1 Changes Before Weekends
        • 32.11.2 Preventing Injured Toes
        • 32.11.3 Revision History
      • 32.12 Starting with Git
      • 32.13 Summary
      • Exercises
    • 33 Server Upgrades
      • 33.1 The Upgrade Process
      • 33.2 Step 1: Develop a Service Checklist
      • 33.3 Step 2: Verify Software Compatibility
        • 33.3.1 Upgrade the Software Before the OS
        • 33.3.2 Upgrade the Software After the OS
        • 33.3.3 Postpone the Upgrade or Change the Software
      • 33.4 Step 3: Develop Verification Tests
      • 33.5 Step 4: Choose an Upgrade Strategy
        • 33.5.1 Speed
        • 33.5.2 Risk
        • 33.5.3 End-User Disruption
        • 33.5.4 Effort
      • 33.6 Step 5: Write a Detailed Implementation Plan
        • 33.6.1 Adding Services During the Upgrade
        • 33.6.2 Removing Services During the Upgrade
        • 33.6.3 Old and New Versions on the Same Machine
        • 33.6.4 Performing a Dress Rehearsal
      • 33.7 Step 6: Write a Backout Plan
      • 33.8 Step 7: Select a Maintenance Window
      • 33.9 Step 8: Announce the Upgrade
      • 33.10 Step 9: Execute the Tests
      • 33.11 Step 10: Lock Out Customers
      • 33.12 Step 11: Do the Upgrade with Someone
      • 33.13 Step 12: Test Your Work
      • 33.14 Step 13: If All Else Fails, Back Out
      • 33.15 Step 14: Restore Access to Customers
      • 33.16 Step 15: Communicate Completion/Backout
      • 33.17 Summary
      • Exercises
    • 34 Maintenance Windows
      • 34.1 Process Overview
      • 34.2 Getting Management Buy-In
      • 34.3 Scheduling Maintenance Windows
      • 34.4 Planning Maintenance Tasks
      • 34.5 Selecting a Flight Director
      • 34.6 Managing Change Proposals
        • 34.6.1 Sample Change Proposal: SecurID Server Upgrade
        • 34.6.2 Sample Change Proposal: Storage Migration
      • 34.7 Developing the Master Plan
      • 34.8 Disabling Access
      • 34.9 Ensuring Mechanics and Coordination
        • 34.9.1 Shutdown/Boot Sequence
        • 34.9.2 KVM, Console Service, and LOM
        • 34.9.3 Communications
      • 34.10 Change Completion Deadlines
      • 34.11 Comprehensive System Testing
      • 34.12 Post-maintenance Communication
      • 34.13 Reenabling Remote Access
      • 34.14 Be Visible the Next Morning
      • 34.15 Postmortem
      • 34.16 Mentoring a New Flight Director
      • 34.17 Trending of Historical Data
      • 34.18 Providing Limited Availability
      • 34.19 High-Availability Sites
        • 34.19.1 The Similarities
        • 34.19.2 The Differences
      • 34.20 Summary
      • Exercises
    • 35 Centralization Overview
      • 35.1 Rationale for Reorganizing
        • 35.1.1 Rationale for Centralization
        • 35.1.2 Rationale for Decentralization
      • 35.2 Approaches and Hybrids
      • 35.3 Summary
      • Exercises
    • 36 Centralization Recommendations
      • 36.1 Architecture
      • 36.2 Security
        • 36.2.1 Authorization
        • 36.2.2 Extranet Connections
        • 36.2.3 Data Leakage Prevention
      • 36.3 Infrastructure
        • 36.3.1 Datacenters
        • 36.3.2 Networking
        • 36.3.3 IP Address Space Management
        • 36.3.4 Namespace Management
        • 36.3.5 Communications
        • 36.3.6 Data Management
        • 36.3.7 Monitoring
        • 36.3.8 Logging
      • 36.4 Support
        • 36.4.1 Helpdesk
        • 36.4.2 End-User Support
      • 36.5 Purchasing
      • 36.6 Lab Environments
      • 36.7 Summary
      • Exercises
    • 37 Centralizing a Service
      • 37.1 Understand the Current Solution
      • 37.2 Make a Detailed Plan
      • 37.3 Get Management Support
      • 37.4 Fix the Problems
      • 37.5 Provide an Excellent Service
      • 37.6 Start Slowly
      • 37.7 Look for Low-Hanging Fruit
      • 37.8 When to Decentralize
      • 37.9 Managing Decentralized Services
      • 37.10 Summary
      • Exercises
  • Part VIII: Service Recommendations
    • 38 Service Monitoring
      • 38.1 Types of Monitoring
      • 38.2 Building a Monitoring System
      • 38.3 Historical Monitoring
        • 38.3.1 Gathering the Data
        • 38.3.2 Storing the Data
        • 38.3.3 Viewing the Data
      • 38.4 Real-Time Monitoring
        • 38.4.1 SNMP
        • 38.4.2 Log Processing
        • 38.4.3 Alerting Mechanism
        • 38.4.4 Escalation
        • 38.4.5 Active Monitoring Systems
      • 38.5 Scaling
        • 38.5.1 Prioritization
        • 38.5.2 Cascading Alerts
        • 38.5.3 Coordination
      • 38.6 Centralization and Accessibility
      • 38.7 Pervasive Monitoring
      • 38.8 End-to-End Tests
      • 38.9 Application Response Time Monitoring
      • 38.10 Compliance Monitoring
      • 38.11 Meta-monitoring
      • 38.12 Summary
      • Exercises
    • 39 Namespaces
      • 39.1 What Is a Namespace?
      • 39.2 Basic Rules of Namespaces
      • 39.3 Defining Names
      • 39.4 Merging Namespaces
      • 39.5 Life-Cycle Management
      • 39.6 Reuse
      • 39.7 Usage
        • 39.7.1 Scope
        • 39.7.2 Consistency
        • 39.7.3 Authority
      • 39.8 Federated Identity
      • 39.9 Summary
      • Exercises
    • 40 Nameservices
      • 40.1 Nameservice Data
        • 40.1.1 Data
        • 40.1.2 Consistency
        • 40.1.3 Authority
        • 40.1.4 Capacity and Scaling
      • 40.2 Reliability
        • 40.2.1 DNS
        • 40.2.2 DHCP
        • 40.2.3 LDAP
        • 40.2.4 Authentication
        • 40.2.5 Authentication, Authorization, and Accounting
        • 40.2.6 Databases
      • 40.3 Access Policy
      • 40.4 Change Policies
      • 40.5 Change Procedures
        • 40.5.1 Automation
        • 40.5.2 Self-Service Automation
      • 40.6 Centralized Management
      • 40.7 Summary
      • Exercises
    • 41 Email Service
      • 41.1 Privacy Policy
      • 41.2 Namespaces
      • 41.3 Reliability
      • 41.4 Simplicity
      • 41.5 Spam and Virus Blocking
      • 41.6 Generality
      • 41.7 Automation
      • 41.8 Monitoring
      • 41.9 Redundancy
      • 41.10 Scaling
      • 41.11 Security Issues
      • 41.12 Encryption
      • 41.13 Email Retention Policy
      • 41.14 Communication
      • 41.15 High-Volume List Processing
      • 41.16 Summary
      • Exercises
    • 42 Print Service
      • 42.1 Level of Centralization
      • 42.2 Print Architecture Policy
      • 42.3 Documentation
      • 42.4 Monitoring
      • 42.5 Environmental Issues
      • 42.6 Shredding
      • 42.7 Summary
      • Exercises
    • 43 Data Storage
      • 43.1 Terminology
        • 43.1.1 Key Individual Disk Components
        • 43.1.2 RAID
        • 43.1.3 Volumes and File Systems
        • 43.1.4 Directly Attached Storage
        • 43.1.5 Network-Attached Storage
        • 43.1.6 Storage-Area Networks
      • 43.2 Managing Storage
        • 43.2.1 Reframing Storage as a Community Resource
        • 43.2.2 Conducting a Storage-Needs Assessment
        • 43.2.3 Mapping Groups onto Storage Infrastructure
        • 43.2.4 Developing an Inventory and Spares Policy
        • 43.2.5 Planning for Future Storage
        • 43.2.6 Establishing Storage Standards
      • 43.3 Storage as a Service
        • 43.3.1 A Storage SLA
        • 43.3.2 Reliability
        • 43.3.3 Backups
        • 43.3.4 Monitoring
        • 43.3.5 SAN Caveats
      • 43.4 Performance
        • 43.4.1 RAID and Performance
        • 43.4.2 NAS and Performance
        • 43.4.3 SSDs and Performance
        • 43.4.4 SANs and Performance
        • 43.4.5 Pipeline Optimization
      • 43.5 Evaluating New Storage Solutions
        • 43.5.1 Drive Speed
        • 43.5.2 Fragmentation
        • 43.5.3 Storage Limits: Disk Access Density Gap
        • 43.5.4 Continuous Data Protection
      • 43.6 Common Data Storage Problems
        • 43.6.1 Large Physical Infrastructure
        • 43.6.2 Timeouts
        • 43.6.3 Saturation Behavior
      • 43.7 Summary
      • Exercises
    • 44 Backup and Restore
      • 44.1 Getting Started
      • 44.2 Reasons for Restores
        • 44.2.1 Accidental File Deletion
        • 44.2.2 Disk Failure
        • 44.2.3 Archival Purposes
        • 44.2.4 Perform Fire Drills
      • 44.3 Corporate Guidelines
      • 44.4 A Data-Recovery SLA and Policy
      • 44.5 The Backup Schedule
      • 44.6 Time and Capacity Planning
        • 44.6.1 Backup Speed
        • 44.6.2 Restore Speed
        • 44.6.3 High-Availability Databases
      • 44.7 Consumables Planning
        • 44.7.1 Tape Inventory
        • 44.7.2 Backup Media and Off-Site Storage
      • 44.8 Restore-Process Issues
      • 44.9 Backup Automation
      • 44.10 Centralization
      • 44.11 Technology Changes
      • 44.12 Summary
      • Exercises
    • 45 Software Repositories
      • 45.1 Types of Repositories
      • 45.2 Benefits of Repositories
      • 45.3 Package Management Systems
      • 45.4 Anatomy of a Package
        • 45.4.1 Metadata and Scripts
        • 45.4.2 Active Versus Dormant Installation
        • 45.4.3 Binary Packages
        • 45.4.4 Library Packages
        • 45.4.5 Super-Packages
        • 45.4.6 Source Packages
      • 45.5 Anatomy of a Repository
        • 45.5.1 Security
        • 45.5.2 Universal Access
        • 45.5.3 Release Process
        • 45.5.4 Multitiered Mirrors and Caches
      • 45.6 Managinga Repository
        • 45.6.1 Repackaging Public Packages
        • 45.6.2 Repackaging Third-Party Software
        • 45.6.3 Service and Support
        • 45.6.4 Repository as a Service
      • 45.7 Repository Client
        • 45.7.1 Version Management
        • 45.7.2 Tracking Conflicts
      • 45.8 Build Environment
        • 45.8.1 Continuous Integration
        • 45.8.2 Hermetic Build
      • 45.9 Repository Examples
        • 45.9.1 Staged Software Repository
        • 45.9.2 OS Mirror
        • 45.9.3 Controlled OS Mirror
      • 45.10 Summary
      • Exercises
    • 46 Web Services
      • 46.1 Simple Web Servers
      • 46.2 Multiple Web Servers on One Host
        • 46.2.1 Scalable Techniques
        • 46.2.2 HTTPS
      • 46.3 Service Level Agreements
      • 46.4 Monitoring
      • 46.5 Scaling for Web Services
        • 46.5.1 Horizontal Scaling
        • 46.5.2 Vertical Scaling
        • 46.5.3 Choosing a Scaling Method
      • 46.6 Web Service Security
        • 46.6.1 Secure Connections and Certificates
        • 46.6.2 Protecting the Web Server Application
        • 46.6.3 Protecting the Content
        • 46.6.4 Application Security
      • 46.7 Content Management
      • 46.8 Summary
      • Exercises
  • Part IX: Management Practices
    • 47 Ethics
      • 47.1 Informed Consent
      • 47.2 Code of Ethics
      • 47.3 Customer Usage Guidelines
      • 47.4 Privileged-Access Code of Conduct
      • 47.5 Copyright Adherence
      • 47.6 Working with Law Enforcement
      • 47.7 Setting Expectations on Privacy and Monitoring
      • 47.8 Being Told to Do Something Illegal/Unethical
      • 47.9 Observing Illegal Activity
      • 47.10 Summary
      • Exercises
    • 48 Organizational Structures
      • 48.1 Sizing
      • 48.2 Funding Models
      • 48.3 Management Chain’s Influence
      • 48.4 Skill Selection
      • 48.5 Infrastructure Teams
      • 48.6 Customer Support
      • 48.7 Helpdesk
      • 48.8 Outsourcing
      • 48.9 Consultants and Contractors
      • 48.10 Sample Organizational Structures
        • 48.10.1 Small Company
        • 48.10.2 Medium-Size Company
        • 48.10.3 Large Company
        • 48.10.4 E-commerce Site
        • 48.10.5 Universities and Nonprofit Organizations
      • 48.11 Summary
      • Exercises
    • 49 Perception and Visibility
      • 49.1 Perception
        • 49.1.1 A Good First Impression
        • 49.1.2 Attitude, Perception, and Customers
        • 49.1.3 Aligning Priorities with Customer Expectations
        • 49.1.4 The System Advocate
      • 49.2 Visibility
        • 49.2.1 System Status Web Page
        • 49.2.2 Management Meetings
        • 49.2.3 Physical Visibility
        • 49.2.4 Town Hall Meetings
        • 49.2.5 Newsletters
        • 49.2.6 Mail to All Customers
        • 49.2.7 Lunch
      • 49.3 Summary
      • Exercises
    • 50 Time Management
      • 50.1 Interruptions
        • 50.1.1 Stay Focused
        • 50.1.2 Splitting Your Day
      • 50.2 Follow-Through
      • 50.3 Basic To-Do List Management
      • 50.4 Setting Goals
      • 50.5 Handling Email Once
      • 50.6 Precompiling Decisions
      • 50.7 Finding Free Time
      • 50.8 Dealing with Ineffective People
      • 50.9 Dealing with Slow Bureaucrats
      • 50.10 Summary
      • Exercises
    • 51 Communication and Negotiation
      • 51.1 Communication
      • 51.2 I Statements
      • 51.3 Active Listening
        • 51.3.1 Mirroring
        • 51.3.2 Summary Statements
        • 51.3.3 Reflection
      • 51.4 Negotiation
        • 51.4.1 Recognizing the Situation
        • 51.4.2 Format of a Negotiation Meeting
        • 51.4.3 Working Toward a Win-Win Outcome
        • 51.4.4 Planning Your Negotiations
      • 51.5 Additional Negotiation Tips
        • 51.5.1 Ask for What You Want
        • 51.5.2 Don’t Negotiate Against Yourself
        • 51.5.3 Don’t Reveal Your Strategy
        • 51.5.4 Refuse the First Offer
        • 51.5.5 Use Silence as a Negotiating Tool
      • 51.6 Further Reading
      • 51.7 Summary
      • Exercises
    • 52 Beinga Happy SA
      • 52.1 Happiness
      • 52.2 Accepting Criticism
      • 52.3 Your Support Structure
      • 52.4 Balancing Work and Personal Life
      • 52.5 Professional Development
      • 52.6 Staying Technical
      • 52.7 Loving Your Job
      • 52.8 Motivation
      • 52.9 Managing Your Manager
      • 52.10 Self-Help Books
      • 52.11 Summary
      • Exercises
    • 53 Hiring System Administrators
      • 53.1 Job Description
      • 53.2 Skill Level
      • 53.3 Recruiting
      • 53.4 Timing
      • 53.5 Team Considerations
      • 53.6 The Interview Team
      • 53.7 Interview Process
      • 53.8 Technical Interviewing
      • 53.9 Nontechnical Interviewing
      • 53.10 Selling the Position
      • 53.11 Employee Retention
      • 53.12 Getting Noticed
      • 53.13 Summary
      • Exercises
    • 54 Firing System Administrators
      • 54.1 Cooperate with Corporate HR
      • 54.2 The Exit Checklist
      • 54.3 Removing Access
        • 54.3.1 Physical Access
        • 54.3.2 Remote Access
        • 54.3.3 Application Access
        • 54.3.4 Shared Passwords
        • 54.3.5 External Services
        • 54.3.6 Certificates and Other Secrets
      • 54.4 Logistics
      • 54.5 Examples
        • 54.5.1 Amicably Leaving a Company
        • 54.5.2 Firing the Boss
        • 54.5.3 Removal at an Academic Institution
      • 54.6 Supporting Infrastructure
      • 54.7 Summary
      • Exercises
  • Part X: Being More Awesome
    • 55 Operational Excellence
      • 55.1 What Does Operational Excellence Look Like?
      • 55.2 How to Measure Greatness
      • 55.3 Assessment Methodology
        • 55.3.1 Operational Responsibilities
        • 55.3.2 Assessment Levels
        • 55.3.3 Assessment Questions and Look-For’s
      • 55.4 Service Assessments
        • 55.4.1 Identifying What to Assess
        • 55.4.2 Assessing Each Service
        • 55.4.3 Comparing Results Across Services
        • 55.4.4 Acting on the Results
        • 55.4.5 Assessment and Project Planning Frequencies
      • 55.5 Organizational Assessments
      • 55.6 Levels of Improvement
      • 55.7 Getting Started
      • 55.8 Summary
      • Exercises
    • 56 Operational Assessments
      • 56.1 Regular Tasks (RT)
      • 56.2 Emergency Response (ER)
      • 56.3 Monitoring and Metrics (MM)
      • 56.4 Capacity Planning (CP)
      • 56.5 Change Management (CM)
      • 56.6 New Product Introduction and Removal (NPI/NPR)
      • 56.7 Service Deployment and Decommissioning (SDD)
      • 56.8 Performance and Efficiency (PE)
      • 56.9 Service Delivery: The Build Phase
      • 56.10 Service Delivery: The Deployment Phase
      • 56.11 Toil Reduction
      • 56.12 Disaster Preparedness
    • Epilogue
  • Part XI: Appendices
    • A: What to Do When . . .
    • B: The Many Roles of a System Administrator
      • B.1 Common Positive Roles
      • B.2 Negative Roles
      • B.3 Team Roles
      • B.4 Summary
      • Exercises
  • Bibliography
  • Index
    • A
    • B
    • C
    • D
    • E
    • F
    • G
    • H
    • I
    • J
    • K
    • L
    • M
    • N
    • O
    • P
    • Q
    • R
    • S
    • T
    • U
    • V
    • W
    • Y
    • Z