Optical transport and wavelengths

Almost every bit that leaves a server rack travels part of its journey as light. Inside a data hall, light carries traffic from leaves to spines over a few hundred metres. Across a campus, it links buildings over a few kilometres. Between data centres in a metro area, between cities and under oceans, it carries terabits per second over thousands of kilometres. Fibre optics is the physical layer of the modern internet, and it is the part of networking that data centre engineers design most directly: the fibre types, the cable plant, the connectors, the loss budgets and the rooms for optical equipment.

This chapter explains how optical fibre works, the two main fibre types and when each is used, how transceivers are named and what their reach limits are, how to calculate a loss budget, and how dense wavelength division multiplexing (DWDM) packs dozens of independent channels into one fibre for long-distance and data centre interconnect links.

How optical fibre works

An optical fibre is a strand of ultra-pure glass about the thickness of a human hair: 125 µm in diameter. It has two parts: a central core and a surrounding cladding, made of glass with a slightly lower refractive index. Light launched into the core strikes the core-cladding boundary at a shallow angle and is reflected back by total internal reflection, so it stays trapped in the core and follows the fibre around gentle bends. A plastic coating, 250 µm in diameter (sometimes 200 µm in high-density cables), protects the glass, and cables add buffer tubes, strength members and an outer jacket.

Glass absorbs and scatters a little light. The loss is measured in decibels per kilometre (dB/km) and depends strongly on wavelength. Modern single-mode fibre loses roughly 0.35 dB/km at 1310 nm and about 0.2 dB/km at 1550 nm, which means half the light remains after about 15 km at 1550 nm. That astonishing transparency is what makes long-distance optical communication possible.

Light in glass travels slower than in a vacuum by a factor equal to the refractive index, about 1.47 for the core of standard fibre. That gives the figure from Lesson 7: about 204,000 km/s, or 4.9 µs per kilometre.

Decibels in optics

Optical power is expressed in dBm, decibels relative to one milliwatt:

So 1 mW is 0 dBm, 2 mW is about +3 dBm, 0.5 mW is about −3 dBm and 0.1 mW is −10 dBm. Losses are expressed in dB. The advantage is that losses simply add: the power at the receiver in dBm is the transmitter power in dBm minus the sum of all the losses in dB along the way. A loss of 3 dB halves the power; 10 dB leaves one tenth; 20 dB leaves one hundredth.

Single-mode and multimode fibre

The core diameter decides how many paths, or modes, light can take through the fibre.

• Single-mode fibre (SMF) has a tiny core, about 9 µm across. Only one mode propagates, so pulses do not spread out from different path lengths. Single-mode fibre carries signals for tens of kilometres without amplification and thousands with it. The standard grade for data centres and outside plant is OS2 (ITU-T G.652.D), often with bend-insensitive versions (G.657.A1) for tight routing. Its jacket is usually yellow.
• Multimode fibre (MMF) has a larger core, 50 µm in modern grades. Many modes propagate, each taking a slightly different path, so a short pulse spreads out over distance (modal dispersion). This limits reach to a few hundred metres at high speeds. Multimode grades are named OM3, OM4 and OM5, with increasing bandwidth; OM3 jackets are usually aqua, OM4 aqua or violet (erika violet), and OM5 lime green. Older OM1 and OM2 fibres are obsolete for data centres.

Why use multimode at all? Historically, multimode optics used cheap vertical-cavity surface-emitting lasers (VCSELs) at 850 nm and were much less expensive than single-mode optics, while the larger core made alignment easier. For links under about 100 m, multimode was the economical choice. As speeds have risen and single-mode optics have become cheaper through enormous hyperscale volumes, the balance has shifted. Many new hyperscale and AI facilities use single-mode fibre for almost everything beyond the rack, because single-mode reach easily covers any hall and the same fibre will support future speeds. Enterprise and colocation facilities still use a lot of OM4 multimode for short links.

Transceivers and their names

Lesson 1 introduced pluggable transceivers. Their IEEE names describe what they do: speed, signalling, reach and lanes. For example, in 400GBASE-DR4, "400G" is the speed, "BASE" means baseband signalling, "DR" means 500 m reach on single-mode fibre, and "4" means four parallel lanes, each on its own fibre pair. The common reach codes are SR (short reach, multimode), DR (500 m, single-mode, parallel fibres), FR (2 km, single-mode), LR (6 to 10 km) and ER (30 to 40 km).

There are two ways to build a fast optic from slower lanes. Parallel optics (SR4, SR8, DR4, DR8) send each lane on its own fibre, so a 400GBASE-DR4 link uses eight fibres: four to transmit and four to receive. Wavelength-multiplexed optics (FR4, LR4) put each lane on a different wavelength and combine them onto one fibre, so the link needs only two fibres. Parallel optics are cheaper per module and can be broken out into separate lower-speed links; multiplexed optics save fibre, which matters over longer distances. The choice decides the fibre count of the whole cable plant, so it must be agreed with the network architect before the cabling is designed.

Connectors

Duplex links use LC connectors, which are small push-latch connectors holding one fibre each, mounted in pairs. Parallel optics use MPO (multi-fibre push-on) connectors holding 8, 12, 16 or 24 fibres in a single rectangular ferrule. Very small form factor connectors (such as SN, MDC and CS) pack two fibres into a smaller footprint so that more links fit in a patch panel or an 800G transceiver can carry two duplex links.

Single-mode connectors come with two end-face polishes. UPC (ultra physical contact) connectors have a domed end face and are usually blue. APC (angled physical contact) connectors are polished at 8° so that reflected light leaves the core, and they are green. They must never be mated with each other: the gap damages both and causes high loss. Many modern single-mode optics, including MPO-based DR4, use APC connectors.

Contamination is the leading cause of optical link problems. A speck of dust a few micrometres across on a single-mode core can block much of the light or scratch the end face permanently when the connector is mated. The rule in every data centre is "inspect before you connect": every connector end face is examined with a fibre microscope and cleaned if necessary before it is plugged in, using standard pass/fail criteria (IEC 61300-3-35).

Loss budgets

Every optic has a power budget: the maximum loss the link between its transmitter and receiver can have while still working within its specified error rate. IEEE specifies this as the maximum channel insertion loss. For example, 100GBASE-SR4 allows 1.9 dB over OM4, and 100GBASE-LR4 allows 6.3 dB. A designer must check that the loss of each planned link is below the budget, with some margin for ageing, repairs and future patching.

The loss of a link is the sum of three parts:

where \(\alpha\) is the fibre attenuation in dB/km, \(L\) the length in km, \(n_c\) and \(L_c\) the number of mated connector pairs and the loss of each, and \(n_s\) and \(L_s\) the number of splices and the loss of each. Typical design values are about 3.0 dB/km for multimode fibre at 850 nm, 0.35 to 0.5 dB/km for single-mode fibre at 1310 nm, 0.15 to 0.5 dB per mated connector pair depending on quality (MPO connectors are higher than LC), and 0.1 dB per fusion splice.

After installation, every link is tested. A light source and power meter measure total loss against the design. An OTDR (optical time-domain reflectometer) sends pulses down the fibre and measures reflections over time, producing a trace that shows the location and loss of each connector, splice and fault; it is the tool that tells a repair crew exactly where a cable has been cut.

Dense wavelength division multiplexing

One fibre can carry many signals at once if each uses a different wavelength, just as many radio stations share the air on different frequencies. This is wavelength division multiplexing (WDM). Coarse WDM (CWDM), used inside FR4 and LR4 optics, places a few wavelengths 20 nm apart. Dense WDM (DWDM) packs dozens of channels closely together in the C-band, the range around 1530 to 1565 nm where fibre loss is lowest and optical amplifiers work best.

DWDM channels are placed on a grid of frequencies defined by ITU-T Recommendation G.694.1, anchored at 193.1 THz. The wavelength of a channel follows from \(\lambda = c/f\): 193.1 THz corresponds to 1552.52 nm. Older systems used fixed 100 GHz or 50 GHz spacing. Modern systems use a flexible grid in 12.5 GHz slices, giving each channel as much spectrum as its data rate needs, for example 75 GHz for a 400 Gb/s channel.

Coherent optics and amplifiers

High-speed long-distance channels use coherent optics. Instead of just switching light on and off or between intensity levels, a coherent transmitter encodes data in the amplitude and phase of the light and in both polarizations, and the receiver mixes the incoming signal with a local laser and uses a powerful digital signal processor (DSP) to recover it. The DSP also undoes chromatic dispersion, the spreading of pulses because different wavelengths travel at slightly different speeds (about 17 ps per nm per km in standard fibre at 1550 nm). Coherent technology is why a single wavelength can now carry 800 Gb/s or more across a continent.

Coherent optics used to require large dedicated chassis. Since about 2020, 400ZR optics have packed a coherent DWDM transceiver into the same QSFP-DD or OSFP pluggable format as a short-reach module, so a router or switch in one data centre can connect directly over a DWDM line system to a router in another data centre up to about 120 km away. This made data centre interconnect (DCI) in metro areas far simpler and cheaper, and it is how cloud providers link the buildings in a region.

Over distances beyond one span, the signal must be amplified. An erbium-doped fibre amplifier (EDFA) boosts all the DWDM channels together in the optical domain, without converting them to electrical signals, typically every 80 to 100 km. ROADMs (reconfigurable optical add-drop multiplexers) at junctions let operators add, drop or redirect individual wavelengths remotely. Amplifier and ROADM sites are small buildings or huts along the route, with their own power and cooling, and a long-haul route has dozens of them.

Fibre plant in and between data centres

Data centre fibre counts have exploded with AI. A hyperscale campus may link buildings with cables of 3456 or 6912 fibres, made possible by ribbon and rollable-ribbon designs that bond 12 fibres side by side and can be fusion-spliced 12 at a time. Inside a hall, trunk cables with MPO connectors on both ends run in overhead trays from rows to network areas, and modular cassettes at each end convert MPO trunks to the connectors the equipment needs.

Fibre cables inside buildings must also meet fire and smoke requirements. In Canada, optical fibre cables are covered by Section 56 of the Canadian Electrical Code and must carry flame-spread ratings from CSA tests. FT4 (a vertical tray flame test) is the common rating for general building and riser use, and FT6, a more severe flame and smoke test, is required in plenums and other spaces where the National Building Code calls for it. Specifying the wrong rating is a frequent cause of failed inspections.