DNA polymerases are essential enzymes that faithfully and efficiently replicate genomic information.1-3 The mechanism of nucleotide incorporation by DNA polymerases has been extensively studied structurally and kinetically, but several key steps following phosphodiester bond formation remain structurally uncharacterized due to utilization of natural nucleotides. It is thought that the release of pyrophosphate (PPi) triggers reverse conformational changes in a polymerase in order to complete a full catalytic cycle as well as prepare for DNA translocation and subsequent incorporation events. Here, by using the triphosphates of chain-terminating antiviral drugs lamivudine ((-)3TC-TP) and emtricitabine ((-)FTC-TP), we structurally reveal the correct sequence of post-chemistry steps during nucleotide incorporation by human DNA polymerase $\beta$ (hPol$\beta$) and provide a structural basis for PPi release. These post-catalytic structures reveal hPol$\beta$ in an open conformation with PPi bound in the active site, thereby strongly suggesting that the reverse conformational changes occur prior to PP; release. The results also help to refine the role of the newly discovered third divalent metal ion for DNA polymerase-catalyzed nucleotide incorporation. Furthermore, a post-chemistry structure of hPol$\beta$ in the open conformation, following incorporation of (-)3TC-MP, with a second (-)3TC-TP molecule bound to the active site in the absence of PPi, suggests that nucleotide binding stimulates PPi dissociation and occurs before polymerase translocation. Our structural characterization defines the order of the elusive post-chemistry steps in the canonical mechanism of a DNA polymerase.