DnaK is a molecular chaperone that has important roles in protein folding. The hydrolysis of ATP is essential to this activity, and the effects of nucleotides on the structure and function of DnaK have been extensively studied. However, the key residues that govern the conformational motions that define the apo, ATP-bound, and ADP-bound states are not entirely clear. Here, we used molecular dynamics simulations, mutagenesis, and enzymatic assays to explore the molecular basis of this process. Simulations of DnaKs nucleotide-binding domain (NBD) in the apo, ATP-bound, and ADP/Pi-bound states suggested that each state has a distinct conformation, consistent with available biochemical and structural information. The simulations further suggested that large shearing motions between subdomains I-A and II-A dominated the conversion between these conformations. We found that several evolutionally conserved residues, especially G228 and G229, appeared to function as a hinge for these motions, because they predominantly populated two distinct states depending on whether ATP or ADP/Pi was bound. Consistent with the importance of these hinge residues, alanine point mutations caused DnaK to have reduced chaperone activities in vitro and in vivo. Together, these results clarify how sub-domain motions communicate allostery in DnaK.