Abstract
Human L3MBTL1, which contains three malignant brain tumor (MBT) repeats, binds monomethylated and dimethylated lysines, but not trimethylated lysines, in several histone sequence contexts. In crystal structures of L3MBTL1 complexes, the monomethyl- and dimethyllysines insert into a narrow and deep cavity of aromatic residue-lined pocket 2, while a proline ring inserts into shallower pocket 1. We have also engineered a single Y to E substitution within the aromatic cage of the BPTF PHD finger, resulting in a reversal of binding preference from trimethyl- to dimethyllysine in an H3K4 sequence context. In both the “cavity insertion” (L3MBTL1) and “surface groove” (PHD finger) modes of methyllysine recognition, a carboxylate group both hydrogen bonds and ion pairs to the methylammonium proton. Our structural and binding studies of these two modules provide insights into the molecular principles governing the decoding of lysine methylation states, thereby highlighting a methylation state-specific layer of histone mark readout impacting on epigenetic regulation.