We present a holographic construction of the QCD axion based on a warped 5D model. A key ingredient of our setup is the introduction of a bulk scalar field $\theta$ which is holographically dual to the topological operator of QCD. This will make the relation between the axion, the $\eta \prime$ and the anomalies transparent. We identify the bulk modes corresponding to the $\eta \prime$ and axion states, and show that an adjustment analogous to that of the usual 4D axion takes place. We identify the origin of the axion quality problem in this framework and show that a large degree of axion compositeness is needed to solve it. We also find that in the limit of a high quality axion the physical axion state is predominantly contained in the bulk gauge field.