Motivated by recent developments in augmented reality display technology and notably smartglasses, we present a geometric framework to model the optical effects of deformations of planar holographic optical elements into curved surfaces. In particular, we consider deformations into shapes that do not preserve the Gaussian curvature, such as deforming planar regions into sphere segments.