Post-matrix product state methods: To tangent space and beyond

We develop in full detail the formalism of tangent states to the manifold of matrix product states, and show how they naturally appear in studying time evolution, excitations, and spectral functions. We focus on the case of systems with translation invariance in the thermodynamic limit, where momentum is a well-defined quantum number. We present some illustrative results and discuss analogous constructions for other variational classes. We also discuss generalizations and extensions beyond the tangent space, and give a general outlook towards post-matrix product methods.