The speed of quantum evolution is limited under finite energy resources. While most quantum speed limits (QSLs) are formulated in terms of quantum states, they can be extended to the evolution operator itself, and thus impose fundamental limits on how quickly logical gate operations can be implemented on a quantum computer. Here, we derive a general, tight QSL that holds for any unitary evolution under the constraint that the spectral width of the Hamiltonian is bounded. We apply this result to obtain QSLs for several standard quantum gates, including Hadamard, CNOT, and Toffoli gates, finding that the QSL can vary significantly across different gates, including ones with the same entangling power. These findings can be understood geometrically using the Space Curve Quantum Control formalism, which maps unitary evolution to space curves in Euclidean space. In this formalism, the problem of finding QSLs is recast as the problem of finding minimal-length curves obeying a curvature bound. We find that time-optimal gates map to helices of varying dimensions, and that QSLs can be understood from the perspective of a bottleneck principle in which the operator that evolves the slowest governs the minimal gate time.