We study the gauge invariance of different continuum methods to include non-perturbative effects in gauge theories. We work with three dimensional quantum electrodynamics and implement vertices using two different methods: a set of coupled Schwinger-Dyson (SD) integral equations, and the self-consistent equations obtained from the three loop 3-particle irreducible (3PI) effective action. We work in Landau gauge and assess the extent to which results are gauge invariant by checking how well the Ward identity is satisfied. Our results show that there is a fairly significant violation of the Ward identity at large coupling, although the 3PI effective theory is slightly better than the SD vertex. We also compare the results of both calculations with the commonly used Ball-Chiu ansatz and show that the agreement of the ansatz with both non-perturbative vertices is fairly good at small coupling but deviates more significantly at large coupling. We compare results for the two point functions of the theory and discuss the possible implications for phase transitions.