We present a perturbative approach to include tensor terms in the Gogny interaction. We do not change the values of the usual parameterisations, with the only exception of the spin-orbit term, and we add tensor terms whose only free parameters are the strengths of the interactions. We identify observables sensitive to the presence of the tensor force in Hartree-Fock, Hartree-Fock-Bogoliubov and random phase approximation calculations. We show the need of including two tensor contributions, at least: a pure tensor term and a tensor-isospin term. We show results relevant for the inclusion of the tensor term for single-particle energies, charge-conserving magnetic excitations and Gamow-Teller excitations.