The Self-Consistent RPA (SCRPA) approach is elaborated for cases with a continuously broken symmetry, this being the main focus of the present article. Correlations beyond standard RPA are summed up correcting for the quasi-boson approximation in standard RPA. Desirable properties of standard RPA such as fullfillment of energy weighted sum rule and appearance of Goldstone (zero) modes are kept. We show theoretically and, for a model case, numerically that, indeed, SCRPA maintains all properties of standard RPA for practically all situations of spontaneously broken symmetries. A simpler approximate form of SCRPA, the so-called renormalised RPA, also has these properties. The SCRPA equations are first outlined as an eigenvalue problem, but it is also shown how an equivalent many body Green's function approach can be formulated.