The quantum Brownian motion (QBM) with couplings nonlinear (quadratic) in the environment coordinates was studied. The influence functional for nonlinear interactions up to second order of perturbation with generalized initial conditions was constructed. This functional was used to get the propagator for the particle in a harmonic potential as well as for the particle in an additional an harmonic potential.