No. Quadprog is only able to accept LINEAR constraints. (equality, inequality, as well as bound constraints on the parameters. But they are all linear.)
Anyway, if your function is itself generally nonlinear, as opposed to a quadratic form, then you still cannot use quadprog.
You can use fmincon though, as it does accept nonlinear constrints.
