The answer is positive. A regression problem is not thing but an optimization problem if you think that way. The restrictions are equivalent to constrains in optimization problems.
I am agree with bobguy. For this problem what you really need to do is to minimize the ||Y- X beta_hat||^2 subject to the constrain of a+b<1. It is quite easy to program.