Triggers will make a difference too. The M700 single stage is fairly crisp and light, while a lot of the stock AR triggers I have pulled are heavy, long, gritty and have gobs of over travel.
JDG is probably headed in the right direction with his thoughts on the set up you have. A good steady front and REAR rest, tight component fit and good ammo (Hornady is not bad stuff but your rifle might prefer something else) should give you ~1.5"/2" groups...