Sandel's aim is to criticise the influential Kantian strand of liberalism. Kant was an Enlightenment philosopher of the 18th century. He wanted to find a way to make individual autonomy the basis of morality.Nonsense. Kant was a continental philosopher whose primary aims were to rescue "truth" from Humean skepticism (via a completely bogus categorization of knowledge types), and to at the same time rescue a traditionalist conception of God. Duty is the foundation of ethics in Kant...and he is quite the friend to the religious in his philosophy.
The true founders of enlightenment philosophy are from the generation before Kant, primarily in Scotland and France. Descartes posed the questions about knowledge that undermined the conservative enterprise. Locke dabbled with them, and extended the epistemology and politics further than before. And Hume finished the questions. Kant was the Alchemist who came to try to raise the traditional positions from the dead. And his big German words were confusing enough that he seems to have succeeded. Certainly all the philosophers since who were supportive of the conservative or reactionary position followed Kant's start-point.
You want to attack the liberal position. Hume is the fulcrum. Hume taught us that it's unjustifiably insane to accept the authority of those "above" us or of "God". To get a real conservativism back, you need belief in the rightness of authority...and to get that back, you must beat back Humean skepticism. Kant led that charge, and to my mind was turned back by Hume's pikes.
A more successful response to Hume was the Common Sense of Thomas Reid, which is rather easily updated to a Bayesian approach to knowledge. But really...that doesn't rescue conservativism at all, it just allows one to escape from Humean radical skepticism.
To respond then to Oz, philosophy itself is a profoundly anti-conservative endeavor. In Haidt's typology, conservativism as an ethic is marked by an increased respect for authority, purity, and loyalty. Philosophy near universally opposes authority, purity, and loyalty in favor of a quest for transcendent truth. If you want a conservative system, ban philosophy.