I'm a sucker for the neatness of the square.

All stone in the home is a sign of quality. Stone surfaces are very "forgiving" and best of all, can be restored, polished or repaired. Consider the durability of natural and engineered stone in the home. The Marble Man specialise in stone polishing, repairs and sealing. www.themarbleman.com.au 1300 627 626 will always recommend stone!

Both have their place depending on taste and budget.

A lot of the time they build a core filled concrete block wall then construct another stone wall against it. The concrete block wall takes the job of retaining while the stone is for looks only. It does depend on what purpose the wall is performing. For example a retaining wall higher than 600mm (usually) needs engineering by a structural engineer which is easier to achieve with core filled concrete block on footings rather than just solid stone. You never mentioned the purpose of the wall which is a vital detail as there can be numerous ways to achieve similar outcomes.