How high society New Yorkers lived in the 1800s? Very lavishly, and they had money to spend. Having a mansion right in the centre of town, even back then, was considered a flex.