Do you think my neighbor was out of line to sarcastically ask me what our family does on Sundays?

They know we don't attend a "house of worship" and their question was asked in a condescending manner - as if our Sundays (and lives) are somehow meaningless because we choose not to engage in the same activities as them...