Who is the boss of the other?

The Chairman is the overall both of the district but CAO is the accountable officer and technical adviser.