City officials must make improvements to address multiple "deficiencies" identified by federal and state inspectors.