The Boiler Inspector shall keep in the office of the Boiler Inspection Service all applications made, and a complete record thereof, as well as of all certificates issued. He shall also keep a complete record of each boiler and unfired pressure vessel inspected, and such other records and data pertaining to the Boiler Inspection Service as may be directed by the Mayor of the District of Columbia.