You need a demolition permit if you are taking down a building or a portion of a building. This applies to any permanent structure, like a tool shed or accessory building.
Demolition permits follow the building permit process, but they have their own application form.