Looks like a mud dauber. That type wasp usually isn’t aggressive. If it is cold where you are the insects will be sluggish. They are sluggish at night too.
The nests are easy to smash/remove with a broom and/or a very strong stream of water. This time of year I think you’ll only find larva inside. Just in case wear long sleeves and have a can of wasp spray handy, They do tend to like specific spots so check this area every so often in the summer. It is easy to discourage them when the nest is first being constructed.
