Oil base or Alkyd coating typically crack and peel.
Many homes have shutters that are strictly for decoration applications. Mildew is attracted to the oil in oil-based paints and definitely will grow on latex paints as anyway.