It won't go away. Even if I click Dismiss, it comes back. And I have even completed 7/7 items.
This long standing bug is going to be fixed after v12 is released apparently. @Adam has posted a few times on the forums about this.
I've been experiencing this as well on the latest release.
