Punishments are dealt to the brothers if they miss a video (Exceptions: Major holidays, hospitalization, paternity leaves, post Brotherhood 2.0), Make a video over 4 minutes (Exceptions: Educational videos, videos containing montages, videos that are 4:01 long, post Brotherhood 2.0) or communicate textually (Brotherhood 2.0 only). Any punishment can be vetoed by the brothers' wives if they deem it to be inappropriate, too gross, or generally too extreme. Such vetoed suggestions include Hank having to pay for every hand gesture in all of his videos (which is a lot). One time Hank asked to sleep with John's wife, which was vetoed obviously.
This video by Hank explains a history of punishments up until July 2014.