Learn exactly how to get rid of your chest fat. Gynecomastia is a rare condition in which men grow breast tissue. Often men suffer from pseudo gynecomastia, rather than real gynecomastia. Although, it may be distressing if you’re more prone to storing fat around your chest, fortunately, it is a fixable issue.