If you are male and you are never laid off on job, you never get EI benefits. Most working female give birth at least once during their career and are paid by EI during maternity leave. In that sense, working females are subsidized by working males in terms of EI. For a typical family, the husband's share is subsidizing the wife's, so its even. For single working males, they are pure contributors in that regard.
The point is, there is no absolute fairness in this world. We should be grateful for having a job. Believe it or not, there are people who are in greater need than us. Think about something happy and have a good evening.