A mortgage banker works for a bank or lender which actually loans you the money. A mortgage broker doesn’t represent one institution, but works with many to shop for a loan for a specific individual. The broker is a middleman between you and the lender.