The speaker shares their personal preference for buying clothes at department stores like Burlington Coat Factory and expresses that such stores do not necessarily sell fashionable or stylish clothes.