The speaker expresses confusion and frustrations with the way the seven day week operates, referencing a book that explores the difficulty in changing it due to its strong cultural presence.