It takes about one hour to play 18 holes of golf. The other 2.5 to 4.5 hours is "logistical positioning" -- getting to the next shots with the right equipment. Any golf tournament including the PGA Tour played by the rules (no gimmies, no fluffing, etc.) is not going to be completed in under 4 3/4 hours. Add hackers and add time.

The slowest group dictates the pace of play for everyone behind them. Any group that gets out of position -- especially early in the day -- will affect many groups after it.

The pairings are designed with "fun" as top priority and "pace of play" as a close second.
Skilled golfers should educate and lead by example. Everyone needs to enjoy their round, but allow low handicappers to help move things along.

Raking bunkers for others, fixing divots for others, replacing divots for others, and carrying a pocket full of XL Top-Flites is being someone's caddy. It also is speeding up pace of play.
Hitting your own ball first, putting out on occasion, and even putting out of turn while someone is raking a greenside bunker can do wonders for pace of play.

None of the above requires a fellow golfer to play faster between pulling a club from the bag and swinging it. It does imply as a foursome we will work together to play faster.
Your foursome is playing slow if you cannot see the foursome in front of you.