Not necessarily. If you're planning a destination wedding because you don’t want to have a lot of people then don’t invite a lot of people to your wedding.
If pressure from your parents is causing you to grow the guest list offer this compromise: A small wedding ceremony and reception then go on your honeymoon and allow your parents to host a post-wedding reception bash in your honor when you're back. You can also have a small ceremony in your hometown and then a few days (or weeks) later have a reception with the larger guest list.
The bottom line: Only invite the people (or number of people) you want to celebrate with you. Never assume people won’t come. Everyone loves a wedding, especially if it's at a fabulous location.
P.S. Remember that couple who invited 200 people to their wedding in Barbados I wrote about. They thought maybe 80 people would fly Mother’s Day weekend to their wedding and in the end 180 RSVP’d yes. Everyone had a wonderful time, but the couple’s budget ended up being a lot bigger than they had planned.