The survey also claims thart 80% of Britons would book more long-haul flights if flying distances were shorter.
And 77% believe that a new supersonic aircraft like Concorde will take to the skies within the next five years.
The team behind holiday booking website www.sunshine.co.uk carried out the study as part of ongoing research into the travel experiences and preferences of Britons.
In total, 2,643 people aged 18 and over took part in the study and respondents answered questions surrounding travel and transport relating to holidays.
Of those who didn't want to see the return of a supersonic jet, 66% stated that they didn't think they were safe and 21% said they thought they'd be 'bad for the environment'.
When asked what their flight time limit was, 35% of the respondents said they refused to travel anywhere with a flight time of five hours or more, ruling out long-distance destinations, including the US.
Respondents were questioned on what, if anything, put them off long distance travel, to which the number one answer emerged as 'travel times' (52%), followed by 'travel anxieties (e.g. fear of flying), an opinion that 34% of the respondents shared.
Chris Clarkson, managing director of the travel website, says:"Supersonic passenger jets would make long distance travel so much more appealing.
"Often, people will be put off the idea of visiting places like the USA, Caribbean and even further afield destinations like Australia due to the travel times; whether it's because they fear flying and don't want to put themselves through such a lengthy trip, or they just don't want the exhaustion of the journey.
"I think when it comes to supersonic air travel, it's not a matter of if, but when!
"It does feel somewhat as if we've taken a step back since Concorde stopped operating, so it will be interesting to see what the future holds."