So far I haven't been robbed or been involved in any serious scam in Thailand. Including Pattaya. All foreigners every now and then pay a little too much for something they bargain for. Same for foreigners in your own country.
If you stupidly wear pounds of gold and wander around late at night drunk you make yourself a better target. If you wander around parts of Beach Road late at night and chat up the ladyboys you make yourself a better target. (When you read stories about ladyboys robbing tourists quite a few are from Middle East type countries for some reason.)
If you act stupidly you make yourself a target. Same for any country. Don't carry every cent you have with you when you go out. Hotels have safes and safety boxes. You can use ATM's for cash when needed. When I use an ATM I do look to see who is too close and tell the guy to move back. Also when using an ATM anyone too close to me with a camera placed so they can see me enter pin numbers gets a piece of my mind. Sometimes I just tell the fellow to go ahead of me and then I purposely stand so I can look at his pin numbers to piss him off! This can happen in any country.
There are guys who are stupid and leave their passports, wallets, cell phones and other valuables on the dresser with a "guest" in the hotel room. That guest could run out the door as soon as the toilet door closes. Same for women and their rent-a-dates. If this is something you or your wife will not be involved in then you have fewer things to worry about.
" I am going with my wife , and we are not going to go to walking street...."
I don't think you will have a problem walking by bars even visiting Walking Street unless you can't control the desire to go into a bar. Because no one is going to drag you into any bar! There is no real way to avoid walking by some bars so if this is a problem better skip Pattaya. Family groups, even with young kids pass through Walking Street area, that is how you get to Bali Hai Pier for rides to Koh Larn. This area does get a little lively late at night though. Daytime, early evening shouldn't be any problem with children.
There are many people from the Middle East living around the South Pattaya Road area and not too far from Walking Street area too. Lots of little restaurants with Arabic writing on the signs in that area and shisha places even close to Walking Street!
I see old foreign women retirees walking around Pattaya at night. Just keep your wits about yourself and you should be okay.
Up to you.