Yes, he's annoying, unfunny and a sleaze. He's also a big asshole (even bigger in the comics!), i don't get why people find him charming.
That thanks to him it's hard to enjoy at times these movies. Because most of the time the Фильмы consist of RDJ derping around and unfunny jokes for 2 hours.