Why is Franky called a pervert? Dude just dresses comfy.

Did I miss his pervyness? I also feel like he has only complimented Nami and Robin by calling them "pretty lady" or some shiz like that. Just because he wears a Speedo?

What did I miss?