As someone who knows the Dutertes personally, I can personally say that they were never poor