In case of noble gases, Vander waal forces exist between atoms which are directly proportional to size of elements.
Due to bigger size of Xe, it's electron cloud gets polarized more and as a result it has stronger Van Der Waals forces leading to a higher boiling point.