This is more logical - the points are passed in sorted as well and there is
no way for the master sampledset to determine the ordering.