We introduce a new method for finding several types of optimal k-point sets, minimizing perimeter, diameter, circumradius, and related measures, by testing sets of the O(k) nearest neighbors to each point. We argue that this is better in a number of ways than previous algorithms, which were based on high order Voronoi diagrams. Our technique allows us for the first time to efficiently dynamize our algorithms, to generalize them to higher dimensions, to find minimal convex k-vertex polygons and polytopes, and to improve many previous results. We achieve many of our results via a new algorithm for finding rectilinear nearest neighbors in the plane in time O(n log n +kn). Finally, we demonstrate a related method for finding k-point sets with minimum boundary measure or volume in arbitrary dimensions, generalizing our results for minimizing perimeter and an earlier result of the first author for minimizing area.