Haha, probably the latter. Note that I could be wrong about your BF%. If it's lower, your target weight may as well be 160+ lbs.
Looking small (with clothes on anyway) is a problem for a lot of natural lifters. Without regard of the genetically gifted or lean, for most of us it's not very satisfactory. At least esthetically.