Starting from what the Hou Hanshu says about the Southern Man in Later Han times, this article aims to measure the prescriptive importance of Fan Ye’s text, through a comparison with other types of documents, mostly unearthed documents from the Middle Yangzi area. Beyond the stereotypical image of benevolent officials educating savage barbarians, it suggests that the “Man problem” was not an ethnic issue, but rather a political and fiscal one. Indeed, most Man rebellions occurred not only because of the gradual imperial colonization of the southern part of the realm, but also because the officials holding office in the Middle Yangzi regularly questioned the Man’s fiscal status.