As the writer of First Chronicles (probably Ezra), listed the places for the Levites to live, he noted that Caleb was among them,

Now these are their dwelling places throughout their settlements in their territory, for they were given by lot to the sons of Aaron, of the family of the Kohathites: They gave them Hebron in the land of Judah, with its surrounding common-lands. But the fields of the city and its villages they gave to Caleb the son of Jephunneh. And to the sons of Aaron they gave one of the cities of refuge, Hebron; also Libnah with its common-lands, Jattir, Eshtemoa with its common-lands, Hilen with its common-lands, Debir with its common-lands, Ashan with its common-lands, and Beth Shemesh with its common-lands. And from the tribe of Benjamin: Geba with its common-lands, Alemeth with its common-lands, and Anathoth with its common-lands. All their cities among their families were thirteen (1 Chronicles 6:54–60).

I do not know what Caleb thought about that, but he lived among the people who served the Lord in the tabernacle!