A little more info on your vehicle would be helpful, but I'm gonna go out on a limb here and say that a clunk in the T-case is a bad thing. Especially a loud one!
Definitely check your fluid level - like right now!
Also, was the vehicle moving, sitting still, in neutral, tires straight, or what?
T-case should shift smoothly, especially between 2H and 4H.